CN106782558A - A kind of vehicle-mounted interactive system of intelligent sound with image understanding - Google Patents
A kind of vehicle-mounted interactive system of intelligent sound with image understanding Download PDFInfo
- Publication number
- CN106782558A CN106782558A CN201611230108.5A CN201611230108A CN106782558A CN 106782558 A CN106782558 A CN 106782558A CN 201611230108 A CN201611230108 A CN 201611230108A CN 106782558 A CN106782558 A CN 106782558A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- image
- module
- voice
- offline
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 34
- 230000006855 networking Effects 0.000 claims abstract description 47
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 25
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 25
- 230000004044 response Effects 0.000 claims abstract description 21
- 238000004891 communication Methods 0.000 claims abstract description 10
- 238000012544 monitoring process Methods 0.000 claims description 31
- 230000006870 function Effects 0.000 claims description 26
- 230000002093 peripheral effect Effects 0.000 claims description 11
- 238000004378 air conditioning Methods 0.000 claims description 6
- 239000002131 composite material Substances 0.000 claims description 6
- 230000010365 information processing Effects 0.000 claims description 3
- 238000012545 processing Methods 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 claims 1
- 238000005516 engineering process Methods 0.000 abstract description 5
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
- H04B1/3822—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving specially adapted for use in vehicles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/28—Constructional details of speech recognition systems
- G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Acoustics & Sound (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Medical Informatics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses a kind of vehicle-mounted interactive system of the intelligent sound with image understanding, including the vehicle-mounted interactive system of on-line intelligence voice and the vehicle-mounted interactive system of offline intelligent sound with image understanding, the vehicle-mounted interactive system of on-line intelligence voice with image understanding, including vehicle mobile terminals, onboard wireless gateway, car networking cloud platform and internet, the described vehicle-mounted interactive system of offline intelligent sound, including offline speech reception module, vehicle OBD interfaces, offline speech recognition engine, offline speech synthesis engine, offline voice playing module and vehicle mobile terminals.New experience is driven the invention provides the unprecedented auxiliary of one kind, innovatively with technologies such as image understanding, natural language understanding, intelligent sound and network communications, the more more rich user's request response of real time comprehensive traffic information and connection internet is interacted in the form of intelligent sound with user.
Description
Technical field
The present invention relates to a kind of vehicle-mounted interactive system of the intelligent sound with image understanding, belong to areas of information technology, it is main
It is related to Internet of Things, car networking, mobile Internet, network communication, database, intelligent sound, natural language understanding, image to manage
Solution.
Background technology
In recent years, with the development of mobile network and widely using for mobile intelligent terminal equipment, using intelligent movable end
The car networking that the satellite fix and radio communication function at end build, realizes that more more complicated functions have been inexorable trends.But gather around
Having many multi-functional vehicle-mounted terminal systems needs the more more complicated interactive operations of driver, when carrying out these operations, drives
The person of sailing cannot typically eye to the front, therefore increased and the risk of traffic accident occur.Therefore other measures need to be introduced to cause phase
Pass information is more enough preferably to be interacted with driver.
The content of the invention
Present invention aim at a kind of vehicle-mounted interactive system of intelligent sound with image understanding is provided, before one kind to be provided
Not some auxiliary driving experiences.
To achieve the above object, the invention provides a kind of vehicle-mounted interactive system of the intelligent sound with image understanding, should
The vehicle-mounted interactive system of intelligent sound with image understanding includes the vehicle-mounted interactive system of on-line intelligence voice with image understanding
With the vehicle-mounted interactive system of offline intelligent sound.
The vehicle-mounted interactive system of on-line intelligence voice with image understanding, including vehicle mobile terminals, onboard wireless
Gateway, car networking cloud platform and internet, periphery road conditions image information, real-time video prison for integrating the shooting of vehicle camera
The Real-time Collection Current vehicle peripheral path video monitoring image that control module is received, and according to user to Internet resources information
Many demands its be analyzed, realize the semantic understanding of image, by real time comprehensive traffic information and connection internet it is more
More rich user's request response is interacted in the form of intelligent sound with user.
In order to further improve performance, described vehicle mobile terminals be used to receiving the vehicle-surroundings road conditions image information and
Needing connection car networking cloud platform could complete the complicated user voice data of speech identifying function, and by onboard wireless gateway
Send to car networking cloud platform, while receiving the image understanding engine real-time processing of car networking cloud platform by onboard wireless gateway
Traffic information and according to a series of nets such as customer requirement retrieval Weather information, Domestic News, Email, ambient services
The voice feedback information of the other users demand response such as network resource, and the intelligent sound for carrying out the function with user interacts, including
Vehicle-mounted image receiver module, online speech reception module, vehicle-mounted image sending module, online voice sending module, voice feedback
Information receiving module, online voice playing module；
Wherein, described vehicle-mounted image receiver module, vehicle periphery road conditions video is shot by vehicle-mounted camera, receives the vehicle
Periphery road conditions image information；
Described online speech reception module, by gathering the speech data of user, receives for needing connection car networking cloud to put down
Platform could complete the complicated user voice data of speech identifying function；
Described vehicle-mounted image sending module, for receiving the vehicle-surroundings road conditions image letter that vehicle-mounted image receiver module is received
Breath, and sent to car networking cloud platform by onboard wireless gateway；
Described online voice sending module, car networking cloud platform is connected for receiving the need for online speech reception module is received
The complicated user voice data of speech identifying function could be completed；
Described voice feedback information receiving module, receives what voice feedback information sending module sent by onboard wireless gateway
Voice signal；
Described online voice playing module, for the composite result of online speech synthesis engine to be played into user；
In order to further improve performance, described car networking cloud platform, on the one hand, connect the need for being received by onboard wireless gateway
Pick up networking cloud platform and could complete the complicated user voice data of speech identifying function and understood, recognized, on the other hand, profit
The vehicle-surroundings road conditions image letter that vehicle-mounted image sending module sends will be received by onboard wireless gateway with image understanding engine
Breath and real-time video monitoring module Real-time Collection Current vehicle peripheral path video monitoring image are analyzed, and realize the language of image
Reason and good sense solution, and receive other users demand response module according to customer requirement retrieval Weather information, Domestic News, Email,
A series of network resource informations such as ambient services synthesize voice signal, including the vehicle-mounted image receiver module in high in the clouds, high in the clouds voice
Receiver module, online speech recognition engine, real-time video monitoring module, image understanding engine, other users demand response module,
Online speech synthesis engine, voice feedback information sending module；
Wherein, the vehicle-mounted image receiver module in described high in the clouds, receives vehicle-mounted image sending module and sends by onboard wireless gateway
Vehicle-surroundings road conditions image information；
Described high in the clouds speech reception module, is connected car and joined the need for being received by the online speech reception module of onboard wireless gateway
Net cloud platform could complete the complicated user voice data of speech identifying function；
Described online speech recognition engine, car networking cloud platform is connected the need for being received to high in the clouds speech reception module could be complete
Complicated user voice data into speech identifying function is understood, is recognized；
Described real-time video monitoring module, collects road video monitoring image, is positioned according to vehicle GPS, and Real-time Collection is current
Vehicle-surroundings road video monitoring image；
Described image understanding engine, integrates vehicle-surroundings road conditions image information and reality that the vehicle-mounted image receiver module in high in the clouds is received
When video monitoring module receive Real-time Collection Current vehicle peripheral path video monitoring image, it is analyzed, realize figure
The semantic understanding of picture；
Described other users demand response module, according to customer requirement retrieval Weather information, Domestic News, Email, week
A series of network resource informations such as side service；
Other are needed to user for described online speech synthesis engine, the information that image understanding engine is exported and car networking cloud platform
The response asked, synthesizes voice signal；
Described voice feedback information sending module, synthesizes voice signal, and pass through for receiving online speech synthesis engine
Onboard wireless gateway is sent to voice feedback information receiving module；
In order to further improve performance, described onboard wireless gateway connects with car networking cloud platform and vehicle mobile terminals respectively
Connect, for realizing the radio communication function between vehicle mobile terminals and car networking cloud platform；
In order to further improve performance, described internet is connected with car networking cloud platform, for obtaining Weather information, news
A series of Internet resources such as information, Email, ambient services.
The described vehicle-mounted interactive system of offline intelligent sound, including it is offline speech reception module, vehicle OBD interfaces, offline
Speech recognition engine, offline speech synthesis engine, offline voice playing module and vehicle mobile terminals, for showing without networking
Achievable user's request interactive voice；
Wherein, described offline speech reception module, by gathering the speech data of user, receive for control automotive window,
The user base voice control command of air-conditioning, broadcast etc.；
Described vehicle OBD interfaces, for exporting the vehicle condition parameter information such as including speed, rotating speed, oil consumption；
Described offline speech recognition engine, for offline speech reception module is received for control automotive window, air-conditioning,
The user base voice control command of broadcast etc. is understood, is recognized；
Described offline speech synthesis engine, for the vehicle condition parameter information and the offline voice of execution that export vehicle OBD interfaces
Automobile synthesizes voice signal to the demand response of user after control command；
Described offline voice playing module, for the composite result of offline speech synthesis engine to be played into user；
Described vehicle mobile terminals, according to OBD agreements and vehicle OBD interface communications, and are carrying out OBD in local off-line state
Information and simple speech identification, the information processing of simple speech synthesis.
Beneficial effect is：Compared with the existing technology, new experience is driven the invention provides the unprecedented auxiliary of one kind.
The present invention considers that user cannot well pay close attention to the situation of image information, innovatively with image understanding, natural language understanding, intelligence
The energy technology such as voice and network communication is to integrating vehicle-surroundings road conditions image information, reality that the vehicle-mounted image receiver module in high in the clouds is received
When the Real-time Collection Current vehicle peripheral path video monitoring image that receives of video monitoring module, and according to user to internet
It is analyzed many demands of resource information, realizes the semantic understanding of image, and real time comprehensive traffic information and connection are interconnected
The more more rich user's request response of net is interacted in the form of intelligent sound with user.
Brief description of the drawings
Accompanying drawing described herein is used for providing a further understanding of the present invention, constitutes the part of the application, this hair
Bright schematic description and description does not constitute inappropriate limitation of the present invention for explaining the present invention.
Accompanying drawing 1 is the overall structure diagram of the vehicle mobile terminals system that the present invention is provided；
Accompanying drawing 2 is the structural representation of the online intelligent speech interactive system with image understanding according to alternative embodiment of the present invention
Figure；
Accompanying drawing 3 is the structural representation of the offline intelligent speech interactive system according to alternative embodiment of the present invention.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below with reference to accompanying drawing and in conjunction with the embodiments
To describe the present invention in detail.
Embodiment one
A kind of vehicle-mounted interactive system of on-line intelligence voice with image understanding is present embodiments provided, vehicle camera is integrated and is clapped
The Real-time Collection Current vehicle peripheral path video monitoring figure that the periphery road conditions image information taken the photograph, real-time video monitoring module are received
Picture, and according to user, to many demands of Internet resources information, it is analyzed, and realizes the semantic understanding of image, will be real-time
The more more rich user's request response of comprehensive road condition information and connection internet is carried out in the form of intelligent sound with user
Interact as schemed shown in attached 2, including vehicle mobile terminals, onboard wireless gateway, car networking cloud platform, internet etc., wherein：
Alternatively, described vehicle mobile terminals are used to receive the vehicle-surroundings road conditions image information and need to connect car networking cloud
Platform could complete the complicated user voice data of speech identifying function, and send flat to car networking cloud by onboard wireless gateway
Platform, at the same pass through onboard wireless gateway receive car networking cloud platform image understanding engine real-time processing traffic information and
According to other users such as a series of Internet resources such as customer requirement retrieval Weather information, Domestic News, Email, ambient services
The voice feedback information of demand response, and the intelligent sound for carrying out the function with user interacts, including vehicle-mounted image receiver module,
It is online speech reception module, vehicle-mounted image sending module, online voice sending module, voice feedback information receiving module, online
Voice playing module, wherein：
Described vehicle-mounted image receiver module, vehicle periphery road conditions video is shot by vehicle-mounted camera, receives the vehicle-surroundings
Road conditions image information；
Described online speech reception module, by gathering the speech data of user, receives for needing connection car networking cloud to put down
Platform could complete the complicated user voice data of speech identifying function；
Described vehicle-mounted image sending module, for receiving the vehicle-surroundings road conditions image letter that vehicle-mounted image receiver module is received
Breath, and sent to car networking cloud platform by onboard wireless gateway；
Described online voice sending module, car networking cloud platform is connected for receiving the need for online speech reception module is received
The complicated user voice data of speech identifying function could be completed；
Described voice feedback information receiving module, receives what voice feedback information sending module sent by onboard wireless gateway
Voice signal；
Described online voice playing module, for the composite result of online speech synthesis engine to be played into user；
Alternatively, described car networking cloud platform, on the one hand, car networking cloud is connected the need for being received by onboard wireless gateway and is put down
The complicated user voice data that platform could complete speech identifying function is understood, is recognized, on the other hand, drawn using image understanding
Holding up will receive vehicle-surroundings road conditions image information and the real-time video that vehicle-mounted image sending module sends by onboard wireless gateway
Monitoring module Real-time Collection Current vehicle peripheral path video monitoring image is analyzed, and realizes the semantic understanding of image, and connect
Other users demand response module is received according to customer requirement retrieval Weather information, Domestic News, Email, ambient services etc.
Series of network resource information synthesizes voice signal, including the vehicle-mounted image receiver module in high in the clouds, high in the clouds speech reception module, online
Speech recognition engine, real-time video monitoring module, image understanding engine, other users demand response module, online phonetic synthesis
Engine, voice feedback information sending module, wherein：
The vehicle-mounted image receiver module in described high in the clouds, the vehicle that vehicle-mounted image sending module sends is received by onboard wireless gateway
Periphery road conditions image information；
Described high in the clouds speech reception module, is connected car and joined the need for being received by the online speech reception module of onboard wireless gateway
Net cloud platform could complete the complicated user voice data of speech identifying function；
Described online speech recognition engine, car networking cloud platform is connected the need for being received to high in the clouds speech reception module could be complete
Complicated user voice data into speech identifying function is understood, is recognized；
Described real-time video monitoring module, collects road video monitoring image, is positioned according to vehicle GPS, and Real-time Collection is current
Vehicle-surroundings road video monitoring image；
Described image understanding engine, integrates vehicle-surroundings road conditions image information and reality that the vehicle-mounted image receiver module in high in the clouds is received
When video monitoring module receive Real-time Collection Current vehicle peripheral path video monitoring image, it is analyzed, realize figure
The semantic understanding of picture；
Described other users demand response module, according to customer requirement retrieval Weather information, Domestic News, Email, week
A series of network resource informations such as side service；
Other are needed to user for described online speech synthesis engine, the information that image understanding engine is exported and car networking cloud platform
The response asked, synthesizes voice signal；
Described voice feedback information sending module, synthesizes voice signal, and pass through for receiving online speech synthesis engine
Onboard wireless gateway is sent to voice feedback information receiving module；
Alternatively, described onboard wireless gateway, is connected, with car networking cloud platform and vehicle mobile terminals for realizing car respectively
Carry the radio communication function between mobile terminal and car networking cloud platform；
Alternatively, described internet, is connected with car networking cloud platform, for obtaining Weather information, Domestic News, electronics postal
A series of Internet resources such as part, ambient services.
Embodiment two
Present embodiments provide a kind of vehicle-mounted interactive system of offline intelligent sound, for show without networking can be complete user's request
Interactive voice, as shown in Figure 3, including offline speech reception module, vehicle OBD interfaces, offline speech recognition engine, offline language
Sound Compositing Engine, offline voice playing module, vehicle mobile terminals, wherein：
Described offline speech reception module, by gathering the speech data of user, receive for control automotive window, air-conditioning,
The user base voice control command of broadcast etc.；
Described vehicle OBD interfaces, for exporting the vehicle condition parameter information such as including speed, rotating speed, oil consumption；
Described offline speech recognition engine, for offline speech reception module is received for control automotive window, air-conditioning,
The user base voice control command of broadcast etc. is understood, is recognized；
Described offline speech synthesis engine, for the vehicle condition parameter information and the offline voice of execution that export vehicle OBD interfaces
Automobile synthesizes voice signal to the demand response of user after control command；
Described offline voice playing module, for the composite result of offline speech synthesis engine to be played into user；
Vehicle mobile terminals, according to OBD agreements and vehicle OBD interface communications, and local off-line state carry out OBD information with
And simple speech identification, the information processing of simple speech synthesis.
Presently preferred embodiments of the present invention is the foregoing is only, is not intended to limit the invention, it is all in essence of the invention
Any modification, equivalent and improvement made within god and principle etc., should be included within the scope of the present invention.
Claims (5)
1. a kind of vehicle-mounted interactive system of intelligent sound with image understanding, including the on-line intelligence voice car with image understanding
Carry interactive system and the vehicle-mounted interactive system of offline intelligent sound, it is characterised in that：The on-line intelligence language with image understanding
The vehicle-mounted interactive system of sound, including vehicle mobile terminals, onboard wireless gateway, car networking cloud platform and internet, for integrating car
The Real-time Collection Current vehicle peripheral path that camera shoots periphery road conditions image information, real-time video monitoring module are received
Video monitoring image, and according to user, to many demands of Internet resources information, it is analyzed, and realizes the semanteme of image
Understand, the more more rich user's request of real time comprehensive traffic information and connection internet is responded in the form of intelligent sound
Interacted with user；The described vehicle-mounted interactive system of offline intelligent sound, including offline speech reception module, vehicle OBD connect
Mouth, offline speech recognition engine, offline speech synthesis engine, offline voice playing module and vehicle mobile terminals, for showing
Need not be networked achievable user's request interactive voice.
2. the vehicle-mounted interactive system of a kind of intelligent sound with image understanding according to claim 1, it is characterised in that：Institute
The vehicle mobile terminals stated be used for receive the vehicle-surroundings road conditions image information and need connection car networking cloud platform could complete
The complicated user voice data of speech identifying function, and sent to car networking cloud platform by onboard wireless gateway, while passing through
Onboard wireless gateway receives the traffic information of the image understanding engine real-time processing of car networking cloud platform and according to user's need
Ask and obtain a series of other users demand responses such as Internet resources such as Weather information, Domestic News, Email, ambient services
Voice feedback information, and the intelligent sound for carrying out the function with user interacts, including vehicle-mounted image receiver module, online voice connect
Receive module, vehicle-mounted image sending module, online voice sending module, voice feedback information receiving module, online speech play mould
Block；Wherein, described vehicle-mounted image receiver module, vehicle periphery road conditions video is shot by vehicle-mounted camera, receives the vehicle
Periphery road conditions image information；Described online speech reception module, by gathering the speech data of user, receives for needing to connect
Picking up networking cloud platform could complete the complicated user voice data of speech identifying function；Described vehicle-mounted image sending module,
For receiving the vehicle-surroundings road conditions image information that vehicle-mounted image receiver module is received, and sent to car by onboard wireless gateway
Networking cloud platform；Described online voice sending module, car connection is connected for receiving the need for online speech reception module is received
Net cloud platform could complete the complicated user voice data of speech identifying function；Described voice feedback information receiving module, leads to
Cross onboard wireless gateway and receive the voice signal that voice feedback information sending module sends；Described online voice playing module,
For the composite result of online speech synthesis engine to be played into user.
3. the vehicle-mounted interactive system of a kind of intelligent sound with image understanding according to claim 1, it is characterised in that：Institute
The car networking cloud platform stated, on the one hand, car networking cloud platform is connected the need for being received by onboard wireless gateway could complete language
The complicated user voice data of sound identification function is understood, is recognized that another aspect will be by vehicle-mounted using image understanding engine
The vehicle-surroundings road conditions image information and real-time video monitoring module that radio network gateway receives vehicle-mounted image sending module transmission are real-time
Gathering Current vehicle peripheral path video monitoring image to be analyzed, realize the semantic understanding of image, and receive other users needs
Respond module is sought according to a series of Internet resources such as customer requirement retrieval Weather information, Domestic News, Email, ambient services
Information synthesizes voice signal, including the vehicle-mounted image receiver module in high in the clouds, high in the clouds speech reception module, online speech recognition draw
Hold up, real-time video monitoring module, image understanding engine, other users demand response module, online speech synthesis engine, voice it is anti-
Feedforward information sending module；Wherein, the vehicle-mounted image receiver module in described high in the clouds, receives vehicle-mounted image and sends out by onboard wireless gateway
The vehicle-surroundings road conditions image information for sending module to send；Described high in the clouds speech reception module, it is online by onboard wireless gateway
Speech reception module connects car networking cloud platform and could complete the complicated user voice data of speech identifying function the need for receiving；
Described online speech recognition engine, connecting car networking cloud platform the need for being received to high in the clouds speech reception module could complete language
The complicated user voice data of sound identification function is understood, is recognized；Described real-time video monitoring module, collects road video
Monitoring image, positions, Real-time Collection Current vehicle peripheral path video monitoring image according to vehicle GPS；Described image understanding
Engine, integrates vehicle-surroundings road conditions image information and the reception of real-time video monitoring module that the vehicle-mounted image receiver module in high in the clouds is received
Real-time Collection Current vehicle peripheral path video monitoring image, it is analyzed, realize the semantic understanding of image；Described
Other users demand response module, according to customer requirement retrieval Weather information, Domestic News, Email, ambient services etc.
Series of network resource information；Described online speech synthesis engine, the information and car networking cloud that image understanding engine is exported is put down
Response of the platform to other demands of user, synthesizes voice signal；Described voice feedback information sending module, it is online for receiving
Speech synthesis engine synthesizes voice signal, and is sent to voice feedback information receiving module by onboard wireless gateway.
4. the vehicle-mounted interactive system of a kind of intelligent sound with image understanding according to claim 1, it is characterised in that：Institute
The onboard wireless gateway stated, is connected with car networking cloud platform and vehicle mobile terminals respectively, for realize vehicle mobile terminals and
Radio communication function between car networking cloud platform；Described internet, is connected with car networking cloud platform, for obtaining weather letter
A series of Internet resources such as breath, Domestic News, Email, ambient services.
5. the vehicle-mounted interactive system of a kind of intelligent sound with image understanding according to claim 1, it is characterised in that：Institute
The vehicle-mounted interactive system of offline intelligent sound stated, including offline speech reception module, vehicle OBD interfaces, offline speech recognition draw
Hold up, offline speech synthesis engine, offline voice playing module and vehicle mobile terminals, for showing the achievable use that need not network
Family demand interactive voice；Wherein, described offline speech reception module, by gathering the speech data of user, receives for controlling
The user base voice control command of automotive window processed, air-conditioning, broadcast etc.；Described vehicle OBD interfaces, car is included for exporting
The vehicle condition parameter information such as speed, rotating speed, oil consumption；Described offline speech recognition engine, for being received to offline speech reception module
The user base voice control command for controlling automotive window, air-conditioning, broadcast etc. understood, recognized；Described is offline
Speech synthesis engine, for the vehicle condition parameter information that exports vehicle OBD interfaces and performs automobile after offline voice control command
To the demand response of user, voice signal is synthesized；Described offline voice playing module, for by offline speech synthesis engine
Composite result play to user；Described vehicle mobile terminals, according to OBD agreements and vehicle OBD interface communications, and at this
Ground off-line state carries out OBD information and simple speech identification, the information processing of simple speech synthesis.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611230108.5A CN106782558A (en) | 2016-12-27 | 2016-12-27 | A kind of vehicle-mounted interactive system of intelligent sound with image understanding |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611230108.5A CN106782558A (en) | 2016-12-27 | 2016-12-27 | A kind of vehicle-mounted interactive system of intelligent sound with image understanding |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106782558A true CN106782558A (en) | 2017-05-31 |
Family
ID=58922315
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611230108.5A Pending CN106782558A (en) | 2016-12-27 | 2016-12-27 | A kind of vehicle-mounted interactive system of intelligent sound with image understanding |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106782558A (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109376303A (en) * | 2018-10-25 | 2019-02-22 | 合肥望京科技有限公司 | A kind of vehicle-mounted content information intelligent recommendation system and method based on car networking |
| WO2019184774A1 (en) * | 2018-03-29 | 2019-10-03 | 比亚迪股份有限公司 | Rail transit passenger information system, method, cloud platform, and cloud broadcast controller |
| CN110428827A (en) * | 2019-06-28 | 2019-11-08 | 深圳市九洲电器有限公司 | Intelligent device interaction and system |
| WO2020051239A1 (en) * | 2018-09-04 | 2020-03-12 | Uber Technologies, Inc. | Network computer system to generate voice response communications |
| CN110989967A (en) * | 2019-12-06 | 2020-04-10 | 安信通科技（澳门）有限公司 | Vehicle-mounted voice auxiliary interaction method and device |
| CN111694944A (en) * | 2020-06-17 | 2020-09-22 | 深圳市航盛车云技术有限公司 | Internet of vehicles interactive intelligent customer service system |
| CN111833881A (en) * | 2020-08-07 | 2020-10-27 | 斑马网络技术有限公司 | Travel voice service generation method, travel accompanying assistant system and electronic equipment |
| CN111883126A (en) * | 2020-07-27 | 2020-11-03 | 珠海格力电器股份有限公司 | Data processing mode selection method and device and electronic equipment |
| CN112970060A (en) * | 2018-11-09 | 2021-06-15 | 标致雪铁龙汽车股份有限公司 | Auxiliary method and device for assisting the use of a voice assistant in a vehicle |
| CN113257245A (en) * | 2021-06-17 | 2021-08-13 | 智道网联科技(北京)有限公司 | Inspection method and device for vehicle-mounted terminal, vehicle-mounted terminal and storage medium |
| WO2024012113A1 (en) * | 2022-07-11 | 2024-01-18 | 中国第一汽车股份有限公司 | Smart photographic system of vehicle |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101589428A (en) * | 2006-12-28 | 2009-11-25 | 三菱电机株式会社 | Vehicle-mounted voice recognition apparatus |
| CN102006373A (en) * | 2010-11-24 | 2011-04-06 | 深圳市子栋科技有限公司 | Vehicle-mounted service system and method based on voice command control |
| CN102842304A (en) * | 2011-06-22 | 2012-12-26 | 歌乐株式会社 | Voice data transferring device, transferring method, terminal device and voice recognition system |
| CN103187059A (en) * | 2011-12-28 | 2013-07-03 | 上海博泰悦臻电子设备制造有限公司 | Speech processing system based on vehicle-mounted application |
| CN203366735U (en) * | 2013-07-15 | 2013-12-25 | 深圳市众鸿科技股份有限公司 | Onboard intelligent terminal based on Android system and onboard voice identification system |
| CN103685524A (en) * | 2013-12-16 | 2014-03-26 | 中国科学院深圳先进技术研究院 | Intelligent vehicle-mounted terminal system |
| CN103730119A (en) * | 2013-12-18 | 2014-04-16 | 惠州市车仆电子科技有限公司 | Vehicle-mounted man-machine voice interaction system |
| CN104318924A (en) * | 2014-11-12 | 2015-01-28 | 沈阳美行科技有限公司 | Method for realizing voice recognition function |
| CN104637326A (en) * | 2015-02-12 | 2015-05-20 | 深圳市凌启电子有限公司 | Vehicle driving safety system based on cloud service |
| CN205232353U (en) * | 2015-11-05 | 2016-05-11 | 深圳市祈飞科技有限公司 | Interactive intelligent terminal system |
| CN106057194A (en) * | 2016-06-25 | 2016-10-26 | 浙江合众新能源汽车有限公司 | Voice interaction system |
| CN106101168A (en) * | 2015-06-25 | 2016-11-09 | 乐视控股（北京）有限公司 | Car-mounted terminal, cloud service equipment, onboard system and information processing method and device |
-
2016
- 2016-12-27 CN CN201611230108.5A patent/CN106782558A/en active Pending
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101589428A (en) * | 2006-12-28 | 2009-11-25 | 三菱电机株式会社 | Vehicle-mounted voice recognition apparatus |
| CN102006373A (en) * | 2010-11-24 | 2011-04-06 | 深圳市子栋科技有限公司 | Vehicle-mounted service system and method based on voice command control |
| CN102842304A (en) * | 2011-06-22 | 2012-12-26 | 歌乐株式会社 | Voice data transferring device, transferring method, terminal device and voice recognition system |
| CN103187059A (en) * | 2011-12-28 | 2013-07-03 | 上海博泰悦臻电子设备制造有限公司 | Speech processing system based on vehicle-mounted application |
| CN203366735U (en) * | 2013-07-15 | 2013-12-25 | 深圳市众鸿科技股份有限公司 | Onboard intelligent terminal based on Android system and onboard voice identification system |
| CN103685524A (en) * | 2013-12-16 | 2014-03-26 | 中国科学院深圳先进技术研究院 | Intelligent vehicle-mounted terminal system |
| CN103730119A (en) * | 2013-12-18 | 2014-04-16 | 惠州市车仆电子科技有限公司 | Vehicle-mounted man-machine voice interaction system |
| CN104318924A (en) * | 2014-11-12 | 2015-01-28 | 沈阳美行科技有限公司 | Method for realizing voice recognition function |
| CN104637326A (en) * | 2015-02-12 | 2015-05-20 | 深圳市凌启电子有限公司 | Vehicle driving safety system based on cloud service |
| CN106101168A (en) * | 2015-06-25 | 2016-11-09 | 乐视控股（北京）有限公司 | Car-mounted terminal, cloud service equipment, onboard system and information processing method and device |
| CN205232353U (en) * | 2015-11-05 | 2016-05-11 | 深圳市祈飞科技有限公司 | Interactive intelligent terminal system |
| CN106057194A (en) * | 2016-06-25 | 2016-10-26 | 浙江合众新能源汽车有限公司 | Voice interaction system |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019184774A1 (en) * | 2018-03-29 | 2019-10-03 | 比亚迪股份有限公司 | Rail transit passenger information system, method, cloud platform, and cloud broadcast controller |
| WO2020051239A1 (en) * | 2018-09-04 | 2020-03-12 | Uber Technologies, Inc. | Network computer system to generate voice response communications |
| US11244685B2 (en) | 2018-09-04 | 2022-02-08 | Uber Technologies, Inc. | Network computer system to generate voice response communications |
| CN109376303A (en) * | 2018-10-25 | 2019-02-22 | 合肥望京科技有限公司 | A kind of vehicle-mounted content information intelligent recommendation system and method based on car networking |
| CN112970060A (en) * | 2018-11-09 | 2021-06-15 | 标致雪铁龙汽车股份有限公司 | Auxiliary method and device for assisting the use of a voice assistant in a vehicle |
| CN112970060B (en) * | 2018-11-09 | 2024-05-24 | 标致雪铁龙汽车股份有限公司 | Assistance method and device for assisting use of voice assistant in vehicle |
| CN110428827A (en) * | 2019-06-28 | 2019-11-08 | 深圳市九洲电器有限公司 | Intelligent device interaction and system |
| CN110989967A (en) * | 2019-12-06 | 2020-04-10 | 安信通科技（澳门）有限公司 | Vehicle-mounted voice auxiliary interaction method and device |
| CN111694944B (en) * | 2020-06-17 | 2024-04-05 | 深圳市航盛车云技术有限公司 | Internet of vehicles interactive intelligent customer service system |
| CN111694944A (en) * | 2020-06-17 | 2020-09-22 | 深圳市航盛车云技术有限公司 | Internet of vehicles interactive intelligent customer service system |
| CN111883126A (en) * | 2020-07-27 | 2020-11-03 | 珠海格力电器股份有限公司 | Data processing mode selection method and device and electronic equipment |
| CN111833881A (en) * | 2020-08-07 | 2020-10-27 | 斑马网络技术有限公司 | Travel voice service generation method, travel accompanying assistant system and electronic equipment |
| CN111833881B (en) * | 2020-08-07 | 2023-09-08 | 斑马网络技术有限公司 | Stroke voice service generation method, stroke accompanying assistant system and electronic equipment |
| CN113257245A (en) * | 2021-06-17 | 2021-08-13 | 智道网联科技(北京)有限公司 | Inspection method and device for vehicle-mounted terminal, vehicle-mounted terminal and storage medium |
| WO2024012113A1 (en) * | 2022-07-11 | 2024-01-18 | 中国第一汽车股份有限公司 | Smart photographic system of vehicle |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106782558A (en) | A kind of vehicle-mounted interactive system of intelligent sound with image understanding | |
| US20050050017A1 (en) | Method and system for providing flexible vehicle communication within a vehicle communications system | |
| CN108462728A (en) | A kind of method and device, the vehicle mobile terminals of on-vehicle information processing | |
| CN109345804A (en) | A kind of unmanned aerial vehicle (UAV) control signaling and data transmission method based on mobile network | |
| CN106790938A (en) | A kind of man-machine interaction onboard system based on artificial intelligence | |
| CN108569096B (en) | Remote control method for vehicle-mounted air conditioner | |
| CN105872444B (en) | A kind of video call method, apparatus and system | |
| CN105869233A (en) | Travel recorder for realizing intelligent interaction, and control method thereof | |
| CN201312333Y (en) | Vehicle information service system | |
| CN105844733A (en) | Method and device for sharing driving record | |
| CN103841358B (en) | The video conferencing system and method for low code stream, sending ending equipment, receiving device | |
| CN105843257A (en) | Request based information collection system and information collection method thereof | |
| CN106791662A (en) | A kind of multifunctional vehicle mounted HUD display systems | |
| CN111198573A (en) | Vehicle, vehicle equipment and unmanned aerial vehicle control method based on vehicle equipment | |
| CN109495863A (en) | Exchange method and relevant device | |
| CN206849495U (en) | Vehicle-mounted voice interactive terminal and interactive system for vehicle-mounted voice | |
| CN110334193A (en) | A kind of intelligent interactive system and its exchange method based on bicycle in ride | |
| CN110958559A (en) | Vehicle, vehicle equipment and instant interaction method based on map display | |
| CN206226731U (en) | A kind of vehicle intelligent cloud mirror system | |
| CN110691109A (en) | Vehicle, vehicle equipment and vehicle-mounted call environment control method thereof | |
| CN107562399A (en) | A kind of vehicle-mounted translation shows multi-screen system and a kind of vehicle | |
| CN110956483A (en) | Advertisement information pushing method, system, server and vehicle | |
| CN115017352B (en) | Mobile phone car machine interaction system based on image recognition | |
| CN202172461U (en) | Mobile network based school bus-mounted monitoring system | |
| CN205880668U (en) | Unmanned aerial vehicle system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170531 |
|
| WD01 | Invention patent application deemed withdrawn after publication |