Summary of the invention
In order to solve the technical problem that prior art exists, the invention provides a kind of video file retrieval system of communication Network Based, first to be parsed the video player title in driver's voice according to predetermined text formatting by speech recognition technology, the current emotional of driver is identified subsequently by image recognition technology, finally, based on the current emotional of video player title, download from the Internet, play suitable video file, meet the visual demand of automobile driver at any time.
According to an aspect of the present invention, provide a kind of video file retrieval system of communication Network Based, be arranged in motor vehicle, described searching system comprises AT89C51 single-chip microcomputer, speech recognition apparatus, image detecting apparatus and network retrieval equipment, described speech recognition apparatus is used for the current speech of cognitron motor-car driver to obtain the video player name in current speech, described image detecting apparatus is for detecting the current emotional of automobile driver, described AT89C51 single-chip microcomputer and described speech recognition apparatus, described image detecting apparatus is connected respectively with described network retrieval equipment, the video file retrieval operation of described network retrieval equipment in the Internet is controlled based on described video player name and described current emotional.
More specifically, in the video file retrieval system of described communication Network Based, also comprise: video playback apparatus, comprise display and user input device, for receiving and playing video file, described display is LCDs, and described user input device is the touch-screen integrated with described display, power supply unit, comprise solar powered device, vehicle battery, diverter switch and electric pressure converter, described diverter switch is connected respectively with described solar powered device and described vehicle battery, dump energy according to vehicle battery determines whether be switched to described solar powered device to be powered by described solar powered device, described electric pressure converter is connected with described diverter switch, with the 5V voltage transitions will inputted by diverter switch for 3.3V voltage, portable hard drive, be arranged in the panel board of motor vehicle, for storing facial upper limit gray threshold, facial lower limit gray threshold and each facial emotions reference pattern, described facial upper limit gray threshold and described facial lower limit gray threshold are used for face and background separation from image, the various moods of the corresponding people of each facial emotions reference pattern difference, each facial emotions reference pattern is for taking obtained pattern to the face with corresponding mood in advance, and the various moods of people comprise sadness, joy, calmness and angry, CCD camera, is arranged on the front at automobile driver seat, for carrying out IMAQ, to obtain face-image to the face of automobile driver, described image detecting apparatus, is arranged in the panel board of motor vehicle, is connected, receives described face-image, identify to described face-image the current emotional obtaining driver with described CCD camera, described image detecting apparatus comprises contrast strengthen unit, wavelet filtering unit, gray processing processing unit, face pattern extraction unit and mood analytic unit, described contrast strengthen unit is connected to carry out contrast enhancement processing to described face-image with described CCD camera, obtain and strengthen face-image, described wavelet filtering unit is connected with the filtering process carried out described enhancing face-image based on Haar wavelet transform filter with described contrast strengthen unit, obtain filtering face-image, described gray processing processing unit is connected with described wavelet filtering unit, for performing gray processing process to described filtering face-image, to obtain gray processing face-image, described face pattern extraction unit is connected respectively with described gray processing processing unit and described portable hard drive, the pixel identification of gray value in described gray level image between described facial upper limit gray threshold and described facial lower limit gray threshold is formed driver's face pattern, described mood analytic unit is connected respectively with described face pattern extraction unit and described portable hard drive, described driver's face pattern is mated with each facial emotions reference pattern, facial emotions corresponding for the facial emotions reference pattern that the match is successful is exported as current emotional, described speech recognition apparatus comprises voice recognition chip, text converter, FLASH memory and RS232 serial ports, the current speech of automobile driver is also converted to digital audio file by the current speech of described speech ciphering equipment chip receiver motor-car driver, described FLASH memory prestores character string identification form, described text converter is connected respectively with described voice recognition chip and described FLASH memory, described digital audio file is converted to character string, and the video player name gone out based on described character string identification format identification in described character string, described RS232 serial ports is connected with described text converter, for receiving and exporting described video player name, described AT89C51 single-chip microcomputer, with described image detecting apparatus, described portable hard drive, described speech recognition apparatus is connected respectively with described network retrieval equipment, the search rule arranging described network retrieval equipment is as follows: when the current emotional received is for time sad, control described network retrieval equipment to search on the internet and receive playing style in all works of video player name from described speech recognition apparatus and be peaceful video file and download in the play buffer of described video playback apparatus, when the current emotional received is for time happy, control described network retrieval equipment to search on the internet and receive playing style in all works of video player name from described speech recognition apparatus and be hot video file and download in the play buffer of described video playback apparatus, when the current emotional received is for time tranquil, control described network retrieval equipment to search on the internet and receive playing style in all works of video player name from described speech recognition apparatus and be lyric video file and download in the play buffer of described video playback apparatus, when the current emotional received is for indignation, control described network retrieval equipment and search for from described speech recognition apparatus that to receive playing style in all works of video player name be the video file of arguing and download in the play buffer of described video playback apparatus on the internet, described network retrieval equipment, comprise network communication interface and search rule arranges device, described network communication interface is 4G mobile communication interface, described search rule arranges device and is connected respectively with described network communication interface and described AT89C51 single-chip microcomputer, for receiving search rule that described AT89C51 single-chip microcomputer arranges to control described network communication interface and to search on the internet according to described search rule and to download the video file of correspondence, when the video file of correspondence is multiple, video file the most popular on the Internet is selected to download, described network communication interface is also connected with described video playback apparatus, for the video file of download being forwarded in the play buffer of described video playback apparatus, wherein, described contrast strengthen unit, described wavelet filtering unit, described gray processing processing unit, described face pattern extraction unit and described mood analytic unit adopt different fpga chips to realize respectively, and are integrated on one piece of surface-mounted integrated circuit, described character string identification form is in character string, and latter two character is video, and all characters before latter two character are video player name.
More specifically, in the video file retrieval system of described communication Network Based, also comprise: power supply unit, for each consuming parts in described searching system provides supply of electric power.
More specifically, in the video file retrieval system of described communication Network Based, also comprise: serial communication interface, be connected with described portable hard drive, for the facial upper limit gray threshold will stored in outside serial equipment, facial lower limit gray threshold and each facial emotions reference pattern stored in described portable hard drive.
More specifically, in the video file retrieval system of described communication Network Based: described user input device determines whether the function of search of opening searching system under being used for the operation at automobile driver.
More specifically, in the video file retrieval system of described communication Network Based, also comprise: alternatively, described contrast strengthen unit, described wavelet filtering unit, described gray processing processing unit, described face pattern extraction unit and described mood analytic unit are integrated in one piece of fpga chip.
Embodiment
Below with reference to accompanying drawings the embodiment of the video file retrieval system of communication Network Based of the present invention is described in detail.
Video image can reduce the discomfort in travelling, improve the recreational of travelling, but in the prior art, lack and replace the manual video selection scheme of automobile driver, also lack the selection of the video file of satisfied different driver's mood, download, play mode.
In order to overcome above-mentioned deficiency, the present invention has built a kind of video file retrieval system of communication Network Based, based on the combination of speech recognition, image recognition and Internet communication technology, effectively solves the problems of the technologies described above.
Fig. 1 is the block diagram of the video file retrieval system of the communication Network Based illustrated according to an embodiment of the present invention, described searching system is arranged in motor vehicle, comprise AT89C51 single-chip microcomputer 1, speech recognition apparatus 2, image detecting apparatus 3 and network retrieval equipment 4, described speech recognition apparatus 2 for the current speech of cognitron motor-car driver to obtain the video player name in current speech, described image detecting apparatus 3 is for detecting the current emotional of automobile driver, described AT89C51 single-chip microcomputer 1 and described speech recognition apparatus 2, described image detecting apparatus 3 is connected respectively with described network retrieval equipment 4, the video file retrieval operation of described network retrieval equipment 4 in the Internet is controlled based on described video player name and described current emotional.
Then, continue to be further detailed the concrete structure of the video file retrieval system of communication Network Based of the present invention.
Described searching system also comprises: video playback apparatus, comprises display and user input device, and for receiving and playing video file, described display is LCDs, and described user input device is the touch-screen integrated with described display.
Described searching system also comprises: power supply unit, comprise solar powered device, vehicle battery, diverter switch and electric pressure converter, described diverter switch is connected respectively with described solar powered device and described vehicle battery, dump energy according to vehicle battery determines whether be switched to described solar powered device to be powered by described solar powered device, described electric pressure converter is connected with described diverter switch, with the 5V voltage transitions will inputted by diverter switch for 3.3V voltage.
Described searching system also comprises: portable hard drive, be arranged in the panel board of motor vehicle, for storing facial upper limit gray threshold, facial lower limit gray threshold and each facial emotions reference pattern, described facial upper limit gray threshold and described facial lower limit gray threshold are used for face and background separation from image, the various moods of the corresponding people of each facial emotions reference pattern difference, each facial emotions reference pattern is for taking obtained pattern to the face with corresponding mood in advance, and the various moods of people comprise sadness, joy, calmness and angry.
Described searching system also comprises: CCD camera, is arranged on the front at automobile driver seat, for carrying out IMAQ, to obtain face-image to the face of automobile driver.
Described image detecting apparatus 3 is arranged in the panel board of motor vehicle, is connected, receives described face-image, identify to described face-image the current emotional obtaining driver with described CCD camera;
Described image detecting apparatus 3 comprises contrast strengthen unit, wavelet filtering unit, gray processing processing unit, face pattern extraction unit and mood analytic unit, described contrast strengthen unit is connected to carry out contrast enhancement processing to described face-image with described CCD camera, obtain and strengthen face-image, described wavelet filtering unit is connected with the filtering process carried out described enhancing face-image based on Haar wavelet transform filter with described contrast strengthen unit, obtain filtering face-image, described gray processing processing unit is connected with described wavelet filtering unit, for performing gray processing process to described filtering face-image, to obtain gray processing face-image, described face pattern extraction unit is connected respectively with described gray processing processing unit and described portable hard drive, the pixel identification of gray value in described gray level image between described facial upper limit gray threshold and described facial lower limit gray threshold is formed driver's face pattern, described mood analytic unit is connected respectively with described face pattern extraction unit and described portable hard drive, described driver's face pattern is mated with each facial emotions reference pattern, facial emotions corresponding for the facial emotions reference pattern that the match is successful is exported as current emotional.
Described speech recognition apparatus 2 comprises voice recognition chip, text converter, FLASH memory and RS232 serial ports, the current speech of automobile driver is also converted to digital audio file by the current speech of described speech ciphering equipment chip receiver motor-car driver, described FLASH memory prestores character string identification form, described text converter is connected respectively with described voice recognition chip and described FLASH memory, described digital audio file is converted to character string, and the video player name gone out based on described character string identification format identification in described character string, described RS232 serial ports is connected with described text converter, for receiving and exporting described video player name.
Described AT89C51 single-chip microcomputer 1 is connected respectively with described image detecting apparatus 3, described portable hard drive, described speech recognition apparatus 2 and described network retrieval equipment 4, and the search rule arranging described network retrieval equipment 4 is as follows:
When the current emotional received is for time sad, control described network retrieval equipment 4 and search on the internet and receive playing style in all works of video player name from described speech recognition apparatus 2 and be peaceful video file and download in the play buffer of described video playback apparatus;
When the current emotional received is for time happy, control described network retrieval equipment 4 and search on the internet and receive playing style in all works of video player name from described speech recognition apparatus 2 and be hot video file and download in the play buffer of described video playback apparatus;
When the current emotional received is for time tranquil, control described network retrieval equipment 4 and search on the internet and receive playing style in all works of video player name from described speech recognition apparatus 2 and be lyric video file and download in the play buffer of described video playback apparatus;
When the current emotional received is for indignation, controls described network retrieval equipment 4 and search for from described speech recognition apparatus 2 that to receive playing style in all works of video player name be the video file of arguing and download in the play buffer of described video playback apparatus on the internet.
Described network retrieval equipment 4 comprises network communication interface and search rule arranges device, described network communication interface is 4G mobile communication interface, described search rule arranges device and is connected respectively with described network communication interface and described AT89C51 single-chip microcomputer, for receiving search rule that described AT89C51 single-chip microcomputer arranges to control described network communication interface and to search on the internet according to described search rule and to download the video file of correspondence, when the video file of correspondence is multiple, video file the most popular on the Internet is selected to download, described network communication interface is also connected with described video playback apparatus, for the video file of download is forwarded in the play buffer of described video playback apparatus.
Wherein, described contrast strengthen unit, described wavelet filtering unit, described gray processing processing unit, described face pattern extraction unit and described mood analytic unit adopt different fpga chips to realize respectively, and are integrated on one piece of surface-mounted integrated circuit; Described character string identification form is in character string, and latter two character is video, and all characters before latter two character are video player name.
Alternatively, described searching system also comprises: power supply unit, for each consuming parts in described searching system provides supply of electric power; Described searching system also comprises: serial communication interface, is connected with described portable hard drive, for the facial upper limit gray threshold will stored in outside serial equipment, facial lower limit gray threshold and each facial emotions reference pattern stored in described portable hard drive; Described user input device is used for the function of search determining whether to open searching system under the operation of automobile driver; And alternatively, described contrast strengthen unit, described wavelet filtering unit, described gray processing processing unit, described face pattern extraction unit and described mood analytic unit are integrated in one piece of fpga chip.
In addition, FPGA (Field-Programmable Gate Array), i.e. field programmable gate array, he is the product further developed on the basis of the programming devices such as PAL, GAL, CPLD.He occurs as a kind of semi-custom circuit in application-specific integrated circuit (ASIC) (ASIC) field, has both solved the deficiency of custom circuit, overcomes again the shortcoming that original programming device gate circuit number is limited.
With the circuit design that hardware description language (Verilog or VHDL) completes, can through simple comprehensive and layout, being burned onto fast on FPGA and testing, is the technology main flow of modern IC designs checking.These can be edited element and can be used to realize some basic logic gates (such as AND, OR, XOR, NOT) or more more complex combination function such as decoder or mathematical equation.Inside most FPGA, in these editable elements, also comprise memory cell such as trigger (Flip-flop) or other more complete block of memory.System designer can be coupled together the logical block of FPGA inside by editable connection as required, just looks like that a breadboard has been placed in a chip.One dispatch from the factory after the logical block of finished product FPGA can change according to designer with being connected, so FPGA can complete required logic function.
FPGA is in general slow than the speed of ASIC (application-specific integrated circuit (ASIC)), realizes same function ratio ASIC circuit area and wants large.But they also have a lot of advantages such as can finished product fast, can be modified the mistake in correction program and more cheap cost.Manufacturer also may provide the FPGA of cheap still edit capability difference.Because these chips have poor can edit capability, so exploitations of these designs complete on common FPGA, then design is transferred to one and is similar on the chip of ASIC.Another method is with CPLD (Complex Programmable LogicDevice, CPLD).The exploitation of FPGA has a great difference relative to the exploitation of conventional P C, single-chip microcomputer.FPGA, based on concurrent operation, realizes with hardware description language; Very large difference is had compared to the operation in tandem of PC or single-chip microcomputer (no matter being von Neumann structure or Harvard structure).
As far back as 1980 mid-nineties 90s, FPGA takes root in PLD equipment.CPLD and FPGA includes the Programmadle logic unit of some relatively large amount.The density of CPLD gate is between several thousand to several ten thousand logical blocks, and FPGA normally arrives millions of several ten thousand.The main distinction of CPLD and FPGA is their system configuration.CPLD is a somewhat restrictive structure.This structure is arranged by the logical groups of one or more editable result sum and forms with the register of the locking of some relatively small amounts.Such result lacks editor's flexibility, but but have the time of delay and logical block that can estimate to the advantage of linkage unit height ratio.And FPGA has a lot of linkage units, although allow him edit more flexibly like this, structure is complicated many.
Adopt the video file retrieval system of communication Network Based of the present invention, for cannot according to the technical problem of automobile driver current emotional and the automatic downloading and playing video file of voice in prior art, speech recognition, image recognition and Internet communication technology is adopted to realize respectively detecting and video file download function driver's speech analysis, mood, and automatically can play the video file of download, be the visual enjoyment that automobile driver is provided convenience, enriched.
Be understandable that, although the present invention with preferred embodiment disclose as above, but above-described embodiment and be not used to limit the present invention.For any those of ordinary skill in the art, do not departing under technical solution of the present invention ambit, the technology contents of above-mentioned announcement all can be utilized to make many possible variations and modification to technical solution of the present invention, or be revised as the Equivalent embodiments of equivalent variations.Therefore, every content not departing from technical solution of the present invention, according to technical spirit of the present invention to any simple modification made for any of the above embodiments, equivalent variations and modification, all still belongs in the scope of technical solution of the present invention protection.