CN104883590B - The video file retrieval system of communication Network Based - Google Patents

The video file retrieval system of communication Network Based Download PDF

Info

Publication number
CN104883590B
CN104883590B CN201510306346.9A CN201510306346A CN104883590B CN 104883590 B CN104883590 B CN 104883590B CN 201510306346 A CN201510306346 A CN 201510306346A CN 104883590 B CN104883590 B CN 104883590B
Authority
CN
China
Prior art keywords
face
video
unit
video file
current
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201510306346.9A
Other languages
Chinese (zh)
Other versions
CN104883590A (en
Inventor
童辛宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xinxiang Vocational and Technical College
Original Assignee
Xinxiang Vocational and Technical College
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xinxiang Vocational and Technical College filed Critical Xinxiang Vocational and Technical College
Priority to CN201510306346.9A priority Critical patent/CN104883590B/en
Publication of CN104883590A publication Critical patent/CN104883590A/en
Application granted granted Critical
Publication of CN104883590B publication Critical patent/CN104883590B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/414Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41422Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance located in transportation means, e.g. personal vehicle
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42203Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42224Touch pad or touch panel provided on the remote control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/432Content retrieval operation from a local storage medium, e.g. hard-disk
    • H04N21/4325Content retrieval operation from a local storage medium, e.g. hard-disk by playing back content from the storage medium
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • H04N21/44218Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Studio Devices (AREA)
  • Image Analysis (AREA)

Abstract

The present invention relates to a kind of video file retrieval system of communication Network Based, be arranged in motor vehicle, described searching system comprises AT89C51 single-chip microcomputer, speech recognition apparatus, image detecting apparatus and network retrieval equipment, described speech recognition apparatus is used for cognitron motor-car driver's current speech to obtain the video player name of current speech, described image detecting apparatus is for detection of the current mood of automobile driver, described AT89C51 single-chip microcomputer and described speech recognition apparatus, described image detecting apparatus is connected respectively with described network retrieval equipment, video file retrieval operation based on network retrieval equipment described in described video player name and described current emotion control in internet. by the present invention, can automatically download suitable video file from internet according to driver's voice and mood and play, improve the intelligent level of motor vehicle electronic communication system.

Description

The video file retrieval system of communication Network Based
Technical field
The present invention relates to the communications field, relate in particular to a kind of video file retrieval system of communication Network BasedSystem.
Background technology
In motor vehicle driving process, in order to increase the enjoyment in travelling, amusement occupant is generalIn car, be provided with video playback apparatus, but in prior art, automobile driver is busy with driving conventionallySail, and the loaded down with trivial details selection operation of the video file of having no time to carry out for the visual enjoyment of self, driverDifferent moods under the video type difference of liking, and, in prior art, lack the language according to driverThe operator scheme of the automatic downloading video files of sound.
For this reason, the present invention proposes a kind of search plan of new video file, be applied on motor vehicle,On the one hand, can according to driver's voice realize video work to predetermined video player automaticallyDownload, play, on the other hand, can select to download based on driver's mood, play dissimilarVideo file.
Summary of the invention
The technical problem existing in order to solve prior art, the invention provides a kind of communication Network BasedVideo file retrieval system, first parse according to predetermined text formatting by speech recognition technologyVideo player title in driver's voice, identifies driver's by image recognition technology subsequentlyCurrent mood, last, based on the current mood of video player title, download from internet, broadcastPut suitable video file, meet at any time the visual demand of automobile driver.
A kind of video file retrieval system of communication Network Based is provided according to an aspect of the present invention,System, is arranged in motor vehicle, described searching system comprise AT89C51 single-chip microcomputer, speech recognition apparatus,Image detecting apparatus and network retrieval equipment, described speech recognition apparatus is for cognitron motor-car driverCurrent speech to obtain the video player name in current speech, described image detecting apparatus is used forThe current mood that detects automobile driver, described AT89C51 single-chip microcomputer and described speech recognition are establishedStandby, described image detecting apparatus is connected respectively with described network retrieval equipment, plays based on described videoThe video file inspection of network retrieval equipment in internet described in person's name and described current emotion controlRope operation.
More specifically, in the video file retrieval system of described communication Network Based, also comprise: lookFrequently playback equipment, comprises display and user input device, for receiving and playing video file, and instituteStating display is LCDs, and described user input device is to integrate with described displayTouch-screen; Power supply unit, comprises solar powered device, vehicle battery, change-over switch and electricityPressure converter, described change-over switch and described solar powered device and described vehicle battery are respectivelyConnect, determine whether to be switched to described solar powered device according to the dump energy of vehicle batteryTo be powered by described solar powered device, described electric pressure converter is connected with described change-over switch, withBe 3.3V voltage by the 5V voltage transitions of inputting by change-over switch; Portable hard drive, is arranged on motor-drivenIn the instrument board of car, for storing facial upper limit gray threshold, facial lower limit gray threshold and each facePortion's mood reference pattern, described facial upper limit gray threshold and described facial lower limit gray threshold for fromIn image, by face and background separation, each facial emotions reference pattern is corresponding people's various feelings respectivelyThread, each facial emotions reference pattern is by taking and obtained having the face of corresponding mood in advanceThe pattern obtaining, people's various moods comprise sadness, joy, calmness and angry; CCD camera,Be arranged on the front at automobile driver seat, adopt for the face of automobile driver is carried out to imageCollection, to obtain face-image; Described image detecting apparatus, is arranged in the instrument board of motor vehicle, withDescribed CCD camera connects, and receives described face-image, to described face-image identify withObtain driver's current mood; Described image detecting apparatus comprises contrast enhancement unit, small echo filterRipple unit, gray processing processing unit, face pattern extraction unit and mood analytic unit, described contrastDegree enhancement unit is connected that with described CCD camera described face-image is carried out to contrast enhancing placeReason, obtain strengthen face-image, described wavelet filtering unit be connected with described contrast enhancement unit withDescribed enhancing face-image is carried out to the filtering processing based on Ha Er wavelet filter, obtain filtering faceImage, described gray processing processing unit is connected with described wavelet filtering unit, for to described filtering facePortion's image is carried out gray processing processing, to obtain gray processing face-image, and described face pattern extraction unitBe connected respectively with described gray processing processing unit and described portable hard drive, by ash in described gray level imageThe pixel identification of degree value between described facial upper limit gray threshold and described facial lower limit gray thresholdAnd form driver's face pattern, described mood analytic unit and described face pattern extraction unit and instituteState portable hard drive and connect respectively, described driver's face pattern and each facial emotions reference pattern are enteredRow coupling, using defeated as current mood facial emotions corresponding the facial emotions reference pattern that the match is successfulGo out; Described speech recognition apparatus comprise voice recognition chip, text conversion device, FLASH memory andRS232 serial ports, described speech ciphering equipment chip receiver motor-car driver's current speech by motor vehicleDriver's current speech is converted to digital audio file, the pre-stored word of described FLASH memorySymbol string identification form, described text conversion device and described voice recognition chip and described FLASH storageDevice connects respectively, and described digital audio file is converted to character string, and based on described character string identificationFormat identification goes out the video player name in described character string, described RS232 serial ports and described wordConverter connects, for receiving and export described video player name; Described AT89C51 single-chip microcomputer,With described image detecting apparatus, described portable hard drive, described speech recognition apparatus and described network retrievalEquipment connects respectively, and the search rule that described network retrieval equipment is set is as follows: current when what receiveWhen mood is sad, controls described network retrieval equipment and search on the internet from described speech recognition and establishStandby place receive playing style in all works of video player name be peaceful video file alsoDownload in the play buffer of described video playback apparatus, when the current mood receiving is for happyTime, control described network retrieval equipment and search on the internet from described speech recognition apparatus and receiveIn all works of video player name playing style be hot video file and download to described inIn the play buffer of video playback apparatus, when the current mood receiving is when tranquil, described in controlNetwork retrieval equipment is searched on the internet from described speech recognition apparatus and is received video playerIn all works of name, playing style is lyric video file and downloads to described video playback and establishIn standby play buffer, in the time that the current mood receiving is indignation, controls described network retrieval and establishStandby search on the internet from described speech recognition apparatus receives all of video player nameIn works, playing style is that the video file of arguing the broadcasting that downloads to described video playback apparatus are slowRush in district; Described network retrieval equipment, comprises that network communication interface and search rule arrange device, instituteStating network communication interface is 4G mobile communication interface, and described search rule arranges device and described networkCommunication interface is connected respectively with described AT89C51 single-chip microcomputer, for receiving described AT89C51 monolithicThe search rule of machine setting with control described network communication interface according to described search rule in internetUpper search is also downloaded corresponding video file, when corresponding video file is while being multiple, selects internetUpper the most popular video file is downloaded, and described network communication interface also connects with described video playback apparatusConnect, for the video file of download being forwarded to the play buffer of described video playback apparatus; ItsIn, described contrast enhancement unit, described wavelet filtering unit, described gray processing processing unit, instituteStating face pattern extraction unit and described mood analytic unit adopts respectively different fpga chips to come in factExisting, and be integrated on a surface-mounted integrated circuit; Described character string identification form is in character string,Latter two character is video, and all characters before latter two character are video player name.
More specifically, in the video file retrieval system of described communication Network Based, also comprise: supplyElectricity equipment, for each consuming parts in described searching system provides supply of electric power.
More specifically, in the video file retrieval system of described communication Network Based, also comprise: stringSerial Communication interface, is connected with described portable hard drive, for the face that outside serial equipment is storedIt is hard that limit gray threshold, facial lower limit gray threshold and each facial emotions reference pattern deposit described movement inDish.
More specifically, in the video file retrieval system of described communication Network Based: described user is defeatedEnter equipment for determine whether to open the function of search of searching system under the operation of automobile driver.
More specifically, in the video file retrieval system of described communication Network Based, also comprise: replaceChange ground, by described contrast enhancement unit, described wavelet filtering unit, described gray processing processing unit,Described face pattern extraction unit and described mood analytic unit are integrated in a fpga chip.
Brief description of the drawings
Below with reference to accompanying drawing, embodiment of the present invention are described, wherein:
Fig. 1 is the video file retrieval system of the communication Network Based that illustrates according to an embodiment of the present inventionBlock diagram.
Detailed description of the invention
The reality of the video file retrieval system to communication Network Based of the present invention below with reference to accompanying drawingsThe scheme of executing is elaborated.
Video image can reduce the discomfort in travelling, improves the recreational of travelling, but in existing skillIn art, lack and replace the manual video selection scheme of automobile driver, also lack and meet differenceThe selection of the video file of driver's mood, download, play mode.
In order to overcome above-mentioned deficiency, the present invention has built a kind of video file retrieval of communication Network BasedSystem, based on the combination of speech recognition, image recognition and Internet communication technology, effectively solves above-mentionedTechnical problem.
Fig. 1 is the video file retrieval system of the communication Network Based that illustrates according to an embodiment of the present inventionBlock diagram, described searching system is arranged in motor vehicle, comprise AT89C51 single-chip microcomputer 1,Speech recognition apparatus 2, image detecting apparatus 3 and network retrieval equipment 4, described speech recognition apparatus 2Be used for cognitron motor-car driver's current speech to obtain the video player name of current speech,Described image detecting apparatus 3 is for detection of the current mood of automobile driver, described AT89C51Single-chip microcomputer 1 is established with described speech recognition apparatus 2, described image detecting apparatus 3 and described network retrievalStandby 4 connect respectively, based on network inspection described in described video player name and described current emotion controlThe video file retrieval operation of rope equipment 4 in internet.
Then, continue the concrete structure of the video file retrieval system to communication Network Based of the present inventionBe further detailed.
Described searching system also comprises: video playback apparatus, comprise display and user input device,For receiving and playing video file, described display is LCDs, described user input deviceFor the touch-screen integrating with described display.
Described searching system also comprises: power supply unit, comprises solar powered device, motor vehicle electric power storagePond, change-over switch and electric pressure converter, described change-over switch and described solar powered device and described inVehicle battery connects respectively, determines whether to be switched to institute according to the dump energy of vehicle batteryState solar powered device to be powered by described solar powered device, described electric pressure converter with described inChange-over switch connect, taking by the 5V voltage transitions of inputting by change-over switch as 3.3V voltage.
Described searching system also comprises: portable hard drive, is arranged in the instrument board of motor vehicle, for depositingStore up facial upper limit gray threshold, facial lower limit gray threshold and each facial emotions reference pattern, described inFace upper limit gray threshold and described facial lower limit gray threshold are used for from image face and backgroundSeparate, each facial emotions reference pattern is corresponding people's various moods respectively, each facial emotionsReference pattern is for taking obtained pattern to having the face of corresponding mood in advance, and people's is eachPlant mood and comprise sadness, joy, calmness and angry.
Described searching system also comprises: CCD camera, be arranged on the front at automobile driver seat,For the face of automobile driver is carried out to IMAQ, to obtain face-image.
Described image detecting apparatus 3 is arranged in the instrument board of motor vehicle, with described CCD cameraConnect, receive described face-image, described face-image is identified to obtain the current of driverMood;
Described image detecting apparatus 3 comprises contrast enhancement unit, wavelet filtering unit, gray processing placeReason unit, face pattern extraction unit and mood analytic unit, described contrast enhancement unit with described inCCD camera connects so that described face-image is carried out to contrast enhancement processing, obtains and strengthens face figurePicture, described wavelet filtering unit is connected with described contrast enhancement unit with to described enhancing face-imageCarry out the filtering processing based on Ha Er wavelet filter, obtain filtering face-image, described gray processing placeReason unit is connected with described wavelet filtering unit, for described filtering face-image is carried out to gray processing placeReason, to obtain gray processing face-image, described face pattern extraction unit and described gray processing are processed singleFirst and described portable hard drive is connected respectively, by gray value in described gray level image in the described facial upper limitPixel between gray threshold and described facial lower limit gray threshold is identified and is formed driver's face and schemesCase, described mood analytic unit connects respectively with described face pattern extraction unit and described portable hard driveConnect, described driver's face pattern is mated with each facial emotions reference pattern, will be matched toThe facial emotions corresponding to facial emotions reference pattern of merit exported as current mood.
Described speech recognition apparatus 2 comprises voice recognition chip, text conversion device, FLASH memoryWith RS232 serial ports, described speech ciphering equipment chip receiver motor-car driver's current speech is also by motor-drivenCar driver's current speech is converted to digital audio file, and described FLASH memory is pre-storedCharacter string identification form, described text conversion device and described voice recognition chip and described FLASH depositReservoir connects respectively, and described digital audio file is converted to character string, and knows based on described character stringOther format identification goes out the video player name in described character string, described RS232 serial ports and described literary compositionWord converter connects, for receiving and export described video player name.
Described AT89C51 single-chip microcomputer 1 and described image detecting apparatus 3, described portable hard drive, described inSpeech recognition apparatus 2 is connected respectively with described network retrieval equipment 4, and described network retrieval equipment is set4 search rule is as follows:
In the time that the current mood receiving is sadness, control described network retrieval equipment 4 on the internetSearch is played wind from described speech recognition apparatus 2 receives all works of video player nameLattice are peaceful video file and download in the play buffer of described video playback apparatus;
In the time that the current mood receiving is joy, control described network retrieval equipment 4 on the internetSearch is played wind from described speech recognition apparatus 2 receives all works of video player nameLattice are hot video file and download in the play buffer of described video playback apparatus;
In the time that the current mood receiving is calmness, control described network retrieval equipment 4 on the internetSearch is played wind from described speech recognition apparatus 2 receives all works of video player nameLattice are lyric video file and download in the play buffer of described video playback apparatus;
In the time that the current mood receiving is indignation, control described network retrieval equipment 4 on the internetSearch is played wind from described speech recognition apparatus 2 receives all works of video player nameLattice are the video file of arguing and download in the play buffer of described video playback apparatus.
Described network retrieval equipment 4 comprises that network communication interface and search rule arrange device, described netNetwork communication interface is 4G mobile communication interface, and described search rule arranges device and described network serviceInterface is connected respectively with described AT89C51 single-chip microcomputer, establishes for receiving described AT89C51 single-chip microcomputerThe search rule of putting is searched according to described search rule on the internet to control described network communication interfaceRope is also downloaded corresponding video file, when corresponding video file is while being multiple, selects people on internetThe most prosperous video file of gas is downloaded, and described network communication interface is also connected with described video playback apparatus,For the video file of download being forwarded to the play buffer of described video playback apparatus.
Wherein, described contrast enhancement unit, described wavelet filtering unit, described gray processing are processed singleFirst, described face pattern extraction unit and described mood analytic unit adopt respectively different FPGA coresSheet is realized, and is integrated on a surface-mounted integrated circuit; Described character string identification form is in character stringIn, latter two character is video, all characters before latter two character are video player name.
Alternatively, described searching system also comprises: power supply unit is each in described searching systemConsuming parts provides supply of electric power; Described searching system also comprises: serial communication interface, moves with describedMoving hard disk connects, for the facial upper limit gray threshold that outside serial equipment is stored, facial lower limitGray threshold and each facial emotions reference pattern deposit described portable hard drive in; Described user input deviceFor determine whether to open the function of search of searching system under the operation of automobile driver; And replaceChange ground, by described contrast enhancement unit, described wavelet filtering unit, described gray processing processing unit,Described face pattern extraction unit and described mood analytic unit are integrated in a fpga chip.
In addition, FPGA (Field-ProgrammableGateArray), i.e. field-programmable gate arrayRow, he is the product further developing on the basis of the programming devices such as PAL, GAL, CPLD.He occurs as a kind of semi-custom circuit in special IC (ASIC) field, both separatedThe determined deficiency of custom circuit, has overcome again the limited shortcoming of original programming device gate circuit number.
The circuit design being completed with hardware description language (Verilog or VHDL), can be through letterSingle comprehensive and layout, is burned onto on FPGA and tests fast, is modern IC design verificationTechnology main flow. These can edit element can be used to realize some basic logic gates (ratioAs AND, OR, XOR, NOT) or more more complex combination function such as decoder or numberLearn equation. In most FPGA the inside, in these editable elements, also comprise memory cellFor example trigger (Flip-flop) or other more complete block of memory. System designer can rootAccording to need to the logical block of FPGA inside being coupled together by editable connection, it just look like an electricityRoad breadboard has been placed in a chip. Logical block and the connection of a finished product FPGA after dispatching from the factoryFPGA can change according to designer, so can complete needed logic function.
FPGA is in general slow than the speed of ASIC (special IC), realizes same meritCan be larger than ASIC circuit area. But they also have a lot of advantages such as finished product fast,Can be modified mistake in correction program and more cheap cost. It is cheap that manufacturer also may provideBut the poor FPGA of edit capability. Because these chips have poor can edit capability, soThe exploitation of these designs is to complete on common FPGA, then design is transferred to one similarOn the chip of ASIC. Another method is with CPLD (ComplexProgrammableLogicDevice, CPLD). The exploitation of FPGA is opened with respect to conventional P C, single-chip microcomputerSend out and have a great difference. FPGA, taking concurrent operation as main, realizes with hardware description language; ThanThe operation in tandem of PC or single-chip microcomputer (no matter being von Neumann structure or Harvard structure) has very large difference.
As far back as 1980 mid-nineties 90s, FPGA takes root in PLD equipment. CPLD and FPGAComprise the Programmadle logic unit of some relatively large number amounts. The density of CPLD gate arrives several thousandBetween several ten thousand logical blocks, and FPGA normally several ten thousand to millions of. CPLD and FPGAThe main distinction be their system architecture. CPLD is a somewhat restrictive structure. This knotStructure is by the logical groups row of one or more editable result sum and the locking of some relatively small amountsRegister composition. Such result is to lack editor's flexibility, but but has the delay that can estimateTime and the logical block advantage to linkage unit height ratio. And FPGA has a lot of connection listsUnit, although allow like this him edit more flexibly, structure is complicated many.
Adopt the video file retrieval system of communication Network Based of the present invention, for nothing in prior artMethod is according to the technical problem of the current mood of automobile driver and the automatic downloading and playing video file of voice,Adopt speech recognition, image recognition and Internet communication technology realize respectively to driver's voice resolve,Mood detects and video file download function, and can automatically play the video file of download, for motor-drivenCar driver provides convenience, abundant visual enjoyment.
Be understandable that, although the present invention disclose as above with preferred embodiment, but above-mentioned enforcementExample is not in order to limit the present invention. For any those of ordinary skill in the art, do not departing fromIn technical solution of the present invention scope situation, all can utilize the technology contents of above-mentioned announcement to the technology of the present inventionScheme is made many possible variations and modification, or is revised as the equivalent embodiment of equivalent variations. Therefore,Every content that does not depart from technical solution of the present invention, foundation technical spirit of the present invention is to above embodimentAny simple modification, equivalent variations and the modification done, all still belong to technical solution of the present invention protectionIn scope.

Claims (1)

1. a video file retrieval system for communication Network Based, is arranged in motor vehicle, described inSearching system comprises AT89C51 single-chip microcomputer, speech recognition apparatus, image detecting apparatus and network retrievalEquipment, described speech recognition apparatus is used for cognitron motor-car driver's current speech to obtain current languageVideo player name in sound, described image detecting apparatus is current for detection of automobile driverMood, described AT89C51 single-chip microcomputer and described speech recognition apparatus, described image detecting apparatus and instituteState network retrieval equipment and connect respectively, based on described video player name and described current emotion controlThe video file retrieval operation of described network retrieval equipment in internet;
Described searching system also comprises:
Video playback apparatus, comprises display and user input device, for receiving and displaying video literary compositionPart, described display is LCDs, described user input device is for to be integrated in described displayTouch-screen together;
Power supply unit, comprises that solar powered device, vehicle battery, change-over switch and voltage turnParallel operation, described change-over switch connects respectively with described solar powered device and described vehicle batteryConnect, according to the dump energy of vehicle battery determine whether to be switched to described solar powered device withPowered by described solar powered device, described electric pressure converter is connected with described change-over switch, to incite somebody to actionThe 5V voltage transitions of inputting by change-over switch is 3.3V voltage;
Portable hard drive, is arranged in the instrument board of motor vehicle, for store facial upper limit gray threshold,Face lower limit gray threshold and each facial emotions reference pattern, described facial upper limit gray threshold and instituteState facial lower limit gray threshold for from image by face and background separation, each facial emotions benchmarkPattern is corresponding people's various moods respectively, and each facial emotions reference pattern is for right to having in advanceAnswer the face of mood to take obtained pattern, people's various moods comprise sadness, joy,Tranquil and angry;
CCD camera, is arranged on the front at automobile driver seat, for to automobile driverFace carry out IMAQ, to obtain face-image;
Described image detecting apparatus, is arranged in the instrument board of motor vehicle, with described CCD cameraConnect, receive described face-image, described face-image is identified to obtain the current of driverMood; Described image detecting apparatus comprises contrast enhancement unit, wavelet filtering unit, gray processing placeReason unit, face pattern extraction unit and mood analytic unit, described contrast enhancement unit with described inCCD camera connects so that described face-image is carried out to contrast enhancement processing, obtains and strengthens face figurePicture, described wavelet filtering unit is connected with described contrast enhancement unit with to described enhancing face-imageCarry out the filtering processing based on Ha Er wavelet filter, obtain filtering face-image, described gray processing placeReason unit is connected with described wavelet filtering unit, for described filtering face-image is carried out to gray processing placeReason, to obtain gray processing face-image, described face pattern extraction unit and described gray processing are processed singleFirst and described portable hard drive is connected respectively, by gray value in described gray level image in the described facial upper limitPixel between gray threshold and described facial lower limit gray threshold is identified and is formed driver's face and schemesCase, described mood analytic unit connects respectively with described face pattern extraction unit and described portable hard driveConnect, described driver's face pattern is mated with each facial emotions reference pattern, will be matched toThe facial emotions corresponding to facial emotions reference pattern of merit exported as current mood;
Described speech recognition apparatus comprise voice recognition chip, text conversion device, FLASH memory andRS232 serial ports, described speech ciphering equipment chip receiver motor-car driver's current speech by motor vehicleDriver's current speech is converted to digital audio file, the pre-stored word of described FLASH memorySymbol string identification form, described text conversion device and described voice recognition chip and described FLASH storageDevice connects respectively, and described digital audio file is converted to character string, and based on described character string identificationFormat identification goes out the video player name in described character string, described RS232 serial ports and described wordConverter connects, for receiving and export described video player name;
Described AT89C51 single-chip microcomputer, with described image detecting apparatus, described portable hard drive, institute's predicateSound identification equipment is connected respectively with described network retrieval equipment, and the search of described network retrieval equipment is setRule is as follows: in the time that the current mood receiving is sadness, control described network retrieval equipment interconnectedOnline search receives from described speech recognition apparatus in all works of video player name and drillsTo play style be peaceful video file and download in the play buffer of described video playback apparatus, whenWhen the current mood receiving is happy, controls described network retrieval equipment and search on the internet from instituteIt is hot stating playing style in all works that speech recognition apparatus place receives video player nameVideo file and download in the play buffer of described video playback apparatus, current when what receiveWhen mood is tranquil, controls described network retrieval equipment and search on the internet from described speech recognition and establishStandby place receive playing style in all works of video player name be lyric video file alsoDownload in the play buffer of described video playback apparatus, when the current mood receiving is indignationTime, control described network retrieval equipment and search on the internet from described speech recognition apparatus and receiveIn all works of video player name playing style be the video file of arguing and download to described inIn the play buffer of video playback apparatus;
Described network retrieval equipment, comprises that network communication interface and search rule arrange device, described netNetwork communication interface is 4G mobile communication interface, and described search rule arranges device and described network serviceInterface is connected respectively with described AT89C51 single-chip microcomputer, establishes for receiving described AT89C51 single-chip microcomputerThe search rule of putting is searched according to described search rule on the internet to control described network communication interfaceRope is also downloaded corresponding video file, when corresponding video file is while being multiple, selects people on internetThe most prosperous video file of gas is downloaded, and described network communication interface is also connected with described video playback apparatus,For the video file of download being forwarded to the play buffer of described video playback apparatus;
Wherein, described contrast enhancement unit, described wavelet filtering unit, described gray processing are processed singleFirst, described face pattern extraction unit and described mood analytic unit adopt respectively different FPGA coresSheet is realized, and is integrated on a surface-mounted integrated circuit;
Wherein, described character string identification form is in character string, and latter two character is video,All characters before latter two character are video player name;
Wherein, fpga chip adopts the design of Hardware Description Language VHDL completing circuit;
Wherein, described contrast enhancement unit, described wavelet filtering unit, described gray processing are processed singleThe realization of the fpga chip of first, described face pattern extraction unit and described mood analytic unit comprises:Adopt the design of Hardware Description Language VHDL completing circuit, will complete with Hardware Description Language VHDLCircuit design carry out comprehensive and layout, the circuit design after comprehensive and layout is burnt on FPGATest; FPGA inside comprises multiple logical blocks, the electricity completing with Hardware Description Language VHDLRoad is designed for the logical block of FPGA inside is coupled together.
CN201510306346.9A 2015-06-06 2015-06-06 The video file retrieval system of communication Network Based Expired - Fee Related CN104883590B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510306346.9A CN104883590B (en) 2015-06-06 2015-06-06 The video file retrieval system of communication Network Based

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510306346.9A CN104883590B (en) 2015-06-06 2015-06-06 The video file retrieval system of communication Network Based

Publications (2)

Publication Number Publication Date
CN104883590A CN104883590A (en) 2015-09-02
CN104883590B true CN104883590B (en) 2016-05-11

Family

ID=53950899

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510306346.9A Expired - Fee Related CN104883590B (en) 2015-06-06 2015-06-06 The video file retrieval system of communication Network Based

Country Status (1)

Country Link
CN (1) CN104883590B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1716413A (en) * 2004-07-02 2006-01-04 深圳市朗科科技有限公司 Vehicle carried speech identification audio-video playing device and method
CN102523502A (en) * 2011-12-15 2012-06-27 四川长虹电器股份有限公司 Intelligent television interaction system and interaction method
CN103377293A (en) * 2013-07-05 2013-10-30 河海大学常州校区 Holographic touch interactive exhibition system with multisource input and intelligent information optimizing functions
CN203661267U (en) * 2013-11-19 2014-06-18 浙江吉利汽车研究院有限公司 Automobile audio system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1716413A (en) * 2004-07-02 2006-01-04 深圳市朗科科技有限公司 Vehicle carried speech identification audio-video playing device and method
CN102523502A (en) * 2011-12-15 2012-06-27 四川长虹电器股份有限公司 Intelligent television interaction system and interaction method
CN103377293A (en) * 2013-07-05 2013-10-30 河海大学常州校区 Holographic touch interactive exhibition system with multisource input and intelligent information optimizing functions
CN203661267U (en) * 2013-11-19 2014-06-18 浙江吉利汽车研究院有限公司 Automobile audio system

Also Published As

Publication number Publication date
CN104883590A (en) 2015-09-02

Similar Documents

Publication Publication Date Title
CN104951520A (en) Search platform for acquiring music file from Internet
CN104883591B (en) The video file retrieval system of communication Network Based
CN100559463C (en) Voice recognition dictionary scheduling apparatus and voice recognition device
CN104851435B (en) A kind of music intellectuality player method based on network service
CN105045926B (en) A kind of searching method obtaining music file at the Internet
CN206805467U (en) A kind of vehicle personalization custom-built system and automobile based on gesture identification
CN106506975A (en) A kind of image pickup method and terminal
CN104883590B (en) The video file retrieval system of communication Network Based
CN106028088A (en) Insertion method and device of media data
CN106457039A (en) Virtual game operation platform and virtual game operation method based on artificial intelligence
CN104883589B (en) Video file playing platform based on detection of electrons
CN107545884A (en) A kind of singing system based on internet
CN105681852B (en) A kind of video file retrieval system based on network service
CN104835518B (en) The music intellectuality Play System of communication Network Based
CN106024004A (en) Dual-microphone noise reduction processing method and system for mobile terminal and mobile terminal
CN104883592B (en) A kind of video file playing platform based on detection of electrons
CN106412285A (en) Method for entering expression mode and mobile terminal
CN105679351A (en) Intelligent music play system based on network communication
CN101082842A (en) Digital keyboard Chinese character input method used for built-in equipment
CN201917926U (en) Automatic long-terminology extracting device having scanning function
CN113176893A (en) Simulation method and device for automobile control, storage medium and terminal equipment
CN102456305A (en) Voice recognition-based portable intelligent multimedia visitor guiding system
CN106383677A (en) Entertainment system and setting method thereof, and vehicle having same
CN105812871A (en) Video file playing method based on electronic detection
CN217835513U (en) Vehicle-mounted sound system of automobile and automobile

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
EXSB Decision made by sipo to initiate substantive examination
SE01 Entry into force of request for substantive examination
C41 Transfer of patent application or patent right or utility model
CB03 Change of inventor or designer information

Inventor after: Tong Xinyu

Inventor before: Kong Hua

COR Change of bibliographic data
TA01 Transfer of patent application right

Effective date of registration: 20160412

Address after: 453000, No. three, No. six, Xiaodian Industrial Park, Henan, Xinxiang

Applicant after: Xinxiang Polytechnic College

Address before: 262100 No. 19 health Road, Anqiu, Shandong, Weifang

Applicant before: Kong Hua

C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20160511

Termination date: 20170606

CF01 Termination of patent right due to non-payment of annual fee