Based on multimedia interaction inquiry all-in-one and the using method thereof of gesture identification
Technical field
The invention belongs to smart machine field, particularly relate to a kind of multimedia interaction based on gesture identification inquiry all-in-one and using method thereof.
Background technology
Existing inquiry all-in-one is only do simple Query Information, and input user operation by touch screen, not only cost is high, and wisdom interaction sense is poor.
Summary of the invention
Goal of the invention: invent a kind of multimedia interaction based on gesture identification inquiry all-in-one, the content of multimedia inquiry realizing public place enquiry machine is interactive with hommization, and reduces the cost of touch screen input.
Technical scheme: a kind of inquiry of the multimedia interaction based on gesture identification all-in-one, comprise housing 6 and be arranged on main control computer 1,3D gesture induction module 2, display 3, stereo set 4, AC-DC power supply 5, background server 7, application software CD 8 and the various network interface on housing 6
Described main control computer 1 is made up of four core arm processors 101, USB HUB chip 102, RS232 transceiver 103, audio frequency DAC-circuit 104, ethernet transceiver circuit 105; Described 3D gesture induction module 2 follows the tracks of attitude controller 202 by host CPU 201,3D, gesture identification antenna 203 forms; Described application software CD 8 comprises application software 801 and application platform 802;
Described four core arm processors 101 connect USB HUB chip 102 by usb protocol 106, and the single channel USB HOST of four core arm processors 101 is extended to multichannel usb 1 07, for connecting described 3D gesture induction module 2 and application software CD 8; By LVDS bus 108, vision signal is directly outputted to display 3; Pass through I
2s bus 109 connects audio frequency DAC-circuit 104, audio digital signals is converted to analog signal output to outside stereo set 4; RS232 transceiver 103 is connected and externally connected portable formula or portable equipment 114 by UART bus 112; Connect ethernet transceiver 105 by industry ethernet 110, realize the data interaction with background server 7 through Ethernet 111;
The host CPU 201 of described 3D gesture induction module 2, is connected with main control computer 1 by usb 1 07, passes through I
2c hardware communication interface 113 and described 3D follow the tracks of attitude controller 202 and are connected, thus realize the I that 3D follows the tracks of attitude controller 202 to four core arm processor 101
2c turns usb function;
Described 3D follows the tracks of attitude controller 202 and obtains gesture motion information by gesture identification antenna 203, and effective action message is sent to described four core arm processors 101, described four core arm processors 101 operate accordingly according to action message.
Preferably, described four core arm processors 101 are Freescale I.MX6Q, are brains of the present invention, there is powerful data processing performance, inner integrated 4 CORTEX-A9 kernels, running frequency reaches 1.2GHz, with 1MB L2 buffer memory, support that 1080P@60fps decoding and 1080P@30fps encode, can also play 3D video under high definition pattern, it can also manage the dual camera for 3D stereoscopic shooting simultaneously, has independently 2D and summit accelerating engine simultaneously; Interface aspect, can support HDMI1.4, USB2.0 and gigabit ethernet card; Have abundant peripheral interface, as USB OTG, USB HOST, SPI, I simultaneously
2c, UART etc., be responsible for peripherals access.
Described USB HUB chip 102, adopt four port concentrator controller USB2514 of SMSC company, internal circuit comprises transponder (HUB Repeater), controller (HUB Controller) and process translater (Transaction Translator, TT); This controller has 1 USB uplink port, 4 USB downlink ports, each downlink port maximum operating currenbt can be 500mA, flank speed is 480Mbps, and proposes the third high transmission speeds on the basis of full speed USB1.1 (transfer rate is 12Mbps) and low speed USB1.0 (transfer rate is 1.5Mbps); Complete compatible USB1.1 and USB1.0 of USB2.0; USB HUB supports the USB external unit of multiple different attribute, and tiered-star topology structural support reaches 127 external units, for USB user provide convenience, simple and direct connected mode; Also support hot plug, namely when not shutting down, user can directly insert or extract equipment simultaneously.
Described RS232 transceiver 103, adopt the SP3232EEN chip of SIPEX company, this receiver is the device of 2 driver/2 receivers, comprises Sipex series distinctive interior charge pump circuit, can produce the RS-232 voltage level of 2 × Vcc from the supply voltage of+3.0V ~+5.5V; Meet EIA/TIA-232 and V.28/V.24 communication protocol, be applicable to portable or portable equipment, as notebook or palmtop computer; When the driver of this device is fully loaded with work, typical message transmission rate is 235Kbps; its inside is that All Drives exports and the esd protection that provides of receiver input pin, and the pin of driver and receiver can be born ± 15kV human-body model and IEC1000-4-2 bubble-discharge pattern.
Described audio frequency DAC-circuit 104, adopt NAU8822A chip, this chip is a low-power consumption, high-quality audio codec, integrated 24 stereo ADC and DAC module, can the audio frequency apparatus such as Direct driver loudspeaker, earphone.
Described ethernet transceiver circuit 105, adopt the AR8035 chip of ATHEROS company, this chip is the ethernet transceiver of a efficient 10/100/1000Mbps, support complete IEEE 802.3az standard, support the MAC interface of SGMII and RGMII, support 10base-T, 100BASE-TX and 1000BASE-T, support LAN to wake up and up to the full duplex of 10KB, the SmartEEE technology that Atheros is proprietary.
Described host CPU 201, adopt the PIC18F14K50 single-chip microcomputer of Microchip company, 20 pin USB flash memory single-chip microcomputers of a employing nanoWatt XLP technology, support full speed and the low speed USB2.0 of maximum 16 end points, integrated 256 byte binary channels fast operating RAM, 256 byte data EEPROM, 16K byte program storer; There is provided 10,11 tunnel ADC, No. 2 analog comparators, 1 road PWM exports, SPI and I
2the main synchronous serial port of C, 1 tunnel enhancement mode USART transceiver.
Described 3D follows the tracks of attitude controller 202, adopt the MGC3130 chip of Microchip company, this chip is that solution is followed the tracks of in global first item single-chip 3D gesture/free space position, is the new selection of man-machine interface solution, can detects the change of gesture in 70 ~ 130kHz electric field frequency; Utilize the GestIC technology that Microchip company is up-to-date, this chip the precision with 150dpi in the distance of 15cm can determine position, and sampling rate is 200 times per second, and this GestIC technology can detect hand, the position of finger, velocity and acceleration attribute; The firmware of this chip also can allow frequency realize beating, and fully gets rid of Radio frequency interference (RFI); Power requirement is very low, and being only 100mW in the process of detecting and process gesture, is 150uW under usual standby mode, 30uW during deep sleep mode.
Described gesture identification antenna 203, gets gesture motion information, effective action message is sent to four core arm processors 101, is operated accordingly by I.MX6Q primary processor according to action message.
Described display 3, adopt 19 cun of LCD display, resolution is 1440*900, is mainly used in man-machine interaction, information displaying.
Described stereo set 4 is stero set, and adopt 2*8 Europe 8W loudspeaker, for playback of audio information, by sound prompting, user operates accordingly.
Described AC-DC power supply 5, adopts integrated AC/DC power panel, supports the input of 110 ~ 240V alternating current, exports the DC voltage of 12V/3A, and each parts be mainly used in this enquiry machine provide sufficient stable power supply.
About the syndeton of 3D gesture induction module 2 with main control computer 1, see accompanying drawing 3:
By USB HID protocol interface 115, based on Linux character Driving technique, 3D gesture induction module 2 is connected with main control computer 1 and by usb protocol 107 by the information transmission of gesture relevant action on application software CD 8, and through application software 801 and application platform 802, realize the free gesture identification such as finger rotates, brandishes up and down, touch is clicked, double-click, realize multimedia inquiry machine gesture interaction function.
The invention also discloses the using method of a kind of multimedia interaction based on gesture identification inquiry all-in-one, comprising:
1) when user uses this enquiry machine, the gesture motion of system definition is carried out in 3D gesture identification region;
2) system is according to the gesture motion of definition, shows the operation that this user wants to carry out on a display screen, and user no longer needs to touch click virtual functions key on a display screen with finger and inquires about.
Beneficial effect of the present invention: the present invention is combined with ARM multimedia processor by Gesture Recognition, realize the content of multimedia inquiry of public place enquiry machine, three-dimensional content shows interaction, Flash animated content is interactive, only just need can complete interactive operation by Non-contact gesture, as left and right is brandished choice menus content, pointed rotation and choose target; This enquiry machine can simplify the operation largely, reduces costs, and only needs common LCD display, no longer needs touch pad; Beautify interface, do not need on interface, place virtual functions key, the probability of cross-infection can also be reduced; Range of application is boundless, mainly contains the inquiry of public information, as the service inquiry of the departments such as telecommunication bureau, the tax bureau, bank, electric power; The information inquiry in street corner, city; Enterprise's office, Industry Control, military commanding, electronic game, choosing song or selecting dish, multimedia teaching, real estate presell etc. can be widely used in addition.
Concrete superiority: electric field 3D gesture identification, realizes finger and rotates, brandishes up and down, touches free gesture identification such as (click, double-click); Support 1080P encodes multimedia content, decoding display, interactive operation; Support 100/1000M network insertion, network enabled directly transmits high-resolution media; Support multiple multimedia IO interface, integrated LVDS, MIPI, HDMI etc. simultaneously.
Accompanying drawing explanation
Fig. 1 is each parts connection diagram of the present invention's interaction inquiry all-in-one;
Fig. 2 is the 3D gesture induction inside modules connection diagram of the present invention's interaction inquiry all-in-one;
Fig. 3 is the 3D gesture induction module 2 of the present invention's interaction inquiry all-in-one and the syndeton schematic diagram of main control computer 1.
Embodiment
In order to make the object, technical solutions and advantages of the present invention clearly, describe the present invention below in conjunction with the drawings and specific embodiments.
Embodiment:
As shown in Figure 1, a kind of inquiry of the multimedia interaction based on gesture identification all-in-one, comprise housing 6 and be arranged on main control computer 1,3D gesture induction module 2, display 3, stereo set 4, AC-DC power supply 5, background server 7, application software CD 8 and the various network interface on housing 6
Described main control computer 1 is made up of four core arm processors 101, USB HUB chip 102, RS232 transceiver 103, audio frequency DAC-circuit 104, ethernet transceiver circuit 105; Described 3D gesture induction module 2 follows the tracks of attitude controller 202 by host CPU 201,3D, gesture identification antenna 203 forms; Described application software CD 8 comprises application software 801 and application platform 802;
Described four core arm processors 101 connect USB HUB chip 102 by usb protocol 106, and the single channel USB HOST of four core arm processors 101 is extended to multichannel usb 1 07, for connecting described 3D gesture induction module 2 and application software CD 8; By LVDS bus 108, vision signal is directly outputted to display 3; Pass through I
2s bus 109 connects audio frequency DAC-circuit 104, audio digital signals is converted to analog signal output to outside stereo set 4; RS232 transceiver 103 is connected and externally connected portable formula or portable equipment 114 by UART bus 112; Connect ethernet transceiver 105 by industry ethernet 110, realize the data interaction with background server 7 through Ethernet 111;
As Fig. 2, the host CPU 201 of described 3D gesture induction module 2, is connected with main control computer 1 by usb 1 07, passes through I
2c hardware communication interface 113 and described 3D follow the tracks of attitude controller 202 and are connected, thus realize the I that 3D follows the tracks of attitude controller 202 to four core arm processor 101
2c turns usb function;
Described 3D follows the tracks of attitude controller 202 and obtains gesture motion information by gesture identification antenna 203, and effective action message is sent to described four core arm processors 101, described four core arm processors 101 operate accordingly according to action message.
Described four core arm processors 101, for Freescale I.MX6Q, be brain of the present invention, there is powerful data processing performance, inner integrated 4 CORTEX-A9 kernels, running frequency reaches 1.2GHz, with 1MB L2 buffer memory, support that 1080P@60fps decoding and 1080P@30fps encode, 3D video can also be play under high definition pattern simultaneously, it can also manage the dual camera for 3D stereoscopic shooting simultaneously, has independently 2D and summit accelerating engine; Interface aspect, can support HDMI 1.4, USB2.0 and gigabit ethernet card; Have abundant peripheral interface, as USB OTG, USB HOST, SPI, I simultaneously
2c, UART etc., be responsible for peripherals access.
Described USB HUB chip 102, adopt four port concentrator controller USB2514 of SMSC company, internal circuit comprises transponder (HUB Repeater), controller (HUB Controller) and process translater (Transaction Translator, TT); This controller has 1 USB uplink port, 4 USB downlink ports, each downlink port maximum operating currenbt can be 500mA, flank speed is 480Mbps, and proposes the third high transmission speeds on the basis of full speed USB1.1 (transfer rate is 12Mbps) and low speed USB1.0 (transfer rate is 1.5Mbps); Complete compatible USB1.1 and USB1.0 of USB2.0; USB HUB supports the USB external unit of multiple different attribute, and tiered-star topology structural support reaches 127 external units, for USB user provide convenience, simple and direct connected mode; Also support hot plug, namely when not shutting down, user can directly insert or extract equipment simultaneously.
Described RS232 transceiver 103, adopt the SP3232EEN chip of SIPEX company, this receiver is the device of 2 driver/2 receivers, comprises Sipex series distinctive interior charge pump circuit, can produce the RS-232 voltage level of 2 × Vcc from the supply voltage of+3.0V ~+5.5V; Meet EIA/TIA-232 and V.28/V.24 communication protocol, be applicable to portable or portable equipment, as notebook or palmtop computer; When the driver of this device is fully loaded with work, typical message transmission rate is 235Kbps; its inside is that All Drives exports and the esd protection that provides of receiver input pin, and the pin of driver and receiver can be born ± 15kV human-body model and IEC1000-4-2 bubble-discharge pattern.
Described audio frequency DAC-circuit 104, adopt NAU8822A chip, this chip is a low-power consumption, high-quality audio codec, integrated 24 stereo ADC and DAC module, can the audio frequency apparatus such as Direct driver loudspeaker, earphone.
Described ethernet transceiver circuit 105, adopt the AR8035 chip of ATHEROS company, this chip is the ethernet transceiver of a efficient 10/100/1000Mbps, support complete IEEE 802.3az standard, support the MAC interface of SGMII and RGMII, support 10base-T, 100BASE-TX and 1000BASE-T, support LAN to wake up and up to the full duplex of 10KB, the SmartEEE technology that Atheros is proprietary.
Described host CPU 201, adopt the PIC18F14K50 single-chip microcomputer of Microchip company, 20 pin USB flash memory single-chip microcomputers of a employing nanoWatt XLP technology, support full speed and the low speed USB2.0 of maximum 16 end points, integrated 256 byte binary channels fast operating RAM, 256 byte data EEPROM, 16K byte program storer; There is provided 10,11 tunnel ADC, No. 2 analog comparators, 1 road PWM exports, SPI and I
2the main synchronous serial port of C, 1 tunnel enhancement mode USART transceiver;
Described 3D follows the tracks of attitude controller 202, adopt the MGC3130 chip of Microchip company, this chip is that solution is followed the tracks of in global first item single-chip 3D gesture/free space position, is the new selection of man-machine interface solution, can detects the change of gesture in 70 ~ 130kHz electric field frequency; Utilize the GestIC technology that Microchip company is up-to-date, this chip the precision with 150dpi in the distance of 15cm can determine position, and sampling rate is 200 times per second, and this GestIC technology can detect hand, the position of finger, velocity and acceleration attribute; The firmware of this chip also can allow frequency realize beating, and fully gets rid of Radio frequency interference (RFI); Power requirement is very low, and being only 100mW in the process of detecting and process gesture, is 150uW under usual standby mode, 30uW during deep sleep mode.
Described gesture identification antenna 203, gets gesture motion information, effective action message is sent to four core arm processors 101, is operated accordingly by I.MX6Q primary processor according to action message.
Described display 3, adopt 19 cun of LCD display, resolution is 1440*900, is mainly used in man-machine interaction, information displaying.
Described stereo set 4 is stero set, and adopt 2*8 Europe 8W loudspeaker, for playback of audio information, by sound prompting, user operates accordingly.
Described AC-DC power supply 5, adopts integrated AC/DC power panel, supports the input of 110 ~ 240V alternating current, exports the DC voltage of 12V/3A, and each parts be mainly used in this enquiry machine provide sufficient stable power supply.
About the syndeton of 3D gesture induction module 2 with main control computer 1, see accompanying drawing 3:
By USB HID protocol interface 115, based on Linux character Driving technique, 3D gesture induction module 2 is connected with main control computer 1 and by usb protocol 107 by the information transmission of gesture relevant action on application software CD 8, and through application software 801 and application platform 802, realize the free gesture identification such as finger rotates, brandishes up and down, touch is clicked, double-click, realize multimedia inquiry machine gesture interaction function.
The invention also discloses the using method of a kind of multimedia interaction based on gesture identification inquiry all-in-one, comprising:
1) when user uses this enquiry machine, the gesture motion of system definition is carried out in 3D gesture identification region;
2) system is according to the gesture motion of definition, shows the operation that this user wants to carry out on a display screen, and user no longer needs to touch click virtual functions key on a display screen with finger and inquires about.
The foregoing is only preferred embodiments of the present invention, not in order to limit the present invention, any amendment done within the spirit and principle of invention, equivalent replacement, improvement etc., all should be included within system architecture of the present invention and method.