CN203070312U

CN203070312U - Motion recognition and voice synthesis technology-based sign language interpreting system

Info

Publication number: CN203070312U
Application number: CN 201220690380
Authority: CN
Inventors: 陈拥权; 王略志; 刘思杨; 胡翀豪
Original assignee: Hefei Huanjing Information Technology Co Ltd
Current assignee: Hefei Huanjing Information Technology Co Ltd
Priority date: 2012-12-13
Filing date: 2012-12-13
Publication date: 2013-07-17
Anticipated expiration: 2022-12-13

Abstract

Disclosed in the utility model is a motion recognition and voice synthesis technology-based sign language interpreting system comprising a housing. An FPGA and a DSP are arranged in the housing; and a pair of cameras for collecting sign language movements of a human body are arranged on the housing and the signal lines of the two cameras are respectively connected to the FPGA. The FPGA and the DSP are in bidirectional communication connection; the DSP is respectively connected with the two cameras by I2C/SPI buses and is also in communication connection with an upper computer by a USB bus; and the upper computer is externally connected with a voice playing module. The upper synthesizes image data, collected by the cameras and transmitted by the DSP, of body sign language motions into video signals; and the video signals are converted into voice information that is played by the voice playing module. With utilization of the system, synchronous image collection of the two cameras can be realized; and the realized motion recognition and voice synthesis technology-based sign language interpreting system has a good application prospect.

Description

A kind of sign language interpretation system based on action recognition and speech synthesis technique

Technical field

The utility model relates to electronic device field, is specially a kind of sign language interpretation system based on action recognition and speech synthesis technique.

Background technology

Motion identification device based on video is made of main frame, action recognition module etc., can be by the moving image of the camera collection human body in the motion identification device, and by integrated image algorithm chip, moving image is resolved, form the Three-Dimensional Dynamic coordinate of human motion, synthetic and emulation obtain corresponding action video at last, so motion identification device can be used as the infrastructure device of sign language interpretation system through the image of main frame.And in the prior art still not based on the sign language interpretation system of action recognition and speech synthesis technique.

The utility model content

The purpose of this utility model provides a kind of sign language interpretation system based on action recognition and speech synthesis technique, to solve the problem that does not still have in the prior art based on the sign language interpretation system of action recognition and speech synthesis technique.

In order to achieve the above object, the technical scheme that adopts of the utility model is:

A kind of sign language interpretation system based on action recognition and speech synthesis technique, include housing, it is characterized in that: be provided with FPGA and DSP in the described housing, housing is provided with a pair of for the camera of gathering human body sign language action, two camera signals lines insert FPGA respectively, described FPGA is connected with the DSP two-way communication, described DSP is connected with two cameras by the I2C/SPI bus respectively, DSP also is connected with upper machine communication by usb bus, host computer is circumscribed with the speech play module, the view data composite video signal of the human body sign language action of the camera collection that host computer transmits DSP is converted into vision signal voice messaging again and broadcasts by the speech play module.

Described a kind of sign language interpretation system based on action recognition and speech synthesis technique is characterized in that: have access to two SRAM on the described FPGA, have access to a SDRAM and a Nand/Nor FLASH on the described DSP.

The utility model is used FPGA and is driven two cameras, and make two cameras gather moving image synchronously by the I2C/SPI bus of DSP according to Bumblebee binocular measuring principle, and view data carries out being sent to host computer after the pre-service at DSP.The view data composite video signal of the human body sign language action of the camera collection that host computer transmits DSP is converted into vision signal voice messaging again and broadcasts by the speech play module.The utility model can be realized the synchronous images collection of dual camera, and has realized having good application prospects based on the sign language interpretation system of action recognition and speech synthesis technique.

Description of drawings

Fig. 1 is the utility model structured flowchart.

Embodiment

As shown in Figure 1.A kind of sign language interpretation system based on action recognition and speech synthesis technique, include housing, be provided with FPGA and DSP in the housing, housing is provided with a pair of for the camera 1 of gathering human body sign language action, two cameras, 1 signal wire inserts FPGA respectively, FPGA is connected with the DSP two-way communication, DSP is connected with two cameras 1 by the I2C/SPI bus respectively, DSP also is connected with host computer 2 communications by usb bus, host computer 2 is circumscribed with speech play module 3, the view data composite video signal of the human body sign language action of the camera collection that host computer 2 transmits DSP is converted into vision signal voice messaging again and broadcasts by speech play module 3.Have access to two SRAM on the FPGA, have access to a SDRAM and a Nand/Nor FLASH on the described DSP.

Claims

1. sign language interpretation system based on action recognition and speech synthesis technique, include housing, it is characterized in that: be provided with FPGA and DSP in the described housing, housing is provided with a pair of for the camera of gathering human body sign language action, two camera signals lines insert FPGA respectively, described FPGA is connected with the DSP two-way communication, described DSP is connected with two cameras by the I2C/SPI bus respectively, DSP also is connected with upper machine communication by usb bus, host computer is circumscribed with the speech play module, the view data composite video signal of the human body sign language action of the camera collection that host computer transmits DSP is converted into vision signal voice messaging again and broadcasts by the speech play module.

2. a kind of sign language interpretation system based on action recognition and speech synthesis technique according to claim 1 is characterized in that: have access to two SRAM on the described FPGA, have access to a SDRAM and a Nand/Nor FLASH on the described DSP.