CN110020442A - A kind of portable translating machine - Google Patents

A kind of portable translating machine Download PDF

Info

Publication number
CN110020442A
CN110020442A CN201910293557.1A CN201910293557A CN110020442A CN 110020442 A CN110020442 A CN 110020442A CN 201910293557 A CN201910293557 A CN 201910293557A CN 110020442 A CN110020442 A CN 110020442A
Authority
CN
China
Prior art keywords
camera
depth sensing
translator
sign language
app
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910293557.1A
Other languages
Chinese (zh)
Inventor
黄辰虎
张星星
张志伟
曹一菲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Dianji University
Original Assignee
Shanghai Dianji University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Dianji University filed Critical Shanghai Dianji University
Priority to CN201910293557.1A priority Critical patent/CN110020442A/en
Publication of CN110020442A publication Critical patent/CN110020442A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/40Processing or translation of natural language
    • G06F40/42Data-driven translation
    • G06F40/47Machine-assisted translation, e.g. using translation memory

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

A kind of portable translating machine, including putting mouth outside 3D depth sensing camera, camera, sound, putting volume key, power on button, charge port and capacity prompt lamp outside, the described translator is in glasses shape, include mirror pin and frame, there are two the settings of 3D depth sensing camera and is located in two mirror pins, the 3D depth of sign language movement can be measured by 3D depth sensing camera, to analyze and draw finger bone and joint point image, the 3D depth sensing camera is located at the junction of mirror pin and frame;The translator may be implemented to identify in real time using somatosensory recognition technology, and what deaf-mute can link up makes sign language movement, do not need gone after making a sign language etc. it is to be identified after doing next sign language movement, exchange convenient and efficient.

Description

A kind of portable translating machine
Technical field
The present invention relates to reception and transmitting device field, especially a kind of portable translating machines.
Background technique
In the prior art, more and more for sign language interpreter research work, then producing many translations needs band additionally to set Standby, there are many existing device, such as plate sign language translator, bracelet sign language translator, gloves sign language translator etc., have and directly set It sets and is used on gloves to capture the movement locus of hand, also have movement locus in vision capture hand, especially the latter's relevant apparatus Seldom, existing sign language translation device, translation need to carry many things, meanwhile, the designs such as device continuity are also relatively backward, right Device reliability of operation causes undesirable influence, for example the sign language of making that deaf-mute cannot link up acts, and needs doing Gone after sign language out etc. it is to be identified after doing next sign language movement, thus the low efficiency translated, it is therefore desirable to set again It is convenient to count a kind of translation, sign language translation device that is light-duty, quickly accomplishing without any letup.
The present invention be exactly in order to solve problem above and carry out improvement.
Summary of the invention
The object of the present invention is to provide it is a kind of it is easy to carry, light-duty, quickly accomplish without any letup, exchange convenient translator.
The present invention is that technical solution used by solving its technical problem is:
Mouth is put, volume key is put outside, opens outside a kind of portable translating machine, including 3D depth sensing camera, camera, sound Machine button, charge port and capacity prompt lamp, the described translator are in glasses shape, include mirror pin and frame, the camera shooting of 3D depth sensing There are two head settings and is located in two mirror pins, and the 3D depth of sign language movement can be measured by 3D depth sensing camera, To analyze and draw finger bone and joint point image, the 3D depth sensing camera is located at the connection of mirror pin and frame Place;
The camera is mounted between two frames, by the shooting of the camera, can extract human finger fortune The characteristic parameter of dynamic posture, to establish finger characteristic model;
Mouth is put outside the sound, volume key, power on button, charge port and capacity prompt lamp is put outside and is installed in mirror pin, Mouth is wherein put outside sound, puts volume key (3), power on button and charge port outside in a mirror pin, and capacity prompt lamp position is in another In one mirror pin;
Further, the described translator be able to cooperate APP carry out image, data processing calculate, the camera with it is described 3D depth sensing camera works at the same time, to obtain the plane characteristic of finger bone, further by bone node from image In separate, further read the bone node diagram that sub-argument goes out, with the sign language posture of institute's typing in APP carry out fuzzy diagnosis, Integration, is finally translated as text or voice for bone node diagram;
Specifically, carrying out bluetooth connection between the APP and translator, APP is installed on an electronic device, and translator is taken the photograph As head is captured, then 3D depth sensing camera is identified and is read, by being transferred to APP or output after data processing Voice transfer is to translator.
The APP is as follows by the process that camera captures data:
S1, camera is opened, camera grabs image, is shown to screen with preview and with 3D depth sensing camera Algorithm identification is carried out to the image of crawl;
S2, algorithm recognition result in step S1 is determined, is carried out in next step;
S3, it identifies successfully, directly displays recognition result;Identify it is unsuccessful, then need to attempt identification 3 times, if 3 times not Success then unsuccessfully tells user by sound or display unsuccessful result, if attempting identification 3 times, at least 1 time at Function, then return step S1.
Working principle are as follows: the translator is to carry out sign language capture, reading, output based on Kinect, is set in Kinect somatosensory In standby, major technique is laser speckle image-forming principle and structural light measurement, and structural light measurement technology can be by color, gray scale, three Information in the three-dimensional space such as dimension pattern is collected and is rebuild.And laser speckle imaging technology is that diffusing reflection occurs for laser Or it is generated when across frosted glass and is distributed light and shade hot spot at random.Kinect sensor can identify skeleton and can be carried out Movement tracking captures the three-dimensional feature of bone and individually extracts them.Capture deaf-mute's using camera glasses Sign language movement carries out fuzzy diagnosis, integration by the software of APP, is finally text or voice by sign language interpreter.
It may be implemented to identify in real time using somatosensory recognition technology the beneficial effects of the present invention are: the translator, deaf-mute What can be linked up makes sign language movement, do not need gone after making a sign language etc. it is to be identified after to do next sign language dynamic Make, exchanges convenient and efficient.
Detailed description of the invention
Fig. 1 is a kind of structural schematic diagram of portable translating machine proposed by the present invention.
Fig. 2 is a kind of work flow diagram of two kinds of working conditions of portable translating machine proposed by the present invention.
Fig. 3 is a kind of working state schematic representation of portable translating machine proposed by the present invention.
Fig. 4 is a kind of process flow diagram of the portable translating machine proposed by the present invention to capture data.
Specific embodiment
In order to be easy to understand the technical means, the creative features, the aims and the efficiencies achieved by the present invention, tie below Diagram and specific embodiment are closed, the present invention is further explained.
Referring to Fig.1, shown in Fig. 2, Fig. 3, the portable translating machine, including 3D depth sensing camera 4, camera 5, sound It puts mouth 1 outside, put volume key 3, power on button 2, charge port 6 and capacity prompt lamp 7 outside, the described translator is in glasses shape, includes Mirror pin and frame, there are two the settings of 3D depth sensing camera 4 and is located in two mirror pins, passes through 3D depth sensing camera The 3D depth of sign language movement can be measured, to analyze and draw finger bone and joint point image, the 3D depth sensing is taken the photograph The junction for being located at mirror pin and frame as first 4;
The camera 5 is mounted between two frames, by the shooting of the camera 5, can extract human finger The characteristic parameter of athletic posture, to establish finger characteristic model;
Mouth 1 is put outside the sound, volume key 3, power on button 2, charge port 6 and capacity prompt lamp 7 is put outside and is installed in mirror On foot, mouth 1 is wherein put outside sound, puts volume key (3), power on button 2 and charge port 6 outside in a mirror pin, capacity prompt Lamp 7 is located in another mirror pin;
Further, the described translator be able to cooperate APP carry out image, data processing calculate, the camera 5 with it is described 3D depth sensing camera works at the same time, to obtain the plane characteristic of finger bone, further by bone node from image In separate, further read the bone node diagram that sub-argument goes out, with the sign language posture of institute's typing in APP carry out fuzzy diagnosis, Integration, is finally translated as text or voice for bone node diagram;
Specifically, carrying out bluetooth connection between the APP and translator, APP is installed on an electronic device, and translator is taken the photograph As first 5 are captured, then 3D depth sensing camera 4 is identified and is read, by being transferred to APP or defeated after data processing Voice transfer is to translator out;
The APP is as follows by the process that camera 5 captures data:
S1, camera 5 is opened, camera 5 grabs image, is shown to screen with preview and is imaged with 3D depth sensing The image of first 4 pairs of crawls carries out algorithm identification;
S2, algorithm recognition result in step S1 is determined, is carried out in next step;
S3, it identifies successfully, directly displays recognition result;Identify it is unsuccessful, then need to attempt identification 3 times, if 3 times not Success then unsuccessfully tells user by sound or display unsuccessful result, if attempting identification 3 times, at least 1 time at Function, then return step S1.
The translator is to carry out sign language capture, reading, output, in Kinect somatosensory device, main skill based on Kinect Art is laser speckle image-forming principle and structural light measurement, and structural light measurement technology can be by three-dimensionals such as color, gray scale, three-dimensional appearances Information in space is collected and is rebuild.And laser speckle imaging technology is that laser occurs diffusing reflection or passes through hair glass It is generated when glass and is distributed light and shade hot spot at random.Kinect sensor can identify skeleton and can be carried out movement tracking, catch It catches the three-dimensional feature of bone and individually extracts them.The sign language movement that deaf-mute is captured using camera glasses, is led to The software for crossing APP carries out fuzzy diagnosis, integration, is finally text or voice by sign language interpreter.
Normal users encounter deaf and dumb user, and normal person only needs normal voice to speak, and translator can say user If be converted into text, picture or animation, then interact to deaf-mute, facilitate different deaf-mutes (may be ignorant of Chinese or Do not recognize word) understand.
Deaf and dumb user encounters normal users, deaf-mute only need it is coherent make sign language movement, normal person only need using Camera capture the sign language movement of deaf-mute, is translated by APP equipment, and identification is converted into text, voice, then hands over Mutually to normal person.
When normal person user person need to wear the translator, firstly the need of long-pressing power on button 2 three seconds before wearing, work as booting Afterwards, the bluetooth built in translator, 3D depth sensing camera 4, camera 5 can all be opened, and be needed at this time using with bluetooth function The mobile device (such as mobile phone, notebook) of energy is connected thereto, and it is corresponding to need to open APP selection by exchange both sides after connection (normal person user selects corresponding normal person to user;Deaf-mute user selects corresponding deaf-mute).User can pass through typewriting Or voice input is converted to text, then the text of input is sent to other side.
When deaf-mute's sign language, normal person user just needs to put on the translator having been switched on, and passes through translator two sides 3D depth sensing camera 4 can measure the 3D depth of sign language movement, so that finger bone and joint point image are analyzed and draw, Camera 5 and 3D depth sensing camera 4 can work together simultaneously, extract the characteristic parameter of human finger athletic posture, thus Finger characteristic model is established, image, data processing calculating are then carried out by APP, so that the plane characteristic of finger bone is obtained, Bone node is separated from image further, the bone node diagram that sub-argument goes out further is read, with institute's typing in APP Sign language posture carry out fuzzy diagnosis, integration, bone node diagram is finally translated as text or voice.The voice translated will The broadcasting for carrying out voice by putting mouth 1 outside the sound of translator side.User can be by putting volume key 3 for the volume of voice outside Voluntarily adjust.
Translator has power prompt function, can carry out flash for prompting by capacity prompt lamp 7 when electricity is lower than 15%, Warning light color is red, can be charged by charge port 6 when electricity is low, when charging, capacity prompt lamp 7 can constant, mention Show lamp color for red;Point capacity prompt lamp 7 becomes green when fully charged after, can automatic distinguishing after charging.When user makes After being finished translator, user can be with 2 three seconds progress power-off operations of long-pressing power on button.
The translator is not required to additional using the movement locus that glasses are collected hand only with one belt transect of common spectacles Equipment, be away from home it is convenient, facilitate exchange carry;Using laser speckle image-forming principle and structural light measurement, pass through captured information While translated, to be handled in real time;The cost of product is cheap, than the intelligent glasses cost in market It is low, it is only necessary to receive and transfer function, the translator may be implemented to identify in real time using somatosensory recognition technology, deaf-mute can connect What is passed through makes sign language movement, do not need gone after making a sign language etc. it is to be identified after doing next sign language movement, exchange It is convenient and efficient.
The basic principles, main features and advantages of the present invention have been shown and described above.The technology of the industry Personnel are it should be appreciated that the present invention is not limited to the above embodiments, and the above embodiments and description only describe this The principle of invention, various changes and improvements may be made to the invention without departing from the spirit and scope of the present invention, these changes Change and improvement all fall within the protetion scope of the claimed invention.The claimed scope of the invention by appended claims and its Equivalent defines.

Claims (4)

1. putting mouth (1), outer playback outside a kind of portable translating machine, including 3D depth sensing camera (4), camera (5), sound Measure key (3), power on button (2), charge port (6) and capacity prompt lamp (7), it is characterised in that:
The described translator is in glasses shape, includes mirror pin and frame, there are two 3D depth sensing camera (4) settings and difference position In in two mirror pins, the 3D depth sensing camera (4) is located at the junction of mirror pin and frame;
The camera (5) is mounted between two frames;
Mouth (1) is put outside the sound, volume key (3), power on button (2), charge port (6) and capacity prompt lamp (7) is put outside and pacifies In mirror pin, mouth (1) wherein is put outside sound, volume key (3), power on button (2) and charge port (6) is put outside and is located at a mirror pin On, capacity prompt lamp (7) is located in another mirror pin.
2. a kind of portable translating machine as described in claim 1, which is characterized in that the described translator is able to cooperate APP progress Image, data processing calculate, and the camera (5) works at the same time with the 3D depth sensing camera.
3. a kind of portable translating machine as claimed in claim 2, which is characterized in that carried out between the APP and translator blue Tooth connection, APP are installed on an electronic device, and the camera (5) of translator is captured, then 3D depth sensing camera (4) It is identified and is read, by being transferred to APP after data processing or exporting voice transfer to translator.
4. a kind of portable translating machine as claimed in claim 3, which is characterized in that the APP captures number by camera (5) According to process it is as follows:
S1, camera (5) are opened, camera (5) grabs image, is shown to screen with preview and is imaged with 3D depth sensing Head (4) carries out algorithm identification to the image of crawl;
S2, algorithm recognition result in step S1 is determined, is carried out in next step;
S3, it identifies successfully, directly displays recognition result;Identify it is unsuccessful, then need to attempt identification 3 times, if 3 times not at Function then unsuccessfully tells user by sound or display unsuccessful result, if attempting identification 3 times, at least 1 success, Then return step S1.
CN201910293557.1A 2019-04-12 2019-04-12 A kind of portable translating machine Pending CN110020442A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910293557.1A CN110020442A (en) 2019-04-12 2019-04-12 A kind of portable translating machine

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910293557.1A CN110020442A (en) 2019-04-12 2019-04-12 A kind of portable translating machine

Publications (1)

Publication Number Publication Date
CN110020442A true CN110020442A (en) 2019-07-16

Family

ID=67191205

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910293557.1A Pending CN110020442A (en) 2019-04-12 2019-04-12 A kind of portable translating machine

Country Status (1)

Country Link
CN (1) CN110020442A (en)

Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101567041A (en) * 2009-05-25 2009-10-28 公安部交通管理科学研究所 Method for recognizing characters of number plate images of motor vehicles based on trimetric projection
CN102956132A (en) * 2011-08-25 2013-03-06 鸿富锦精密工业(深圳)有限公司 System, device and method for translating sign languages
CN103914152A (en) * 2014-04-11 2014-07-09 周光磊 Recognition method and system for multi-point touch and gesture movement capturing in three-dimensional space
CN204242466U (en) * 2014-12-08 2015-04-01 安徽工程大学 Sign language intertranslation device
CN206039075U (en) * 2016-09-14 2017-03-22 孙逸 Intelligence translation glasses
CN106683533A (en) * 2017-02-07 2017-05-17 德阳力久云智知识产权运营有限公司 Special communication glasses for deaf-mutes
CN106887059A (en) * 2017-01-18 2017-06-23 华南农业大学 A kind of intelligent electronic lock system based on face recognition
CN106896529A (en) * 2017-03-26 2017-06-27 王金锁 Deaf-mute's synchronous translation glasses
CN107169449A (en) * 2017-05-14 2017-09-15 吉林大学 Chinese sign language interpretation method based on depth transducer
CN107223277A (en) * 2016-12-16 2017-09-29 深圳前海达闼云端智能科技有限公司 A kind of deaf-mute's householder method, device and electronic equipment
CN107798964A (en) * 2017-11-24 2018-03-13 郑军 The sign language intelligent interaction device and its exchange method of a kind of Real time identification gesture
CN107801413A (en) * 2016-06-28 2018-03-13 华为技术有限公司 The terminal and its processing method being controlled to electronic equipment
CN108629241A (en) * 2017-03-23 2018-10-09 华为技术有限公司 A kind of data processing method and data processing equipment
CN108702580A (en) * 2016-02-19 2018-10-23 微软技术许可有限责任公司 Hearing auxiliary with automatic speech transcription
CN108960158A (en) * 2018-07-09 2018-12-07 珠海格力电器股份有限公司 Intelligent sign language translation system and method
CN109145564A (en) * 2018-08-22 2019-01-04 中国工商银行股份有限公司 Control the method and device of mobile terminal

Patent Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101567041A (en) * 2009-05-25 2009-10-28 公安部交通管理科学研究所 Method for recognizing characters of number plate images of motor vehicles based on trimetric projection
CN102956132A (en) * 2011-08-25 2013-03-06 鸿富锦精密工业(深圳)有限公司 System, device and method for translating sign languages
CN103914152A (en) * 2014-04-11 2014-07-09 周光磊 Recognition method and system for multi-point touch and gesture movement capturing in three-dimensional space
CN204242466U (en) * 2014-12-08 2015-04-01 安徽工程大学 Sign language intertranslation device
CN108702580A (en) * 2016-02-19 2018-10-23 微软技术许可有限责任公司 Hearing auxiliary with automatic speech transcription
CN107801413A (en) * 2016-06-28 2018-03-13 华为技术有限公司 The terminal and its processing method being controlled to electronic equipment
CN206039075U (en) * 2016-09-14 2017-03-22 孙逸 Intelligence translation glasses
CN107223277A (en) * 2016-12-16 2017-09-29 深圳前海达闼云端智能科技有限公司 A kind of deaf-mute's householder method, device and electronic equipment
CN106887059A (en) * 2017-01-18 2017-06-23 华南农业大学 A kind of intelligent electronic lock system based on face recognition
CN106683533A (en) * 2017-02-07 2017-05-17 德阳力久云智知识产权运营有限公司 Special communication glasses for deaf-mutes
CN108629241A (en) * 2017-03-23 2018-10-09 华为技术有限公司 A kind of data processing method and data processing equipment
CN106896529A (en) * 2017-03-26 2017-06-27 王金锁 Deaf-mute's synchronous translation glasses
CN107169449A (en) * 2017-05-14 2017-09-15 吉林大学 Chinese sign language interpretation method based on depth transducer
CN107798964A (en) * 2017-11-24 2018-03-13 郑军 The sign language intelligent interaction device and its exchange method of a kind of Real time identification gesture
CN108960158A (en) * 2018-07-09 2018-12-07 珠海格力电器股份有限公司 Intelligent sign language translation system and method
CN109145564A (en) * 2018-08-22 2019-01-04 中国工商银行股份有限公司 Control the method and device of mobile terminal

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
范凯熹主编;胡晓琛副主编: "《信息交互设计》", 青岛:中国海洋大学出版社 *

Similar Documents

Publication Publication Date Title
CN105487673B (en) A kind of man-machine interactive system, method and device
WO2020010979A1 (en) Method and apparatus for training model for recognizing key points of hand, and method and apparatus for recognizing key points of hand
KR101569268B1 (en) Acquisition System and Method of Iris image for iris recognition by using facial component distance
KR102506341B1 (en) Devices, systems and methods of virtualizing a mirror
US8754934B2 (en) Dual-camera face recognition device and method
CN105659200B (en) For showing the method, apparatus and system of graphic user interface
WO2022052475A1 (en) Image capture processing method, apparatus and device, storage medium, and program product
CN101609660A (en) Digital frame, the information processing system control method of unifying
CN108229369A (en) Image capturing method, device, storage medium and electronic equipment
CN105068646B (en) The control method and system of terminal
CN107231529A (en) Image processing method, mobile terminal and storage medium
CN102525400B (en) Intelligent eyesight detecting device with binocular cameras
CN107340875A (en) Keyboard device with built-in sensor and light source module
CN107255813A (en) Distance-finding method, mobile terminal and storage medium based on 3D technology
CN108881544A (en) A kind of method taken pictures and mobile terminal
WO2019062347A1 (en) Facial recognition method and related product
CN108960179A (en) A kind of image processing method and mobile terminal
KR20150085644A (en) Performance Evaluation System and Method for Face Recognition of Service Robot using UHD Moving Image Database
CN109977846A (en) A kind of in-vivo detection method and system based on the camera shooting of near-infrared monocular
KR101344851B1 (en) Device and Method for Processing Image
CN101536896A (en) Iris diagnostic device
CN107255812A (en) Speed-measuring method, mobile terminal and storage medium based on 3D technology
CN106022283A (en) Biometric identification method, biometric identification device and identification equipment
CN206610308U (en) A kind of data processing equipment that face recognition is realized by eyes orientation direction
CN110020442A (en) A kind of portable translating machine

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190716