CN109857262A - A kind of intelligent AC device and intelligent AC apparatus system and communication method - Google Patents
A kind of intelligent AC device and intelligent AC apparatus system and communication method Download PDFInfo
- Publication number
- CN109857262A CN109857262A CN201910200175.XA CN201910200175A CN109857262A CN 109857262 A CN109857262 A CN 109857262A CN 201910200175 A CN201910200175 A CN 201910200175A CN 109857262 A CN109857262 A CN 109857262A
- Authority
- CN
- China
- Prior art keywords
- intelligent
- exchange
- input
- expression
- sign language
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
A kind of intelligent AC device, includes at least: wearable component is inputted with component, the wearable component, the expression for obtaining wearer or exchange side is exchanged；The exchange component is converted to corresponding expression output for inputting the expression.Intelligent AC device in the application, suitable for the exchange auxiliary tool under some special screnes.Such as, when the two people exchange of the country variant of language obstacle, wearable component available language message is expressed by exchange component again after translation, realizes both sides' exchange；For another example, when deaf-mute exchanges with normal person, the sign language information of the wearable available deaf-mute of component is come out by exchange component by voice or literal expression after translation；For another example, wearable component also available lip reading information, translates into voice or text and is expressed by exchange component.Furthermore the present invention also provides a kind of intelligent AC apparatus system and communication methods.
Description
Technical field
The invention belongs to intelligent equipment fields, and in particular to a kind of intelligent AC device, while the application further relates to one kind
Intelligent AC apparatus system and communication method.
Background technique
In daily life and work, interpersonal face-to-face exchange is essential scene, for ordinary people,
Realize face-to-face exchange very normally and conveniently by speech.But it for different language or even some special populations, such as becomes deaf
Personage, vision disorder personage, face-to-face exchange can become difficult.
Such as between the personage that becomes deaf, if both sides understand sign language, can be exchanged by sign language, but become deaf personage with it is general
Between logical people or both sides become deaf in personage has a side to be ignorant of sign language, then exchanging meeting barriers to entry.Further, become deaf personage
Exchanging between blind person is then more difficult, and one can be by sign language presentation but another party is invisible, and one can say but another party
It does not hear, such case leads to the complete partition of exchange.In addition, the exchange between different language is also more troublesome, need by
Mobile phone translation, time-consuming.
Now, with science and technology development, virtual reality technology, gesture motion capturing technology, eyeball motion capture technology,
Speech recognition technology, AI translation technology etc. are more and more mature, and some in these intellectual technologies have been applied to practical work
In life, solve the problems, such as.In the application, attempt by these can only technical application to exchange scene in, especially apply
Into the exchange scene between some special personages, expectation be able to solve it is some at present there is also the problem of.
Summary of the invention
For the above deficiency in the prior art, the present invention provides a kind of intelligent AC devices, pass through virtual reality skill
The auxiliary of the technologies such as art, motion capture, speech recognition, Text region, AI translation, has widened exchange boundary, has solved current spy
Some obstacles in different crowd's communication process, enable information to effective flowing；The present invention also provides a kind of intelligent AC dresses simultaneously
Set system and communication method.
In order to solve the above-mentioned technical problem, the present invention is addressed by following technical proposals.
A kind of intelligent AC device, includes at least: wearable component with exchange component, the wearable component, for obtaining
The expression of wearer or exchange side is taken to input；The exchange component is converted to corresponding expression for inputting the expression
Output.
Intelligent AC device in the application, suitable for the exchange auxiliary tool under some special screnes.Such as, language obstacle
Country variant two people exchange when, wearable component available language message is expressed by exchange component again after translation,
Realize both sides' exchange；For another example, when deaf-mute exchanges with normal person, the sign language information of the wearable available deaf-mute of component is turned over
It is come out by exchange component by voice or literal expression after translating；For another example, wearable component also available lip reading information, is translated into
Voice or text are expressed by exchange component.
Preferably, the intelligent AC device includes: headgear computer, augmented reality glasses or virtual reality eye
Mirror is adapted to a variety of different use environments, and good portability.
Preferably, the wearable component includes one or more of: voice input pickup (e.g., microphone),
Lip type input pickup (e.g., shape of the mouth as one speaks camera), gesture input sensor, text input pickup (e.g., head take aim at or eye movement with
Track device)；The voice input pickup, the voice for obtaining the wearer or exchange side input；The lip type input
Sensor, the lip reading for obtaining the wearer or exchange side input；The gesture input sensor, it is described for obtaining
The sign language of wearer or exchange side inputs；The text input pickup, for obtaining the wearer or exchange side
Text input.
Preferably, the gesture input sensor include: gesture perception one of camera or wisdom gloves or
It is a variety of.Gesture, which perceives camera, can identify corresponding sign language information by the movement of capture human hand；Wisdom gloves are worn over
After on manpower, the sign language movement of hand can be perceived, identifies corresponding sign language information.
Preferably, the text input pickup includes: that head takes aim at control unit, eye-tracking control unit or control
One of handle is a variety of.In the structure, head takes aim at control unit, eye-tracking control unit is used for through headwork, eye
Ball movement carries out text input operation, and corresponding text or information may be selected in control handle.
Preferably, the exchange component includes one or more of: display, LED scrolling display screen, movable dot matrix
Buckplate, loudspeaker, simulation manipulator；The display, for showing sign language picture, sign language image or sign language shadow outward
Picture；The LED scrolling display screen, for showing the text information of flowing outward, or text, letter, expression, mark etc.
Information, when suitable for there is big section text information to need to export, similar to the billboard of character rolling；The activity dot matrix is concave-convex
Plate is shown for braille；The loudspeaker is such as broadcast sign language information " after translation " by voice for playing corresponding voice
It releases；The simulation manipulator is such as showed voice messaging by sign language for making gesture outward.
Preferably, further include: memory module, the memory, for storing exchange database；The exchange data
Library identifies its expression meaning, and the expression meaning is converted to corresponding output order for inputting to the expression.
Preferably, the exchange database includes one or more of: speech database, lip reading database, sign language
Database, lteral data library；Preferably country variant/area speech database, country variant/area lip reading database,
One of country variant/area lteral data library, country variant/area sign language database are a variety of, are adapted to more
In the special exchange scene of kind.
Preferably, the intelligent AC device further comprises: CPU, GPU, MEM, HDD, I/O equipment and communication core
Piece.CPU is equivalent to the brain of computer, is planned as a whole, operation；GPU is connected with each camera is equivalent to the eyes of computer, into
Identification of the row to three-dimensional world；MEM is the semiconductor devices that aiding CPU is calculated；HDD is equivalent to the memory of computer, uses
Make store function；I/O equipment and communication chip are used for Wireless/wired communication；Communication chip is for realizing between equipment, network
Connection.
A kind of intelligent AC apparatus system, comprising: the network equipment and intelligent AC device；The intelligent AC device is used
The network equipment is transferred in inputting the expression；The network equipment, for pair after converting the expression input
The output order answered feeds back to the intelligent AC device.
Preferably, the network equipment, for storing exchange database, the exchange database include it is following a kind of or
It is a variety of: speech database, lip reading database, braille database, lteral data library, sign language database.Preferably country variant/ground
The speech database in area, country variant/area lip reading database, country variant/area lteral data library, country variant/
One of the sign language database in area is a variety of, is adapted in a variety of special exchange scenes.
Preferably, the intelligent AC device includes exchange component, the exchange component is used for will be corresponding described defeated
It instructs out, is converted to corresponding expression output.
Preferably, further include intelligent AC robot, the intelligent AC robot, for obtaining any exchange side
Expression input is passed to the network equipment, and obtains the corresponding output of network equipment feedback by expression input
Instruction, and be converted to corresponding expression output.
Preferably, further include intelligent AC robot, the intelligent AC robot, for obtaining intelligent AC device
The corresponding output order of transmitting, and be converted to corresponding expression output.
Preferably, the intelligent AC robot include: unmanned flight robot or unmanned walking robot or
Unmanned boat form robot；Suitable for a variety of different scenes.
Preferably, the intelligent AC robot includes one or more of: display, is lived at LED scrolling display screen
Dynamic dot matrix buckplate, loudspeaker or simulation manipulator；The display is used positioned at the head of the intelligent AC robot
In display sign language picture, sign language image or sign language video outward；The LED scrolling display screen, is located at the intelligent AC machine
The head of device people, for showing the text information of flowing outward；The activity dot matrix buckplate, is located at the intelligent AC machine
The head of people, for showing braille information outward；The loudspeaker is located at the intelligent AC robot, for playing correspondence
Voice；The simulation manipulator, positioned at the body portion of the intelligent AC robot, for making gesture outward
A kind of communication method by intelligent AC device, includes the following steps: S100: obtaining the wearer or friendship
The expression of stream side inputs；S500: expression input is converted to corresponding expression and is exported.
Preferably, the S100 further comprises following either step: S110: obtaining institute by voice input pickup
State the voice input of wearer or exchange side；S120: the wearer or exchange side are obtained by lip type input pickup
Lip reading input；S130: it is inputted by the sign language that gesture input sensor obtains the wearer or exchange side；S140: logical
Cross the text input that text loader obtains the wearer or exchange side.
Preferably, including: S200 between S100 the and S500 step: the expression is inputted, identifies its expression meaning,
And the expression meaning is converted into corresponding output order.
Preferably, including: S300 between S100 the and S500 step: expression input is transmitted to the network equipment,
The network equipment identifies its expression meaning, and the expression meaning is converted to corresponding output order, is then transmitted to again
The intelligent AC device.
Preferably, including: S400 between S100 the and S500 step: the intelligent AC device is by the output order
It is converted to corresponding expression output.The forms such as the way of output can show for text picture on screen, voice, sign language, braille.
Preferably, the expression output of the S500 further comprises following either step: S510: passing through loudspeaker
Carry out voice output；S520: lip reading output is carried out by display；S530: sign language is carried out by display or simulation manipulator
Output；S540: text output is carried out by display or LED scrolling display screen；S550: it is carried out by movable dot matrix buckplate blind
Text output.
Compared with prior art, the invention has the following advantages: the present invention provides a kind of intelligent AC device, lead to
The auxiliary for crossing the technologies such as virtual reality technology, motion capture, speech recognition, Text region, AI translation, has widened exchange boundary,
It solves some obstacles in current special population communication process, enables information to effective flowing；The present invention also provides one simultaneously
Kind intelligent AC apparatus system and communication method, degree of intelligence is high, and application scenarios are more.
Detailed description of the invention
Fig. 1 wears the perspective view of ac equipment for the virtual reality in the present invention.
Fig. 2 wears the perspective view of ac equipment for another virtual reality in the present invention.
Fig. 3 is to wear the schematic diagram of a scenario one that ac equipment is exchanged using virtual reality.
Fig. 4 is to wear the schematic diagram of a scenario two that ac equipment is exchanged using virtual reality.
Fig. 5 is to wear the schematic diagram of a scenario three that ac equipment is exchanged using virtual reality.
Fig. 6 wears the perspective view of ac equipment for the augmented reality in the present invention.
Fig. 7 is to wear the schematic diagram of a scenario that ac equipment is exchanged using augmented reality.
Fig. 8 is the perspective view for wearing ac equipment in the present invention.
Fig. 9 is the perspective view for wearing ac equipment in the another embodiment in the present invention.
Figure 10 is to use to wear the schematic diagram of a scenario that ac equipment is exchanged.
Figure 11 is to wear the schematic diagram of a scenario that ac equipment is exchanged using another kind.
Figure 12 is the perspective view of the intelligent AC robot of the sufficient formula in the present invention.
Figure 13 is the perspective view of the caterpillar intelligent AC robot in the present invention.
Figure 14 is the perspective view of the intelligent AC robot of the boat form in the present invention.
Figure 15 is the perspective view of the intelligent AC robot of the unmanned plane formula in the present invention.
Specific embodiment
Present invention is further described in detail with specific embodiment with reference to the accompanying drawing.
In following implementation, same or similar label indicates same or similar original part or has identical from beginning to end
Or the original part of similar functions, it is exemplary below by way of the embodiment being described with reference to the drawings, for explaining only the invention, and
It is not considered as limiting the invention.
In the description that the present invention retouches, it is to be understood that term: center, longitudinally, laterally, length, width, thickness, it is upper,
Under, front, rear, left and right, vertical, level, top, bottom, the indicating positions such as inside and outside, clockwise, counterclockwise or positional relationship for based on
Orientation or positional relationship shown in the drawings, is merely for convenience of description of the present invention and simplification of the description, therefore should not be understood as to this
The limitation of invention.In addition, term: first, second etc. is used for description purposes only, and is not understood to indicate or imply relatively important
Property or the quantity for implicitly indicating shown technical characteristic.In description of the invention unless specifically defined or limited otherwise, term:
Installation, connected, connection etc. shall be understood in a broad sense, and those skilled in the art can understand above-mentioned term as the case may be
Concrete meaning in this practicability.
Referring to figs. 1 to Fig. 5, a kind of intelligent AC device involved in the application is included at least: wearable component with exchange
Component, the wearable component, the expression for obtaining wearer or exchange side input；The exchange component is used for institute
Expression input is stated, corresponding expression output is converted to.Specifically, the intelligent AC device includes: to wear in preferred scheme
Computer, augmented reality glasses or virtual reality glasses are adapted to a variety of different use environments, and good portability.Institute
Stating wearable component includes one or more of: voice input pickup (e.g., microphone), lip type input pickup (e.g., mouth
Type camera), gesture input sensor, text input pickup (e.g., head take aim at or eye-tracking device)；The voice input passes
Sensor, the voice for obtaining the wearer or exchange side input；The lip type input pickup, for obtaining described wear
The input of the lip reading of wearer or exchange side；The gesture input sensor, for obtaining the hand of the wearer or exchange side
Language input；The text input pickup, the text for obtaining the wearer or exchange side input.
In the above structure, the gesture input sensor includes: gesture perception one of camera or wisdom gloves
Or it is a variety of.The text input pickup include: head take aim at control unit, eye-tracking control unit or control handle in one
Kind is a variety of.Preferably, the exchange component includes one or more of: display, LED scrolling display screen, moving point
Battle array buckplate, loudspeaker, simulation manipulator；The display, for showing sign language picture, sign language image or sign language shadow outward
Picture；The LED scrolling display screen, for showing the text information of flowing outward, or text, letter, expression, mark etc.
Information, when suitable for there is big section text information to need to export, similar to the billboard of character rolling；The activity dot matrix is concave-convex
Plate is shown for braille；The loudspeaker is such as broadcast sign language information " after translation " by voice for playing corresponding voice
It releases；The simulation manipulator is such as showed voice messaging by sign language for making gesture outward.
In addition, the intelligent AC device in the application further include: memory module, the memory, for storing exchange number
According to library；The exchange database identifies its expression meaning, and the expression meaning is converted to for inputting to the expression
Corresponding output order.In preferred scheme, the exchange database includes one or more of: speech database, lip reading
Database, sign language database, lteral data library；It can be preferably country variant/area speech database, country variant/ground
One of the lip reading database in area, country variant/area lteral data library, country variant/area sign language database or
It is a variety of, it is adapted in a variety of special exchange scenes.
In addition, the intelligent AC device in the application further comprises: CPU, GPU, MEM, HDD, I/O equipment and communication core
Piece.CPU is equivalent to the brain of computer, is planned as a whole, operation；GPU is connected with each camera is equivalent to the eyes of computer, into
Identification of the row to three-dimensional world；MEM is the semiconductor devices that aiding CPU is calculated；HDD is equivalent to the memory of computer, uses
Make store function；I/O equipment and communication chip are used for Wireless/wired communication；Communication chip is for realizing between equipment, network
Connection.
A kind of intelligent AC apparatus system, comprising: the network equipment and intelligent AC device；The intelligent AC device is used
The network equipment is transferred in inputting the expression；The network equipment, for pair after converting the expression input
The output order answered feeds back to the intelligent AC device.
Preferably, the network equipment, for storing exchange database, the exchange database include it is following a kind of or
It is a variety of: speech database, lip reading database, braille database, lteral data library, sign language database.Preferably country variant/ground
The speech database in area, country variant/area lip reading database, country variant/area lteral data library, country variant/
One of the sign language database in area is a variety of, is adapted in a variety of special exchange scenes.
Preferably, the intelligent AC device includes exchange component, the exchange component is used for will be corresponding described defeated
It instructs out, is converted to corresponding expression output.
Preferably, further include intelligent AC robot, the intelligent AC robot, for obtaining any exchange side
Expression input is passed to the network equipment, and obtains the corresponding output of network equipment feedback by expression input
Instruction, and be converted to corresponding expression output.
Preferably, further include intelligent AC robot, the intelligent AC robot, for obtaining intelligent AC device
The corresponding output order of transmitting, and be converted to corresponding expression output.
Preferably, the intelligent AC robot include: unmanned flight robot or unmanned walking robot or
Unmanned boat form robot；Suitable for a variety of different scenes.
Preferably, the intelligent AC robot includes one or more of: display, is lived at LED scrolling display screen
Dynamic dot matrix buckplate, loudspeaker or simulation manipulator；The display is used positioned at the head of the intelligent AC robot
In display sign language picture, sign language image or sign language video outward；The LED scrolling display screen, is located at the intelligent AC machine
The head of device people, for showing the text information of flowing outward；The activity dot matrix buckplate, is located at the intelligent AC machine
The head of people, for showing braille information outward；The loudspeaker is located at the intelligent AC robot, for playing correspondence
Voice；The simulation manipulator, positioned at the body portion of the intelligent AC robot, for making gesture outward.
A kind of communication method by intelligent AC device involved in the present invention includes the following steps: S100: obtaining institute
State the expression input of wearer or exchange side；S500: expression input is converted to corresponding expression and is exported.
In preferred scheme, the S100 further comprises following either step: S110: being obtained by voice input pickup
The voice of the wearer or exchange side is taken to input；S120: the wearer or friendship are obtained by lip type input pickup
The lip reading of stream side inputs；S130: it is inputted by the sign language that gesture input sensor obtains the wearer or exchange side；
S140: it is inputted by the text that text loader obtains the wearer or exchange side.
Include: S200 between S100 the and S500 step in preferred scheme: the expression being inputted, identifies its expression
The meaning, and the expression meaning is converted into corresponding output order.
Include: S300 between S100 the and S500 step in preferred scheme: expression input being transmitted to network and is set
Standby, the network equipment identifies its expression meaning, and the expression meaning is converted to corresponding output order, then transmits again
To the intelligent AC device.
Include: S400 between S100 the and S500 step in preferred scheme: the intelligent AC device is by the output
It is instruction morphing to be exported at corresponding expression.The shapes such as the way of output can show for text picture on screen, voice, sign language, braille
Formula.
In preferred scheme, the expression output of the S500 further comprises following either step: S510: by raising
Sound device carries out voice output；S520: lip reading output is carried out by display；S530: it is carried out by display or simulation manipulator
Sign language output；S540: text output is carried out by display or LED scrolling display screen；S550: by movable dot matrix buckplate into
The output of row braille.
It elaborates below in conjunction with specific embodiment to the application.
Embodiment one
1~attached drawing of attached drawing 2 can be referred to, it includes virtual reality glasses main body that virtual reality, which wears ac equipment, this is virtual
Reality glasses main body includes restraining 11 and virtual reality glasses main body display 13, further includes: speech input device is (such as: wheat
Gram wind 15), lip type input unit (such as: camera 16), gesture input device (such as: gesture camera 14), input device
One of or it is a variety of, these modules are integrated in lens bodies 13, wherein microphone 15 can be built-in structure, can also be with
It is set to human face's attachment by connector, for conventional mounting means, camera 16 is mounted on virtual reality glasses main body and shows
The two sides upper end of device 13, gesture camera 14 are mounted on the side of virtual reality glasses main body display 13.
When ordinary people exchanges with the people that becomes deaf, the people that becomes deaf takes virtual reality and wears ac equipment, and the people that becomes deaf talks, sign language
Posture recorded and reached processing center and analyzed by gesture camera 14, processing center is by the sign language gesture of record and storage
Sign language database in a device is compared, and parses the meaning of the sign language, and the meaning is shown in the form of text
It on export-oriented display 12, is checked for other side, while microphone 15 collects the voice messaging of other side, which is changed into text
Word is shown in virtual reality and wears on the inner display of ac equipment, and for becoming deaf, personnel are checked, can based on above process
To carry out exchanging between ordinary people and the people that becomes deaf.Meanwhile microphone 15 can also collect the acoustic information in ambient enviroment, it will
The voice messaging is changed into text, is shown in the inner display (virtual reality display device) that virtual reality wears ac equipment
On, for becoming deaf, personnel are checked；Camera 16 can also shoot external image real-time display on inner display.
Embodiment two
Can be with reference to attached drawing 3 or attached drawing 4 or attached drawing 5, when ordinary people exchanges with blind person, blind person takes virtual reality and wears friendship
Device is flowed, blind person speaks, and other side can hear that other side speaks, and blind person can also hear.When ordinary people shows written material to blind person
When, camera 16 takes the written material, is converted into voice, plays to blind person by earphone 17 and listens.In addition, blind person exists
When going out alone, when encountering road sign, trade name, notice bulletin, enough the written material can be taken by camera 16, be converted into
Voice plays to blind person by earphone 7 and listens.
Embodiment three
Can with reference to Fig. 3 or attached drawing 4 or attached drawing 5, blind person and become deaf personnel transfer when, both sides take virtual reality and wear
Ac equipment, the people that becomes deaf talk, and the posture of sign language, which is recorded by gesture camera 14 and reached processing center, to be analyzed, and handle
The sign language gesture of record is compared with the sign language database of storage in a device at center, parses the meaning of the sign language, and
The meaning is shown in the form of text on export-oriented display 12, the virtual reality of blind person wears the camera on ac equipment
16 take the written material, are converted into voice, play to blind person by earphone 17 and listen.
Example IV
Can with reference to Fig. 3 or attached drawing 4 or attached drawing 5, blind person and become deaf personnel transfer when, both sides take virtual reality and wear
Ac equipment, the people that becomes deaf talk, and the posture of sign language, which is recorded by gesture camera 14 and reached processing center, to be analyzed, and handle
The sign language gesture of record is compared with the sign language database of storage in a device at center, parses the meaning of the sign language, and
The form of the meaning voice is directly played back and (passes through outside speaker), is listened for blind person.
Embodiment five
Can be with reference to Fig. 3 or attached drawing 4 or attached drawing 5, when blind person exchanges with blind person, blind person takes virtual reality and wears exchange
Device, blind person speak, and other side can hear, can exchange.When needing to show written material each other, camera 16 is shot
To the written material, it is converted into voice, blind person is played to by earphone 7 and is listened.
Embodiment six
When ordinary people exchanges with the people that becomes deaf, the people that becomes deaf takes virtual reality and wears ac equipment, and the people that becomes deaf talks, sign language
Posture recorded and reached processing center and analyzed by gesture camera 14, processing center is by the sign language gesture of record and storage
Sign language database in a device is compared, and parses the meaning of the sign language, and the meaning is shown in the form of text
On export-oriented display 12, checked for other side.Camera 16 shoots lip posture of other side when speaking simultaneously, and by the lip posture
It is analyzed with processing center is reached, processing center carries out the lip reading database of the lip posture of record and storage in a device
It compares, parses the meaning of the lip reading, and the meaning is shown in the form of text and is worn in ac equipment in virtual reality
On portion's display screen (virtual reality display device), for becoming deaf, personnel are checked.
Embodiment seven
Fig. 5 can be referred to take virtual reality when two ordinary peoples of different language exchange and wear ac equipment, Mike
Wind 15 collects the voice messaging of other side, by being converted into known language after translation, plays in earphone 17, both sides may be implemented
Real time translation exchange.
In above embodiments, the mirror holder that virtual reality therein wears ac equipment is equipped with battery module, for powering,
It is additionally provided with processing center simultaneously, for carrying out information processing, while can according to need a certain number of button/touches of setting
Key, for realizing such as volume adjustment, switching on and shutting down operation.Virtual reality wear ac equipment by bluetooth, wifi, GSM, 4G,
The prior arts such as 5G and extraneous holding communicate to connect.In addition, data content can store in lens body in above embodiments
Memory in, also can store on the server, connected by network implementations.Angle a in attached drawing 4-6 is gesture camera
14 can catching range, be just that people's both hands do the region acted.
Embodiment eight
Attached drawing 6 or attached drawing 7 can be referred to, it includes strong Reality glasses main body, the strong reality that augmented reality, which wears ac equipment,
Lens body includes spectacle frame 21 and spectacle lens 22, further includes: speech input device (such as: microphone 15), lip type input unit
One of (such as: camera 16), gesture input device (such as: gesture camera 14), input device are a variety of, wherein
Microphone 15 is set to human face's attachment by connector, and for conventional mounting means, camera 16 is mounted in spectacle lens 22
It holds in the heart, gesture camera 14 is mounted on the side of augmented reality lens body.
When ordinary people exchanges with the people that becomes deaf, the people that becomes deaf takes augmented reality and wears ac equipment, and the people that becomes deaf talks, sign language
Posture recorded and reached processing center and analyzed by gesture camera 14, processing center is by the sign language gesture of record and storage
Sign language database in a device is compared, and parses the meaning of the sign language, and the meaning is shown in the form of text
It on export-oriented display 27, is checked for other side, while microphone 15 collects the voice messaging of other side, which is changed into text
Word is shown in augmented reality and wears on the spectacle lens 22 (augmented reality display device) of ac equipment, and for becoming deaf, personnel are checked, base
In above process, exchanging between ordinary people and the people that becomes deaf can be carried out.Meanwhile microphone 15 can also collect ambient enviroment
In acoustic information, which is changed into text, be shown in augmented reality wear ac equipment spectacle lens 22 (enhancing
Reality display device) on, for becoming deaf, personnel are checked.
Embodiment nine
Fig. 8~11 can be referred to, wearing ac equipment includes headgear computer main body 31, the headgear computer main body 31
Including speech input device (such as: microphone 15), lip type input unit (such as: camera 16), the gesture input dress being provided thereon
Set (such as: gesture camera 14), one of input device or a variety of, wherein microphone 15 is set to people by connector
Facial attachment, is conventional mounting means, and camera 16 and gesture camera 14 are mounted on the two sides of headgear computer main body 31；
In addition, being additionally provided with earphone 17 in headgear computer main body 31.In headgear computer main body 31 in another embodiment,
On further include export-oriented display 32.
When ordinary people exchanges with mute, mute, which takes, wears ac equipment, and mute talks, and the posture of sign language is taken the photograph by gesture
It records and reaches processing center and analyzed as first 14, sign language of the processing center by the sign language gesture of record and storage in a device
Database is compared, and parses the meaning of the sign language, and the meaning is played back with voice, listens to for other side, based on
On process, exchanging between ordinary people and mute can be carried out.
Embodiment ten
Fig. 8~11 can be referred to, when ordinary people exchanges with blind person, blind person, which takes, wears ac equipment, and blind person speaks, other side
It can hear, other side speaks, and blind person can also hear.When ordinary people shows written material to blind person, camera 16 takes this
Written material is converted into voice, plays to blind person by earphone 17 and listens.In addition, blind person when going out alone, encounters road
When mark, trade name, notice bulletin, the written material can be taken by camera 16, be converted into voice, played by earphone 17
It is listened to blind person.
Embodiment 11
Fig. 8~11 can be referred to, when ordinary people exchanges with mute, mute, which takes, wears ac equipment, and mute talks, hand
The posture of language is recorded and reached processing center and analyzed by gesture camera 14, processing center by the sign language gesture of record with deposit
The sign language database of storage in a device is compared, and parses the meaning of the sign language, and the meaning is passed through outside with written form
It shows to display 2, is checked for other side, based on above process, exchanging between ordinary people and mute can be carried out.
Embodiment 12
Can refer to Fig. 8~11, ordinary people and become deaf personnel transfer when, ordinary people, which takes, wears ac equipment, and become deaf people
Member talks, and the posture of sign language, which is recorded by camera 16 and reached processing center, to be analyzed, and processing center is by the sign language of record
Gesture is compared with the sign language database of storage in a device, parses the meaning of the sign language, and the meaning is broadcast with voice
It releases and (earphone can also be passed through), listened to for ordinary people, then ordinary people speaks, 15 recording voice message of microphone, and will
The voice messaging passes through export-oriented display 32 with written form and shows that personnel check for becoming deaf, can based on above process
To carry out ordinary people and interactions among persons of becoming deaf.
Embodiment 13
Attached drawing 12 can be referred to, intelligent AC robot includes head 41, body portion 42, foot 43, and head 41 is equipped with letter
Cease input part, comprising: speech input device (such as: microphone), lip type input unit (such as: camera 16), gesture input dress
Set (such as: gesture camera 14), one of input device or a variety of, wherein microphone is conventional microphone, camera shooting
First 16 are mounted on the center upper end on head 41, and gesture camera 14 is mounted on the side on head 41.Robot and different language
When ordinary people exchanges, the microphone in robot collects the voice messaging of other side, identifies after being translated by processing center therein
Voice carries out corresponding operation, and when needing speech exchange, voice is expressed by the language that ordinary people can understand, can
To realize the real time translation exchange of both sides.When robot is exchanged with blind person, blind person speaks, and robot can hear that robot is said
Words, blind person can also hear.When blind person shows written material to robot, camera 16 takes the written material, and identifies
The meaning of text therein plays to blind person by loudspeaker and listens.Robot and become deaf personnel transfer when, the people that becomes deaf talks, hand
The posture of language is recorded and reached processing center and analyzed by gesture camera 14, processing center by the sign language gesture of record with deposit
The sign language database of storage in a device is compared, and parses the meaning of the sign language, then the information exchanged will be needed to show
On display 45, for becoming deaf, personnel are checked.Simulation manipulator 47, for imitating operation by human hand.
Embodiment 14
With reference to Figure 13, the robot in the embodiment includes head 41, body portion 42, caterpillar drive 431, on head 41
Equipped with information input part and display screen, the robot is mobile by caterpillar drive 431, is adapted to the road of out-of-flatness
Face, stability are high.Exchange way is identical as embodiment 16.
Embodiment 15
With reference to Figure 14, the robot in the embodiment includes head 41, body portion 42, boat form driving device 432, on head 41
Equipped with information input part and display screen, which can move by the propeller in boat form driving device 432 in waters
It is dynamic, it is adapted to river surface, the use demand on lake surface etc..Exchange way is identical as embodiment 16.
Embodiment 16
With reference to Figure 15, the robot in the embodiment has the function of flight (unmanned plane structure), including main body 533, the master
Body 533 is equipped with propeller 531, and for flying, the lower part of the main body 533 is connected with head 51, and it is defeated that head 51 is equipped with information
Enter component and display screen, the lower part of the main body 533 is also connected with simulation manipulator 47, for imitating operation by human hand.The robot
Unmanned plane structure can fly in the sky, be adapted to aerial use demand, and exchange way is identical as embodiment 16.
In above embodiments, it is equipped with battery module in intelligent AC robot therein, for powering, while being additionally provided with place
Reason center for carrying out information processing, while can according to need a certain number of button/membrane keyboards of setting, for realizing such as
The operations such as volume adjustment, function selection.Intelligent AC robot passes through the prior arts such as bluetooth, wifi, GSM, 4G, 5G and the external world
Keep communication connection.It, can also be in addition, data content can store in the memory in lens body in above embodiments
Storage on the server, is connected by network implementations.The foot of intelligent AC machine in the application for realizing locomotive function,
Or unmanned flight robot, unmanned water sailing may be implemented according to different usage scenarios in the foot of other forms
Robot or unmanned walking robot etc..
Intelligent AC robot (and system), with normal person's (languages translation scheme), physical disabilities (sign language interpreter side of becoming deaf
Case), the physical disabilities that cry out (labiomaney translation scheme) or blindness physical disabilities (voiced translation scheme) exchange, be all exchange
Beneficial to intermediary.
Virtual reality involved in embodiment of above wears ac equipment packet, augmented reality wears ac equipment, wears
Ac equipment, intelligent AC robot etc. are for the intelligent AC device in application.
The above, the present invention provides a kind of intelligent AC devices, pass through virtual reality technology, motion capture, voice
The auxiliary of the technologies such as identification, Text region, AI translation, has widened exchange boundary, has solved in current special population communication process
Some obstacles, enable information to effective flowing；Simultaneously the present invention also provides a kind of intelligent AC apparatus system and communication method,
Degree of intelligence is high, and various informative, application scenarios are more.
Protection scope of the present invention includes but is not limited to embodiment of above, and protection scope of the present invention is with claims
Subject to, replacement, deformation, the improvement that those skilled in the art that any pair of this technology is made is readily apparent that each fall within of the invention
Protection scope.
Claims (10)
1. a kind of intelligent AC device, which is characterized in that include at least: wearable component with exchange component, the wearable portion
Part, the expression for obtaining wearer or exchange side input；The exchange component is converted to for inputting the expression
Corresponding expression output.
2. a kind of intelligent AC device as described in claim 1, which is characterized in that the intelligent AC device includes: to wear
Computer, augmented reality glasses or virtual reality glasses.
3. a kind of intelligent AC device as described in claim 1, which is characterized in that the wearable component includes following one kind
Or it is a variety of: voice input pickup, lip type input pickup, gesture input sensor, text input pickup,
The voice input pickup, the voice for obtaining the wearer or exchange side input；
The lip type input pickup, the lip reading for obtaining the wearer or exchange side input；
The gesture input sensor, the sign language for obtaining the wearer or exchange side input；
The text input pickup, the text for obtaining the wearer or exchange side input.
4. a kind of intelligent AC device as described in claim 1, which is characterized in that the exchange component include following one kind or
It is a variety of: display, LED scrolling display screen, movable dot matrix buckplate, loudspeaker, simulation manipulator；
The display, for showing sign language picture, sign language image or sign language video outward；
The LED scrolling display screen, for showing the text information of flowing outward；
The activity dot matrix buckplate, shows for braille；
The loudspeaker, for playing corresponding voice；
The simulation manipulator, for making gesture outward.
5. a kind of intelligent AC apparatus system characterized by comprising the network equipment and intelligent AC device；
The intelligent AC device, for expression input to be transferred to the network equipment；
The network equipment is filled for the corresponding output order after the expression input conversion to be fed back to the intelligent AC
It sets.
6. a kind of intelligent AC apparatus system as claimed in claim 5, which is characterized in that the network equipment, for storing
Exchange database, the exchange database includes one or more of: speech database, lip reading database, braille database,
Lteral data library, sign language database.
7. a kind of intelligent AC apparatus system as claimed in claim 5, which is characterized in that the intelligent AC device includes handing over
Stream unit, the exchange component are used to the corresponding output order being converted to corresponding expression output.
8. a kind of intelligent AC apparatus system as claimed in claim 5, which is characterized in that it further include intelligent AC robot,
The intelligent AC robot, the expression for obtaining any exchange side input, and expression input is passed to the network
Equipment, and the corresponding output order of network equipment feedback is obtained, and be converted to corresponding expression output.
9. a kind of communication method by intelligent AC device, which comprises the steps of:
S100: the expression input of the wearer or exchange side is obtained；
S500: expression input is converted to corresponding expression and is exported.
10. a kind of communication method by intelligent AC device as claimed in claim 9, which is characterized in that the S100 into
One step includes following either step:
S110: it is inputted by the voice that voice input pickup obtains the wearer or exchange side；
S120: it is inputted by the lip reading that lip type input pickup obtains the wearer or exchange side；
S130: it is inputted by the sign language that gesture input sensor obtains the wearer or exchange side；
S140: it is inputted by the text that text loader obtains the wearer or exchange side.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910200175.XA CN109857262A (en) | 2019-03-16 | 2019-03-16 | A kind of intelligent AC device and intelligent AC apparatus system and communication method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910200175.XA CN109857262A (en) | 2019-03-16 | 2019-03-16 | A kind of intelligent AC device and intelligent AC apparatus system and communication method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109857262A true CN109857262A (en) | 2019-06-07 |
Family
ID=66901037
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910200175.XA Pending CN109857262A (en) | 2019-03-16 | 2019-03-16 | A kind of intelligent AC device and intelligent AC apparatus system and communication method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109857262A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110717344A (en) * | 2019-10-12 | 2020-01-21 | 深圳市热丽泰和生命科技有限公司 | Auxiliary communication system based on intelligent wearable equipment |
| CN110840652A (en) * | 2019-11-11 | 2020-02-28 | 北京海益同展信息科技有限公司 | Wearable device, information processing method and device |
| CN111292723A (en) * | 2020-02-07 | 2020-06-16 | 普强时代(珠海横琴)信息技术有限公司 | Voice recognition system |
| CN111562815A (en) * | 2020-05-04 | 2020-08-21 | 北京花兰德科技咨询服务有限公司 | Wireless head-mounted device and language translation system |
| CN112908334A (en) * | 2021-01-31 | 2021-06-04 | 云知声智能科技股份有限公司 | Hearing aid method, device and equipment based on directional pickup |
| CN113327489A (en) * | 2021-06-03 | 2021-08-31 | 西安工业大学 | Layered mechanical intelligent braille reader based on machine vision |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104464719A (en) * | 2014-12-16 | 2015-03-25 | 上海市共进通信技术有限公司 | System for achieving intelligent communication of deaf and mute person |
| CN106683533A (en) * | 2017-02-07 | 2017-05-17 | 德阳力久云智知识产权运营有限公司 | Special communication glasses for deaf-mutes |
| CN206210144U (en) * | 2016-05-03 | 2017-05-31 | 北京儿童创客教育科技有限公司 | Gesture language-voice converts cap |
| CN108877410A (en) * | 2018-08-07 | 2018-11-23 | 深圳市漫牛医疗有限公司 | A kind of deaf-mute's sign language exchange method and deaf-mute's sign language interactive device |
-
2019
- 2019-03-16 CN CN201910200175.XA patent/CN109857262A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104464719A (en) * | 2014-12-16 | 2015-03-25 | 上海市共进通信技术有限公司 | System for achieving intelligent communication of deaf and mute person |
| CN206210144U (en) * | 2016-05-03 | 2017-05-31 | 北京儿童创客教育科技有限公司 | Gesture language-voice converts cap |
| CN106683533A (en) * | 2017-02-07 | 2017-05-17 | 德阳力久云智知识产权运营有限公司 | Special communication glasses for deaf-mutes |
| CN108877410A (en) * | 2018-08-07 | 2018-11-23 | 深圳市漫牛医疗有限公司 | A kind of deaf-mute's sign language exchange method and deaf-mute's sign language interactive device |
Non-Patent Citations (2)
| Title |
|---|
| 刘和平: "《探索与实践》", 30 September 2018 * |
| 比尔工作室: "《新科技启蒙》", 31 October 1999, 中国劳动社会保障出版社 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110717344A (en) * | 2019-10-12 | 2020-01-21 | 深圳市热丽泰和生命科技有限公司 | Auxiliary communication system based on intelligent wearable equipment |
| CN110840652A (en) * | 2019-11-11 | 2020-02-28 | 北京海益同展信息科技有限公司 | Wearable device, information processing method and device |
| CN111292723A (en) * | 2020-02-07 | 2020-06-16 | 普强时代(珠海横琴)信息技术有限公司 | Voice recognition system |
| CN111562815A (en) * | 2020-05-04 | 2020-08-21 | 北京花兰德科技咨询服务有限公司 | Wireless head-mounted device and language translation system |
| CN111562815B (en) * | 2020-05-04 | 2021-07-13 | 北京花兰德科技咨询服务有限公司 | Wireless head-mounted device and language translation system |
| CN112908334A (en) * | 2021-01-31 | 2021-06-04 | 云知声智能科技股份有限公司 | Hearing aid method, device and equipment based on directional pickup |
| CN113327489A (en) * | 2021-06-03 | 2021-08-31 | 西安工业大学 | Layered mechanical intelligent braille reader based on machine vision |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109857262A (en) | A kind of intelligent AC device and intelligent AC apparatus system and communication method | |
| US10645338B2 (en) | Virtual encounters | |
| US6774869B2 (en) | Teleportal face-to-face system | |
| TW200526041A (en) | Method and system for display of facial features on nonplanar surfaces | |
| CN106217393B (en) | Mobile interaction platform of distally coming personally | |
| JP2020530971A (en) | Head-mounted display and its display screen, head-mounted bracket and video | |
| CN206178272U (en) | External multi -lingual smart machine of glasses | |
| CN108108026A (en) | A kind of VR virtual realities motion capture system and motion capture method | |
| WO2019237427A1 (en) | Method, apparatus and system for assisting hearing-impaired people, and augmented reality glasses | |
| CN105653020A (en) | Time traveling method and apparatus and glasses or helmet using same | |
| CN106527678B (en) | A kind of social interactive device, system and the head-mounted display apparatus of mixed reality | |
| WO2021242686A1 (en) | Eyewear including diarization | |
| JPH08205197A (en) | Human interface device | |
| CN113303791A (en) | Online self-service physical examination system for motor vehicle driver, mobile terminal and storage medium | |
| US10536666B1 (en) | Systems and methods for transmitting aggregated video data | |
| CN210109744U (en) | Head-mounted alternating current device and head-mounted alternating current system | |
| CN110717344A (en) | Auxiliary communication system based on intelligent wearable equipment | |
| JP6969577B2 (en) | Information processing equipment, information processing methods, and programs | |
| CN210166754U (en) | Virtual reality wears exchange device and virtual reality wears exchange system | |
| US10983591B1 (en) | Eye rank | |
| CN111881807A (en) | VR conference control system and method based on face modeling and expression tracking | |
| CN210606227U (en) | Augmented reality wears exchange device and augmented reality wears exchange system | |
| CN205563455U (en) | Complete immersive virtual environment device | |
| CN114267070A (en) | VR glasses capable of capturing human body actions and expressions and capturing method thereof | |
| CN107783286A (en) | New ideas AR glasses |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190607 |