CN106789593A - A kind of instant message processing method for merging sign language, server and system - Google Patents
A kind of instant message processing method for merging sign language, server and system Download PDFInfo
- Publication number
- CN106789593A CN106789593A CN201710025174.7A CN201710025174A CN106789593A CN 106789593 A CN106789593 A CN 106789593A CN 201710025174 A CN201710025174 A CN 201710025174A CN 106789593 A CN106789593 A CN 106789593A
- Authority
- CN
- China
- Prior art keywords
- client
- instant message
- sign language
- message
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/56—Unified messaging, e.g. interactions between e-mail, instant messaging or converged IP messaging [CPM]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
- H04L51/10—Multimedia information
Abstract
Instant message processing method, server and system the invention discloses fusion sign language, it is wherein low in the efficiency for the treatment of instant message between ordinary people and deaf-mute in order to solve the problems, such as, the method includes receiving the user login information comprising User Identity information that all clients transmission comes, and the user identity of client is recognized according to User Identity information；According to the user identity of client, by client and the instant message type matching that can be received；Receive and send the instant message that client transmission comes, further according to the user identity for receiving client, instant message is conveyed directly to receive client or reception client is resent to after instant message is converted into the instant message type that correspondingly received client can be received.The method increase the efficiency in treatment instant message between ordinary people and deaf-mute.
Description
Technical field
The invention belongs to data processing method field, more particularly to a kind of instant message processing method for merging sign language, clothes
Business device and system.
Background technology
Instant message (Instant Messaging, IM), also known as instant messaging, refer to can online when the work that exchanges in fact
Tool, that is, usually said online chatting instrument.For broad sense, instant message includes Internet chatroom, Web conference system
System etc. and all online communications；For narrow sense, instant message refers to by the communication under one group of IM server controls.Immediately disappear
Breath function includes word message chat, file transmission, winks, splashette vibration and voice communication, video communication etc..Immediately disappear
Breath, is a kind of IP technical communication softwares of utilization internet also known as instant messaging, has become a kind of the online logical of open intercommunication
Letter instrument.
But current instant message processing system is directed to the chat tool between ordinary people, can not realize common
Exchanging between people and deaf-mute and deaf-mute and deaf-mute.At present, ordinary people and deaf-mute and deaf-mute and deaf-mute
Between exchange be also only limitted to it is aspectant talked, their limitations to space cause strange land exchange, communication cannot experience
To these equipment belts come facility.
The content of the invention
In order to solve the space for exchanging limit in the prior art between ordinary people and deaf-mute and deaf-mute and deaf-mute
The problem of system, the first object of the present invention is to provide a kind of instant message processing method for merging sign language.
A kind of instant message processing method for merging sign language, the method is completed in message processing server, Message Processing
Server is in communication with each other with client, and the client includes sending client and receives client；The method is specifically included：
Step 1：Receive all clients transmission come the user login information comprising User Identity information, according to
Family identification information recognizes the user identity of client；The user identity of the client includes domestic consumer end and deaf and dumb
User terminal；
Step 2：According to the user identity of client, by client and the instant message type matching that can be received；Institute
Stating instant message type includes sign language information, text message and voice messaging；The instant message class that domestic consumer end can receive
Type is text message and voice messaging；The instant message type that deaf and dumb user terminal can be received be sign language information and text message and
Text message；
Step 3：Receive and send the instant message that client transmission comes, further according to the user identity for receiving client, by i.e.
When message be conveyed directly to receive and client or instant message be converted into the instant message that correspondingly received client can be received
Reception client is resent to after type.
Message processing server of the invention is set up with client by websocket mechanism and communicated.
By the communication between websocket Mechanism establishings message processing server and client, realize browser with
Server full-duplex communication, can create many people chatrooms.
It is sign language information when the next instant message of transmission client transmission is received, will receives to the hand in sign language information
Gesture sequence carries out fractionation combination, and gesture sequence is matched according to the gesture database of study definition in advance, and combinations matches are to corresponding
Text message or voice messaging, be finally resent to domestic consumer end.By splitting, combining, match, optimize constantly circulation
Mode ensure that the text being combined into is closest actual.
The method also includes：The voice signal of client input is monitored in real time, is appointed if exceeding setting time interval and not being input into
What information, then be considered as termination input.The complete and accurate of phonetic entry is ensure that by snoop-operations.
In order to solve the space for exchanging limit in the prior art between ordinary people and deaf-mute and deaf-mute and deaf-mute
The problem of system, the second object of the present invention is to provide a kind of instant message processing server for merging sign language.
A kind of instant message processing server for merging sign language, the message processing server is in communication with each other with client,
The client includes sending client and receives client；The message processing server includes：
The user identification module of client, it is used to receiving, and all clients transmission comes comprising User Identity
The user login information of information, the user identity of client is recognized according to User Identity information；The use of the client
Family identity includes domestic consumer end and deaf and dumb user terminal；
Instant message type matching module, it is used for the user identity according to client, by client with can receive
Instant message type matching；The instant message type includes sign language information, text message and voice messaging；Domestic consumer end
The instant message type that can be received is text message and voice messaging；The instant message type that deaf and dumb user terminal can be received is
Sign language information and text message；
Instant message is changed and sending module, and it is used to receive and sends the instant message that client transmission comes, further according to connecing
The user identity of client is received, instant message is conveyed directly to receive client or instant message is converted into correspondingly received visitor
Reception client is resent to after the instant message type that family end can receive.
The message processing server is set up with client by websocket mechanism and communicated.
By the communication between websocket Mechanism establishings message processing server and client, realize browser with
Server full-duplex communication, can create many people chatrooms.
In instant message conversion and sending module, the next instant message of client transmission is sent for sign language is believed when receiving
Breath, fractionation combination is carried out by what is received to the gesture sequence in sign language information, according to the gesture database of study definition in advance
Matching gesture sequence, combinations matches are finally resent to domestic consumer end to corresponding text message or voice messaging.Pass through
Split, combine, matching, the mode of the continuous circulation of optimization ensure that the text being combined into is closest actual.
Party's message processing server also includes：Module is monitored, its voice signal for being used to monitor in real time client input,
If exceeding setting time interval is not input into any information, it is considered as termination input.Phonetic entry is ensure that by snoop-operations
Complete and accurate.
In order to solve the space for exchanging limit in the prior art between ordinary people and deaf-mute and deaf-mute and deaf-mute
The problem of system, the third object of the present invention is to provide a kind of instant message processing method for merging sign language.
A kind of instant message processing method for merging sign language, message processing server is in communication with each other with client, the visitor
Family end includes sending client and receives client；Including：
Step 1：Client sends to message processing server the user login information comprising User Identity information,
The user identity of client is recognized according to User Identity information after message processing server reception；The use of the client
Family identity includes domestic consumer end and deaf and dumb user terminal；
Step 2：Message processing server according to the user identity of client, by client and the instant message that can be received
Type matching；The instant message type includes sign language information, text message and voice messaging；Domestic consumer end can receive
Instant message type be text message and voice messaging；The instant message type that deaf and dumb user terminal can be received is sign language information
And text message；
Step 3：Send client and message processing server is forwarded to reception client, Message Processing clothes by instant message
Be conveyed directly to for instant message to receive client or by immediately according to being additionally operable to according to the user identity for receiving client by business device
Message is resent to reception client after being converted into the instant message type that correspondingly received client can be received.
In order to solve the space for exchanging limit in the prior art between ordinary people and deaf-mute and deaf-mute and deaf-mute
The problem of system, the fourth object of the present invention is to provide a kind of instant message processing system for merging sign language.
A kind of instant message processing system for merging sign language, including：
Client, it is used to send the user login information comprising User Identity information to message handling services
Device；The client includes sending client and receives client；
Message processing server, its user identity for being used to be recognized according to User Identity information client；According to
The user identity of client, by client and the instant message type matching that can be received；
The instant message type includes sign language information, text message and voice messaging；What domestic consumer end can receive
Instant message type is text message and voice messaging；The instant message type that deaf and dumb user terminal can be received be sign language information and
Text message；
The user identity of the client includes domestic consumer end and deaf and dumb user terminal；
Client is sent, it is used to for instant message message processing server is forwarded into reception client；
Message processing server, it is additionally operable to according to the user identity being additionally operable to according to reception client, by instant message
After being conveyed directly to receive client or instant message is converted into the instant message type that correspondingly received client can be received
It is resent to reception client.
Beneficial effects of the present invention are：
(1) the invention provides a kind of instant message method and system for merging sign language, especially in deaf-mute with normal
In the case that people carries out telecommunication, sign language can be converted to word, be sign language text conversion, be different types of user
Selectable information display methods are provided, the space limitation and obstacle linked up each other is eliminated；
(2) the webSocket mechanism in system ensure that message can in time be communicated to all terminals for participating in exchange and use
Family；The cost that ordinary people links up with deaf-mute is reduced to a certain extent, while being exchanged with other people there is provided more to deaf-mute
The chance of communication.
(3) when deaf-mute carries out telecommunication with sign language with normal person, the feelings of the remote conversations for especially being participated in many people
Under condition, system is realized and for sign language to be converted to text, and for domestic consumer provides voice broadcast function, while by domestic consumer
Phonetic entry is converted to the sign language arrived that deaf-mute can see, and exports to display screen.
(4) present invention transmits different types of instant message according to identity information, is reduced while user's request is met
The waste of bandwidth.
Brief description of the drawings
Fig. 1 is a kind of schematic flow sheet of the instant message processing method for merging sign language in the embodiment of the present invention；
Fig. 2 is the schematic flow sheet of the instant message processing method of another fusion sign language in the embodiment of the present invention；
Fig. 3 is a kind of instant message processing server structural representation for merging sign language in the embodiment of the present invention；
Fig. 4 is a kind of instant message processing system structural representation for merging sign language in the embodiment of the present invention.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.It is based on
Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of creative work is not made
Embodiment, belongs to the scope of protection of the invention.
The client referred in the embodiment of the present invention can include PC, panel computer, smart mobile phone, electronic reading
The operation such as device, car-mounted terminal and Wearable has the internet device that APP is applied, by internet and message handling services
Device is communicated, and the message processing server can be the background server of the APP applications run on application terminal.
Fig. 1 is a kind of schematic flow sheet of the instant message processing method for merging sign language, this implementation in the embodiment of the present invention
Example is described mainly from message processing server side, as shown in the figure the instant message treatment of the fusion sign language in the present embodiment
Method can include：
S101, receive all clients transmission come the user login information comprising User Identity information, according to
Family identification information recognizes the user identity of client.
In implementing, the user identity of client includes domestic consumer end and deaf and dumb user terminal.
By the communication between websocket Mechanism establishings message processing server and client, realize browser with
Server full-duplex communication, can create many people chatrooms.
Message processing server is that each user distributes identity (dm represents deaf and dumb user, and nm represents domestic consumer),
User's identification is carried out during for subsequent data transmission foundation is provided.
For example：One room is created by a chat initiator, room password is set, system is returned and creates successful room
ID.Need selection identity to include nm (domestic consumer) dm (deaf and dumb user) when other users are into chatroom and be input into chatroom wound
Room ID and password that the person of building is given.Wherein dm user needs leapmotion supports.
S102, according to the user identity of client, by client and the instant message type matching that can be received.
In implementing, instant message type includes sign language information, text message and voice messaging；Domestic consumer end can
The instant message type of reception is text message and voice messaging；The instant message type that deaf and dumb user terminal can be received is sign language
Information and text message.
According to user identity landmark identification user type, set up with each terminal by websocket mechanism and communicated, by text
All terminals are real-time transmitted to, the gesture sequence that will be collected is real-time transmitted to other dm ends.According to identity information transmission not
The instant message of same type, reduces the waste of bandwidth while user's request is met.
Wherein, selection text in nm ends shows or voice broadcast that dm ends selection text or gesture show.More press close to true
Real communication scene, makes talk more natural.
S103, receives and sends the instant message that client transmission comes, further according to the user identity for receiving client, will be instant
Message is conveyed directly to receive client or instant message is converted into the instant message class that correspondingly received client can be received
Reception client is resent to after type.
For example：
(1) when dm user transmits information to other users, it is necessary first to initialize the running environment of leapmotion, moment
Receive user input.User directly needs transmission content after selection sign language input in chat system using sign language typing.System
After gesture recognition module detection user this end of input in system, this gesture sequence is split, is combined, changed written
Word information.Text message is sent in room other users.Meanwhile, according to user identity, the gesture sequence being collected into
Dm user is sent to, when the text information that other people send in user receives chatroom, nm user can be according to System menu
Selection voice broadcast directly displays word, and dm user can select to show text information or gesture sequence information.
(2) when nm user transmits information to other users, phonetic entry is selected in chat system or text is directly inputted
Word.When voice is input into, system sends voice messaging to the nm user in chatroom, and nm user can directly listen to, and right
Then need to be transcribed into word after voice is received in dm user to directly display, or participle, restructuring carried out to text,
It is inversely gesture sequence, is acted with continuous sign language and shown.When entering text, nm user can select language according to System menu
Word is reported or directly displayed to sound, and dm user can select display text information or participle, restructuring are carried out to text, be inversely
Gesture sequence, is acted with continuous sign language and shown.
Nm ends select for voice to be converted into text according to demand and show, or convert the text to voice reading, dm ends handle
All of voice is first converted to text, and selection text mode shows or carries out the inverse operation of sign language conversion, converts text to
Sign language sequence shows.This design disclosure satisfy that various demands of different type user.
In a particular embodiment, it is sign language information when the next instant message of transmission client transmission is received, by what is received
Fractionation combination is carried out to the gesture sequence in sign language information, gesture sequence is matched according to the gesture database of study definition in advance,
Combinations matches are finally resent to domestic consumer end to corresponding text message or voice messaging.By splitting, combining,
Mode with the continuous circulation of, optimization ensure that the text that is combined into closest to actual.
In another embodiment, the method also includes：
S104, monitors the voice signal of client input in real time, if exceeding setting time interval is not input into any information,
It is considered as termination input.The complete and accurate of phonetic entry is ensure that by snoop-operations.
In the present embodiment in the case where deaf-mute carries out telecommunication with normal person, sign language can be converted to word,
It is sign language text conversion, for different types of user provides selectable information display methods, eliminates and link up each other
Obstacle.WebSocket mechanism in system ensure that message can in time be communicated to all terminal users for participating in exchange；One
Determine to be reduced in degree the cost that ordinary people links up with deaf-mute, while being provided to deaf-mute more with other people communications
Chance.
When deaf-mute carries out telecommunication with sign language with normal person, the situation of the remote conversations for especially being participated in many people
Under, system is realized and for sign language to be converted to text, and for domestic consumer provides voice broadcast function, while by the language of domestic consumer
Sound input is converted to the sign language arrived that deaf-mute can see, and exports to display screen.Transmitted according to identity information different types of
Instant message, reduces the waste of bandwidth while user's request is met.
Fig. 2 is a kind of schematic flow sheet of the instant message processing method for merging sign language in another embodiment of the present invention, this
Embodiment to be mainly and mix side with client from message processing server and describe, the fusion sign language in the present embodiment as shown in the figure
Instant message processing method can include：
S201, client sends to message processing server the user login information comprising User Identity information,
The user identity of client is recognized according to User Identity information after message processing server reception.
Specifically, the user identity of client includes domestic consumer end and deaf and dumb user terminal；Built by websocket mechanism
Vertical communication between message processing server and client, realizes browser and server full-duplex communication, can create many
People chatroom.
Message processing server is that each user distributes identity (dm represents deaf and dumb user, and nm represents domestic consumer),
User's identification is carried out during for subsequent data transmission foundation is provided.
For example：One room is created by a chat initiator, room password is set, system is returned and creates successful room
ID.Selection identity is needed when other users are into chatroom includes nm (domestic consumer), dm (deaf and dumb user), and is input into chatroom
Room ID and password that founder is given.Wherein dm user needs leapmotion supports.
S202, message processing server according to the user identity of client, by client and the instant message that can be received
Type matching.
In implementing, instant message type includes sign language information, text message and voice messaging；Domestic consumer end can
The instant message type of reception is text message and voice messaging；The instant message type that deaf and dumb user terminal can be received is sign language
Information and text message.
According to user identity landmark identification user type, set up with each terminal by websocket mechanism and communicated, by text
All terminals are real-time transmitted to, the gesture sequence that will be collected is real-time transmitted to other dm ends.According to identity information transmission not
The instant message of same type, reduces the waste of bandwidth while user's request is met.
Wherein, selection text in nm ends shows or voice broadcast that dm ends selection text or gesture show.More press close to true
Real communication scene, makes talk more natural.
S203, sends client and instant message is forwarded into reception client, Message Processing clothes by message processing server
Be conveyed directly to for instant message to receive client or by immediately according to being additionally operable to according to the user identity for receiving client by business device
Message is resent to reception client after being converted into the instant message type that correspondingly received client can be received.
In specific implementation, when it is dm ends to send client, gesture number is gathered using motion sensing control device leapmotion
According to, a continuous gesture of dynamic is persistently kept track of, being not detected by gesture in the time interval of lasting setting then terminates defeated
Enter.A persistently coherent gesture sequence can be preferably followed the trail of, makes the raw information for capturing as accurate as possible.
It is sign language information when the next instant message of transmission client transmission is received, will receives to the hand in sign language information
Gesture sequence carries out fractionation combination, and gesture sequence is matched according to the gesture database of study definition in advance, and combinations matches are to corresponding
Text message or voice messaging, be finally resent to domestic consumer end.By splitting, combining, match, optimize constantly circulation
Mode ensure that the text being combined into is closest actual.
In another embodiment, the method also includes：
S204, instant message processing server also monitors the voice signal of client input in real time, if exceeding setting time
Interval is not input into any information, then be considered as termination input.The complete and accurate of phonetic entry is ensure that by snoop-operations.
In the present embodiment in the case where deaf-mute carries out telecommunication with normal person, sign language can be converted to word,
It is sign language text conversion, for different types of user provides selectable information display methods, eliminates and link up each other
Obstacle.WebSocket mechanism in system ensure that message can in time be communicated to all terminal users for participating in exchange；One
Determine to be reduced in degree the cost that ordinary people links up with deaf-mute, while being provided to deaf-mute more with other people communications
Chance.
When deaf-mute carries out telecommunication with sign language with normal person, the situation of the remote conversations for especially being participated in many people
Under, system is realized and for sign language to be converted to text, and for domestic consumer provides voice broadcast function, while by the language of domestic consumer
Sound input is converted to the sign language arrived that deaf-mute can see, and exports to display screen.Transmitted according to identity information different types of
Instant message, reduces the waste of bandwidth while user's request is met.
Fig. 3 is a kind of instant message processing server structural representation for merging sign language in the embodiment of the present invention.Such as Fig. 3 institutes
Show, the instant message processing server of the fusion sign language in the embodiment of the present invention, message processing server and client phase intercommunication
Letter, client includes sending client and receives client.
The message processing server includes：
(1) user identification module of client, it is used to receiving, and all clients transmission comes comprising user identity
The user login information of identification information, the user identity of client is recognized according to User Identity information；The client
User identity include domestic consumer end and deaf and dumb user terminal.
Specifically, by the communication between websocket Mechanism establishings message processing server and client, realize clear
Look at device and server full-duplex communication, many people chatrooms can be created.
Message processing server is that each user distributes identity (dm represents deaf and dumb user, and nm represents domestic consumer),
User's identification is carried out during for subsequent data transmission foundation is provided.
For example：One room is created by a chat initiator, room password is set, system is returned and creates successful room
ID.Selection identity is needed when other users are into chatroom includes nm (domestic consumer), dm (deaf and dumb user), and is input into chatroom
Room ID and password that founder is given.Wherein dm user needs leapmotion supports.
(2) instant message type matching module, it is used for the user identity according to client, by client with can receive
Instant message type matching；The instant message type includes sign language information, text message and voice messaging；Domestic consumer
The instant message type that end can receive is text message and voice messaging；The instant message type that deaf and dumb user terminal can be received
It is sign language information and text message.
In implementing, according to user identity landmark identification user type, set up with each terminal by websocket mechanism
Communication, all terminals are real-time transmitted to by text, and the gesture sequence that will be collected is real-time transmitted to other dm ends.According to identity
The different types of instant message of information transfer, reduces the waste of bandwidth while user's request is met.
Wherein, selection text in nm ends shows or voice broadcast that dm ends selection text or gesture show.More press close to true
Real communication scene, makes talk more natural.
(3) instant message conversion and sending module, it is used to receive the instant message that transmission client transmission comes, further according to
The user identity of client is received, instant message is conveyed directly to receive client or is converted into instant message correspondingly received
Reception client is resent to after the instant message type that client can be received.
In specific implementation, when it is dm ends to send client, gesture number is gathered using motion sensing control device leapmotion
According to, a continuous gesture of dynamic is persistently kept track of, being not detected by gesture in the time interval of lasting setting then terminates defeated
Enter.A persistently coherent gesture sequence can be preferably followed the trail of, makes the raw information for capturing as accurate as possible.
It is sign language information when the next instant message of transmission client transmission is received, will receives to the hand in sign language information
Gesture sequence carries out fractionation combination, and gesture sequence is matched according to the gesture database of study definition in advance, and combinations matches are to corresponding
Text message or voice messaging, be finally resent to domestic consumer end.By splitting, combining, match, optimize constantly circulation
Mode ensure that the text being combined into is closest actual.
In another embodiment, party's message processing server also includes：
Module is monitored, it is used to monitor in real time the voice signal of client input, if exceed setting time interval not being input into
Any information, then be considered as termination input.
In the present embodiment in the case where deaf-mute carries out telecommunication with normal person, sign language can be converted to word,
It is sign language text conversion, for different types of user provides selectable information display methods, eliminates and link up each other
Obstacle.WebSocket mechanism in system ensure that message can in time be communicated to all terminal users for participating in exchange；One
Determine to be reduced in degree the cost that ordinary people links up with deaf-mute, while being provided to deaf-mute more with other people communications
Chance.
When deaf-mute carries out telecommunication with sign language with normal person, the situation of the remote conversations for especially being participated in many people
Under, system is realized and for sign language to be converted to text, and for domestic consumer provides voice broadcast function, while by the language of domestic consumer
Sound input is converted to the sign language arrived that deaf-mute can see, and exports to display screen.Transmitted according to identity information different types of
Instant message, reduces the waste of bandwidth while user's request is met.
Fig. 4 is a kind of instant message processing system structural representation for merging sign language in the embodiment of the present invention.Such as Fig. 4 institutes
Show, the instant message processing system of the fusion sign language in the embodiment of the present invention, including：Client and message processing server.
Client includes sending client and receives client.
(1) client, it is used to send the user login information comprising User Identity information to Message Processing clothes
Business device.
In specific implementation, when it is dm ends to send client, gesture number is gathered using motion sensing control device leapmotion
According to, a continuous gesture of dynamic is persistently kept track of, being not detected by gesture in the time interval of lasting setting then terminates defeated
Enter.A persistently coherent gesture sequence can be preferably followed the trail of, makes the raw information for capturing as accurate as possible.
(2) message processing server, its user identity for being used to be recognized according to User Identity information client；Root
According to the user identity of client, by client and the instant message type matching that can be received.
Instant message type includes sign language information, text message and voice messaging；It is instant that domestic consumer end can receive
Type of message is text message and voice messaging；The instant message type that deaf and dumb user terminal can be received is sign language information and text
Information；
The user identity of the client includes domestic consumer end and deaf and dumb user terminal.
Client is sent, it is used to for instant message message processing server is forwarded into reception client.
Message processing server, it is additionally operable to according to the user identity being additionally operable to according to reception client, by instant message
After being conveyed directly to receive client or instant message is converted into the instant message type that correspondingly received client can be received
It is resent to reception client.
It is sign language information when the next instant message of transmission client transmission is received, will receives to the hand in sign language information
Gesture sequence carries out fractionation combination, and gesture sequence is matched according to the gesture database of study definition in advance, and combinations matches are to corresponding
Text message or voice messaging, be finally resent to domestic consumer end.By splitting, combining, match, optimize constantly circulation
Mode ensure that the text being combined into is closest actual.
In another embodiment, message processing server, is additionally operable to monitor in real time the voice signal of client input, if super
Cross setting time interval and be not input into any information, be then considered as termination input.
In the present embodiment in the case where deaf-mute carries out telecommunication with normal person, sign language can be converted to word,
It is sign language text conversion, for different types of user provides selectable information display methods, eliminates and link up each other
Obstacle.WebSocket mechanism in system ensure that message can in time be communicated to all terminal users for participating in exchange；One
Determine to be reduced in degree the cost that ordinary people links up with deaf-mute, while being provided to deaf-mute more with other people communications
Chance.
When deaf-mute carries out telecommunication with sign language with normal person, the situation of the remote conversations for especially being participated in many people
Under, system is realized and for sign language to be converted to text, and for domestic consumer provides voice broadcast function, while by the language of domestic consumer
Sound input is converted to the sign language arrived that deaf-mute can see, and exports to display screen.Transmitted according to identity information different types of
Instant message, reduces the waste of bandwidth while user's request is met.
It should be understood by those skilled in the art that, embodiments of the invention can be provided as method, system or computer program
Product.Therefore, the present invention can be using the shape of the embodiment in terms of hardware embodiment, software implementation or combination software and hardware
Formula.And, the present invention can be used can use storage in one or more computers for wherein including computer usable program code
The form of the computer program product implemented on medium (including but not limited to magnetic disk storage and optical memory etc.).
The present invention is the flow with reference to method according to embodiments of the present invention, equipment (system) and computer program product
Figure and/or block diagram are described.It should be understood that every first-class during flow chart and/or block diagram can be realized by computer program instructions
The combination of flow and/or square frame in journey and/or square frame and flow chart and/or block diagram.These computer programs can be provided
The processor of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce
A raw machine so that produced for reality by the instruction of computer or the computing device of other programmable data processing devices
The device of the function of being specified in present one flow of flow chart or multiple one square frame of flow and/or block diagram or multiple square frames.
These computer program instructions may be alternatively stored in can guide computer or other programmable data processing devices with spy
In determining the computer-readable memory that mode works so that instruction of the storage in the computer-readable memory is produced and include finger
Make the manufacture of device, the command device realize in one flow of flow chart or multiple one square frame of flow and/or block diagram or
The function of being specified in multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that in meter
Series of operation steps is performed on calculation machine or other programmable devices to produce computer implemented treatment, so as in computer or
The instruction performed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in individual square frame or multiple square frames.
One of ordinary skill in the art will appreciate that all or part of flow in realizing above-described embodiment method, can be
The hardware of correlation is instructed to complete by computer program, described program can be stored in a computer read/write memory medium
In, the program is upon execution, it may include such as the flow of the embodiment of above-mentioned each method.Wherein, described storage medium can be magnetic
Dish, CD, read-only memory (Read-Only Memory, ROM) or random access memory (Random
AccessMemory, RAM) etc..
Although above-mentioned be described with reference to accompanying drawing to specific embodiment of the invention, not to present invention protection model
The limitation enclosed, one of ordinary skill in the art should be understood that on the basis of technical scheme those skilled in the art are not
Need the various modifications made by paying creative work or deformation still within protection scope of the present invention.
Claims (10)
1. it is a kind of merge sign language instant message processing method, it is characterised in that the method is completed in message processing server,
Message processing server is in communication with each other with client, and the client includes sending client and receives client；The method has
Body includes：
Step 1：The user login information comprising User Identity information that all clients transmission comes is received, according to user's body
Part identification information recognizes the user identity of client；The user identity of the client includes domestic consumer end and deaf and dumb user
End；
Step 2：According to the user identity of client, by client and the instant message type matching that can be received；It is described to be
When type of message include sign language information, text message and voice messaging；The instant message type that domestic consumer end can receive is
Text message and voice messaging；The instant message type that deaf and dumb user terminal can be received is sign language information and text message；
Step 3：Receive and send the instant message that client transmission comes, further according to the user identity for receiving client, will disappear immediately
Breath is conveyed directly to receive client or instant message is converted into the instant message type that correspondingly received client can be received
After be resent to reception client.
2. a kind of instant message processing method for merging sign language as claimed in claim 1, it is characterised in that the Message Processing
Server is set up with client by websocket mechanism and communicated.
3. a kind of instant message processing method for merging sign language as claimed in claim 1, it is characterised in that send visitor when receiving
The instant message that the transmission of family end comes is sign language information, and fractionation combination is carried out to the gesture sequence in sign language information by what is received,
Gesture database according to study definition in advance matches gesture sequence, and combinations matches to corresponding text message or voice are believed
Breath, is finally resent to domestic consumer end.
4. a kind of instant message processing method for merging sign language as claimed in claim 1, it is characterised in that the method is also wrapped
Include：The voice signal of client input is monitored in real time, if exceeding setting time interval is not input into any information, is considered as termination defeated
Enter.
5. it is a kind of merge sign language instant message processing server, it is characterised in that the message processing server and client
It is in communication with each other, the client includes sending client and receives client；The message processing server includes：
The user identification module of client, it is used to receiving, and all clients transmission comes comprising User Identity information
User login information, the user identity of client is recognized according to User Identity information；User's body of the client
Part includes domestic consumer end and deaf and dumb user terminal；
Instant message type matching module, it is used for the user identity according to client, and client is instant with what can be received
Type of message matches；The instant message type includes sign language information, text message and voice messaging；Domestic consumer end can
The instant message type of reception is text message and voice messaging；The instant message type that deaf and dumb user terminal can be received is sign language
Information and text message；
Instant message is changed and sending module, and it is used for reception and sends the instant message that client transmission comes, objective further according to receiving
The user identity at family end, instant message is conveyed directly to receive client or instant message is converted into correspondingly received client
Reception client is resent to after the instant message type that can be received.
6. a kind of instant message processing server for merging sign language as claimed in claim 5, it is characterised in that at the message
Reason server is set up with client by websocket mechanism and communicated；
Or be sign language information when the next instant message of transmission client transmission is received in instant message conversion and sending module,
Fractionation combination is carried out to the gesture sequence in sign language information by what is received, is matched according to the gesture database of study definition in advance
Gesture sequence, combinations matches are finally resent to domestic consumer end to corresponding text message or voice messaging；
Or party's message processing server also includes：Module is monitored, its voice signal for being used to monitor in real time client input, if
Any information is not input into more than setting time interval, is then considered as termination input.
7. it is a kind of merge sign language instant message processing method, it is characterised in that message processing server and client phase intercommunication
Letter, the client includes sending client and receives client；Including：
Step 1：Client sends to message processing server, message the user login information comprising User Identity information
The user identity of client is recognized according to User Identity information after processing server reception；User's body of the client
Part includes domestic consumer end and deaf and dumb user terminal；
Step 2：Message processing server according to the user identity of client, by client and the instant message type that can be received
Match；The instant message type includes sign language information, text message and voice messaging；Domestic consumer end can receive i.e.
When type of message be text message and voice messaging；The instant message type that deaf and dumb user terminal can be received is sign language information and text
This information；
Step 3：Send client and message processing server is forwarded to reception client, message processing server by instant message
According to being additionally operable to according to the user identity for receiving client, instant message is conveyed directly to receive client or by instant message
Reception client is resent to after being converted into the instant message type that correspondingly received client can be received.
8. a kind of instant message processing method for merging sign language as claimed in claim 7, it is characterised in that the Message Processing
Server is set up with client by websocket mechanism and communicated；
Or when the instant message that reception transmission client transmission comes is sign language information, will receive to the gesture in sign language information
Sequence carries out fractionation combination, and gesture sequence is matched according to the gesture database of study definition in advance, and combinations matches are to corresponding
Text message or voice messaging, are finally resent to domestic consumer end.
Or the method also includes：Message processing server monitors the voice signal of client input in real time, if exceeding setting time
Interval is not input into any information, then be considered as termination input.
9. it is a kind of merge sign language instant message processing system, it is characterised in that including：
Client, it is used to send the user login information comprising User Identity information to message processing server；Institute
Stating client includes sending client and receives client；
Message processing server, its user identity for being used to be recognized according to User Identity information client；According to client
The user identity at end, by client and the instant message type matching that can be received；
The instant message type includes sign language information, text message and voice messaging；It is instant that domestic consumer end can receive
Type of message is text message and voice messaging；The instant message type that deaf and dumb user terminal can be received is sign language information and text
Information；
The user identity of the client includes domestic consumer end and deaf and dumb user terminal；
Client is sent, it is used to for instant message message processing server is forwarded into reception client；
Message processing server, it is additionally operable to according to being additionally operable to according to the user identity for receiving client, and instant message is direct
It is sent to reception client or is passed again after instant message is converted into the instant message type that correspondingly received client can be received
Deliver to reception client.
10. a kind of instant message processing system for merging sign language as claimed in claim 9, it is characterised in that at the message
Reason server is set up with client by websocket mechanism and communicated；
Or message processing server, it is sign language information to be additionally operable to when the next instant message of transmission client transmission is received, and will be received
To fractionation combination is carried out to the gesture sequence in sign language information, according in advance study definition gesture database match gesture sequence
Row, combinations matches are finally resent to domestic consumer end to corresponding text message or voice messaging；
Or message processing server, it is additionally operable to monitor in real time the voice signal of client input, if exceeding setting time interval not
Any information is input into, is then considered as termination input.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710025174.7A CN106789593B (en) | 2017-01-13 | 2017-01-13 | A kind of instant message processing method, server and system merging sign language |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710025174.7A CN106789593B (en) | 2017-01-13 | 2017-01-13 | A kind of instant message processing method, server and system merging sign language |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106789593A true CN106789593A (en) | 2017-05-31 |
| CN106789593B CN106789593B (en) | 2019-01-11 |
Family
ID=58946529
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710025174.7A Expired - Fee Related CN106789593B (en) | 2017-01-13 | 2017-01-13 | A kind of instant message processing method, server and system merging sign language |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106789593B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107231374A (en) * | 2017-07-08 | 2017-10-03 | 长沙手之声信息科技有限公司 | Deaf person's remote chat method based on online sign language interpreter |
| RU188793U1 (en) * | 2018-07-25 | 2019-04-23 | федеральное государственное бюджетное образовательное учреждение высшего образования "Российский государственный университет им. А.Н. Косыгина (Технологии. Дизайн. Искусство)" | A device for receiving and transmitting information of subscribers with functional disorders of the receiving and generating bodies of information signals |
| RU2715286C2 (en) * | 2018-07-25 | 2020-02-26 | федеральное государственное бюджетное образовательное учреждение высшего образования "Российский государственный университет им. А.Н. Косыгина (Технологии. Дизайн. Искусство)" | System for receiving and transmitting information with conversion of information signals |
| CN111083421A (en) * | 2018-10-19 | 2020-04-28 | 珠海金山办公软件有限公司 | Table document display method and device |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102019204054A1 (en) * | 2019-03-25 | 2020-10-01 | Volkswagen Aktiengesellschaft | Method for providing a speech dialogue in sign language in a speech dialogue system for a vehicle |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1866934A (en) * | 2005-05-20 | 2006-11-22 | 腾讯科技（深圳）有限公司 | Instant communication service realizing method and its system |
| CN103001858A (en) * | 2012-12-14 | 2013-03-27 | 上海量明科技发展有限公司 | Method, client and system for replying messages in instant messaging |
| CN104980599A (en) * | 2015-06-17 | 2015-10-14 | 上海斐讯数据通信技术有限公司 | Sign language-voice call method and sign language-voice call system |
| US20150347399A1 (en) * | 2014-05-27 | 2015-12-03 | Microsoft Technology Licensing, Llc | In-Call Translation |
| CN105868282A (en) * | 2016-03-23 | 2016-08-17 | 乐视致新电子科技（天津）有限公司 | Method and apparatus used by deaf-mute to perform information communication, and intelligent terminal |
-
2017
- 2017-01-13 CN CN201710025174.7A patent/CN106789593B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1866934A (en) * | 2005-05-20 | 2006-11-22 | 腾讯科技（深圳）有限公司 | Instant communication service realizing method and its system |
| CN103001858A (en) * | 2012-12-14 | 2013-03-27 | 上海量明科技发展有限公司 | Method, client and system for replying messages in instant messaging |
| US20150347399A1 (en) * | 2014-05-27 | 2015-12-03 | Microsoft Technology Licensing, Llc | In-Call Translation |
| CN104980599A (en) * | 2015-06-17 | 2015-10-14 | 上海斐讯数据通信技术有限公司 | Sign language-voice call method and sign language-voice call system |
| CN105868282A (en) * | 2016-03-23 | 2016-08-17 | 乐视致新电子科技（天津）有限公司 | Method and apparatus used by deaf-mute to perform information communication, and intelligent terminal |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107231374A (en) * | 2017-07-08 | 2017-10-03 | 长沙手之声信息科技有限公司 | Deaf person's remote chat method based on online sign language interpreter |
| RU188793U1 (en) * | 2018-07-25 | 2019-04-23 | федеральное государственное бюджетное образовательное учреждение высшего образования "Российский государственный университет им. А.Н. Косыгина (Технологии. Дизайн. Искусство)" | A device for receiving and transmitting information of subscribers with functional disorders of the receiving and generating bodies of information signals |
| RU2715286C2 (en) * | 2018-07-25 | 2020-02-26 | федеральное государственное бюджетное образовательное учреждение высшего образования "Российский государственный университет им. А.Н. Косыгина (Технологии. Дизайн. Искусство)" | System for receiving and transmitting information with conversion of information signals |
| CN111083421A (en) * | 2018-10-19 | 2020-04-28 | 珠海金山办公软件有限公司 | Table document display method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106789593B (en) | 2019-01-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106789593A (en) | A kind of instant message processing method for merging sign language, server and system | |
| US20210336906A1 (en) | System and method of using conversational agent to collect information and trigger actions | |
| CN101303622B (en) | Method for chatting using chat interface with haptic feedback function | |
| US11833413B1 (en) | System, method and apparatus for collecting and utilizing big data for online gameplay | |
| EP2847932B1 (en) | Method, client and server of transmitting group communication information | |
| JP5101737B2 (en) | Apparatus and method for interworking between virtual reality services | |
| CN111279349B (en) | Parsing electronic conversations for presentation in alternative interfaces | |
| CN108616447B (en) | Customer relationship bootstrap technique, device and the electronic equipment of social networks | |
| US20100153858A1 (en) | Uniform virtual environments | |
| CN105847988A (en) | Video sharing method and apparatus | |
| CN103346953B (en) | A kind of method of group communication data interaction, Apparatus and system | |
| CN110609970B (en) | User identity identification method and device, storage medium and electronic equipment | |
| CN106339947A (en) | Method and device for performing business operation and acquiring group member information based on chat group | |
| CN104144108A (en) | Information response method, device and system | |
| CN106982158A (en) | The sharing method and device of movement locus | |
| CN106653020A (en) | Multi-business control method and system for smart sound and video equipment based on deep learning | |
| CN113873286A (en) | Live broadcast method and system based on artificial intelligence | |
| CN113850898A (en) | Scene rendering method and device, storage medium and electronic equipment | |
| CN105306695A (en) | Communication method of mobile terminal and mobile terminal | |
| CN107783650A (en) | A kind of man-machine interaction method and device based on virtual robot | |
| CN103684981A (en) | Instant messaging interactive method, system and server | |
| CN106034157A (en) | HTTP transmission method in data exchange, server and storage device | |
| CN115205009A (en) | Account opening business processing method and device based on virtual technology | |
| CN113992882A (en) | Packet processing method and device for multi-person conversation, electronic device and storage medium | |
| CN114124415B (en) | Information interaction method and device in target interaction application |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20190111 Termination date: 20220113 |