CN109917917A - A kind of visual human's interactive software bus system and its implementation - Google Patents
A kind of visual human's interactive software bus system and its implementation Download PDFInfo
- Publication number
- CN109917917A CN109917917A CN201910167941.7A CN201910167941A CN109917917A CN 109917917 A CN109917917 A CN 109917917A CN 201910167941 A CN201910167941 A CN 201910167941A CN 109917917 A CN109917917 A CN 109917917A
- Authority
- CN
- China
- Prior art keywords
- unit
- event
- visual human
- visual
- interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of visual human's interactive software bus system and its implementation, system includes: event communication flexible bus, for realizing the flexible bus communication between module based on distribution subscription mechanism；Visual capacity unit and speech capability unit are used for visual human's vision and interactive voice；Emotional ability unit, for calculating the affective state of visual human；Decision-making management unit, the behaviour control for generating visual human instruct；Visual human's engine unit, for driving the visualization behavior of visual human to show；Application interface unit, for being interacted with third-party application；Each unit of the present invention is by bus interface carry on event communication flexible bus, third-party application is supported to access this system by interface protocol, to realize that visual human's image, movement, expression, sound kimonos variety such as change at the integrated control of operations, solves the compatibility issue that different application systems control visual human, make visual human be easier to be integrated into intelligent man-machine interaction process, effectively improves user experience.
Description
Technical field
The invention belongs to virtual robot technical fields, and in particular to a kind of visual human's interactive software bus system and in fact
Existing method.
Background technique
Visual human is a kind of with 2D or 3D virtual image, and the software forms machine of natural interaction can be carried out with user
People, it is generally passed through the forms such as screen, projection, is showed in front of the user in the form of animation.
Existing tangible machine people, appearance is stiff, volume is larger, is difficult that user is allowed to generate friendliness.Visual human does not have then
The limitation of entity, form is lively, image can on-demand fast custom, have the advantages such as deployment is convenient, input cost is low, be a kind of
The more robot of lightweight can be commonly utilized in the scenes such as retail, advertisement, real estate, customer service, have to user more obvious
Attraction, therefore, the visual human with animating image will be increasingly becoming the mainstream of the following human-computer interaction.
With the continuous development of artificial intelligence technology, visual human gradually has voice response, visual identity, human-computer interaction
Deng intelligent ability, many products also start to introduce main media of the visual human as user's interaction.But current visual human
The form of complete product has not been reached yet, can not directly use as molding product systems, be connect without convenient interactive controlling
Mouthful, third-party application and system are difficult to quickly access and integrate；On the other hand, the ability of visual human relies primarily on software realization,
The interactive system ability of existing visual human and user are weaker, and the interactive experience of user is poor.
In order to enable Virtual Human Technology to be more easily integrated into existing human-computer interaction process, to enhance the people of user
Machine interactive experience, there is an urgent need to study the stronger visual human of compatibility to control integrated method and system.
Summary of the invention
For above-mentioned visual human in the prior art and user interactive system ability is weak, the low problem of compatibility, the present invention
In proposing a kind of visual human's interactive software bus system and its implementation, for realizing visual human's control, user's interaction and the
The software synthesis of tripartite's application is integrated.Third-party application system can quickly access visual human's interaction capabilities, solve visual human
The compatibility issue of application enables different application quickly to have the image and interaction capabilities of visual human, and product form is more
Intelligence, improves the interactive experience of user, specific technical solution is as follows:
On the one hand, a kind of visual human's interactive software bus system is provided, the system is connect with cloud server, the system
System realizes user's interaction, visual human's control and third for being uniformly controlled visual human's image, dress ornament, expression, movement and sound
The comprehensive integration of Fang Yingyong, wherein the system comprises visual capacity unit, speech capability unit, emotional ability units, decision
Administrative unit, visual human's engine unit and event communication flexible bus, the visual capacity unit, speech capability unit, emotion energy
Power unit, decision-making management unit and visual human's engine unit are soft total in the event communication by event interaction bus interface carry
On line, the event communication flexible bus for realizing the visual capacity unit, speech capability unit, emotional ability unit, certainly
The event of plan administrative unit and visual human's engine unit between each other based on distribution subscription mechanism interactively communicates；Wherein:
Visual capacity unit is uploaded to the cloud service for obtaining user image data, and by described image data
The events such as device calculates, and generation Face datection, tracking, identification, personnel reach, leave；
Decision-making management unit for managing the resource and configuration of visual human, and receives the visual capacity unit, voice energy
The incoming event of power unit and emotional ability unit generates the behaviour control instruction of visual human based on the incoming event；
Speech capability unit for obtaining user speech input data, and the input voice data is uploaded to described
Cloud server realizes the understanding to user voice command meaning, generates voice command input event, and refer to according to the control
It enables, generates the voice answer-back output of visual human；
Emotional ability unit, the input based on active user calculate the affective state of visual human according to the input, generate
Affective state event；
Visual human's engine unit, visual animation and behavior for driving visual human show.
Further, the system also includes application interface unit and user interface, the application interface unit is logical
The event interaction bus interface carry is crossed on the event communication flexible bus, the application interface unit is used for and third party
Using progress data interaction；
Interface alternation interface is provided between the user interface and visual human's engine unit, the user hands over
Mutual interface and visual human's engine unit pass through interface alternation interface realization data interaction.
Further, the application interface unit and the third-party application pass through the realization data interaction of TCP/IP interface.
Further, the system carries out data interaction using character string text, and the character string text uses JSON lattice
Formula description.
Further, the virtual artificial software robot with the virtual animating image of 2D or 3D, the soma
People operates in fictitious host computer equipment.
Further, the visual capacity unit, speech capability unit, emotional ability unit, decision-making management unit and void
Anthropomorphic engine unit realizes data interaction by mutually transmitting event in the event communication flexible bus, and the event is by event
Type and message content composition, wherein the event type includes:
System event, vision incoming event, voice incoming event, interface alternation event, third-party application event, emotion shape
State event, voice output event, expression control event, action control event, dress ornament control event, interface information outgoing event.
On the other hand, a kind of implementation method of visual human's interactive software bus system is provided, applied to above-mentioned visual human
Interactive software bus system, the method includes the steps:
S1, the visual capacity unit, speech capability unit, emotional ability unit, decision-making management unit and visual human draw
Unit is held up on the event communication flexible bus and to register by the bus interface carry；
S2, the setting visual capacity unit, speech capability unit, emotional ability unit, decision-making management unit and virtual
The demand of each unit subscribes to the subscription statement that event forms corresponding each unit in people's engine unit, and the subscription is stated that record is protected
There are in the event communication flexible bus；
S3, the visual capacity unit, speech capability unit, emotional ability unit, decision-making management unit and visual human draw
It holds up unit and is separately operable and issues the event, the event communication flexible bus subscribes to the relationship of statement according to each unit,
Distribute the event to corresponding unit, drives the normal operation of the system；
S4, the visual capacity unit, speech capability unit, emotional ability unit, decision-making management unit and visual human draw
It holds up unit and the virtual human animation and interface content is showed by the user interface.
Compared with prior art, the beneficial effect of visual human's interactive software bus system of the invention and its implementation
Are as follows: the present invention has many advantages, such as that compatibility is high, it is quick to integrate；Each unit module is by event bus interface carry in event communication
On flexible bus, after third-party application system is accessed according to interface protocol, be able to achieve to visual human's image, movement, expression, sound and
The operations such as dress ornament transformation be uniformly controlled and fast integration, simultaneously because system extends visual human's interaction capabilities, user be
Interaction between system to which greatly the user experience is improved more naturally, experience.
Detailed description of the invention
Fig. 1 is the structure composition block diagram signal of visual human's interactive software bus system described in the embodiment of the present invention；
Fig. 2 is the user interface schematic diagram of preferable visual human's interactive software bus system in the embodiment of the present invention；
Fig. 3 is that the module of visual human's interactive software bus system of preferred embodiment in the embodiment of the present invention forms diagram
Meaning；
Fig. 4 is that each module event interaction of visual human's interactive software bus system of preferred embodiment in the embodiment of the present invention is closed
System's diagram meaning.
Specific embodiment
In order to enable those skilled in the art to better understand the solution of the present invention, below in conjunction in the embodiment of the present invention
Attached drawing, technical scheme in the embodiment of the invention is clearly and completely described.
In embodiments of the present invention, a kind of visual human's interactive software bus system and its implementation are provided, wherein be
System is connect with cloud server, and system realizes user for being uniformly controlled visual human's image, dress ornament, expression, movement and sound
Interaction, visual human control and the comprehensive integration of third-party application.
Embodiment one
Refering to fig. 1, system provided by the invention includes visual capacity unit, speech capability unit, emotional ability unit, determines
Plan administrative unit, visual human's engine unit and event communication flexible bus, visual capacity unit, speech capability unit, emotional ability
Unit, decision-making management unit and visual human's engine unit pass through event interaction bus interface carry on event communication flexible bus,
Event communication flexible bus is for realizing visual capacity unit, speech capability unit, emotional ability unit, decision-making management unit and void
Event of the anthropomorphic engine unit between each other based on distribution subscription mechanism interactively communicates；Visual capacity unit is for obtaining user's figure
As data, and described image data are uploaded to the cloud server and are calculated, generation Face datection, tracking, identification, personnel arrive
The events such as reach, leave；Decision-making management unit is used to manage the resource and configuration of visual human, and receives visual capacity unit, voice
The incoming event of capacity unit and emotional ability unit generates the behaviour control instruction of visual human based on the incoming event；Language
The input voice data is uploaded to cloud server for obtaining user speech input data by sound capacity unit, is realized
Understanding to user voice command meaning generates voice command input event, and according to the control instruction, generates visual human's
Voice answer-back output；Input of the emotional ability unit based on active user calculates the affective state of visual human according to the input,
Generate affective state event；Visual human's engine unit is for driving the visual animation of visual human and behavior to show.
In addition, system further includes application interface unit and user interface, application interface unit is total by event interaction
On event communication flexible bus, application interface unit is used to carry out data interaction with third-party application line interface carry；User hands over
It is provided with interface alternation interface between mutual interface and visual human's engine unit, user interface passes through with visual human's engine unit
The interface alternation interface realizes data interaction；Preferably, application interface unit and third-party application are real by TCP/IP interface
Existing data interaction；In embodiments of the present invention, it is communicatively coupled using TCP/IP as underlying protocol and third-party application, i.e.,
System receives the control instruction of third-party application, and be converted into the control event of internal system by TCP communication interface protocol.
For example, visual human's action control event, expression control event, interface information outgoing event；It is host computer by visual human's host, it is real
Existing TCP server, serve port can arrange, and for example, 7777；Third-party application system is slave computer, as TCP Client
It realizes；User interface is the UI software interface that can be interacted with visual human for being presented to user, by interface alternation interface with
The connection of visual human's engine unit, is the channel that the visual information between user and the system interacts.
Referring to Fig.2, the user interface in a kind of visual human's interactive software bus system of the embodiment of the present invention is illustrated
Figure is shown, various function buttons and time, state, the comprehensive display of Weather information including but not limited to, visual human；
By the user interface, user can take pictures to user with visual human's chat, consultation service, visual human and carry out the activity of assessment and test and entertaining
The natural interaction with visual human is realized in interaction.
In embodiments of the present invention, visual capacity unit, speech capability unit, emotional ability unit, decision-making management unit
Data interaction is realized by mutually transmitting event in event communication flexible bus with visual human's engine unit, and the event is by event
Type and message content composition, event type includes system event, vision incoming event, voice incoming event, interface alternation thing
Part, third-party application event, affective state event, voice output event, expression control event, action control event, dress ornament control
Event processed, interface information outgoing event；Wherein, message content preferentially uses character string text to carry out data interaction, character illustration and text juxtaposed setting
This is described using JSON format；Certainly, this is only preferable mode, and the interaction of data can also be realized using other modes.
Refering to Fig. 3, a kind of visual human's interactive software bus system module composition schematic diagram of present pre-ferred embodiments,
In, visual unit includes the modules such as image preprocessing, Face datection, face tracking, recognition of face, gesture identification, for obtaining
User image data input generates vision incoming event, specific event package after local calculating and cloud service are called
It includes but is not limited to that user reaches, user leaves, customer attribute information, such as whether age of user, user's gender, user wear glasses
Etc. information, user's expression, for example, the events such as expressions such as glad, sad, sad, tranquil；Voice unit includes ASR (automatic speech
Identification), semantic understanding, TTS (text voice synthesis), individual character voice convert etc. modules, for obtaining user speech input data,
Text information is converted to, is called by cloud server, understands the concrete meaning of user speech text, voice is generated and inputs thing
Part, and according to the voice output event of decision-making management unit, personalized sound is converted to, the voice answer-back as visual human is defeated
It plays out；Emotional ability unit, then can be based on the input of user's expression and speech text input currently obtained, using emotion meter
Calculation method calculates the current affective state of visual human, and generates affective state event；Decision-making management unit is used as entire virtual
The core brain of people's control manages visual human's resource in local device, configures according to the configuration management state of cloud server
And state；And the input of real-time reception vision and voice incoming event, reception affective state event, output generate the behavior of visual human
The bus events such as control instruction, including the control of action control, expression, vivid dress ornament control；Simultaneously according to operation flow demand, produce
Raw various interface information outgoing events；Visual human's engine unit, including visual human's engine, movement generation, expression generation, animation wash with watercolours
The modules such as dye composition is mainly used for receiving visual human's control instruction of decision-making management unit publication, the wash with watercolours on user interface
The animation of dye display visual human, the output display of the animations such as movement, expression, the shape of the mouth as one speaks, dress ornament including visual human；Meanwhile receiving boundary
Face information outgoing event shows various pictures, video, text, state etc. by interface alternation interface on user interface
Customer interaction information.
Specifically, the virtual artificial software robot with the virtual animating image of 2D or 3D of the invention, usually runs
On visual human's host equipment, showed in front of the user by modes such as hardware screen, projections, user can carry out with visual human
Dialogue, consulting, interaction such as are taken pictures at the natural interactions activity.Wherein, visual human's host equipment can be PC host, mobile phone,
Embedded system etc. calculates equipment；Hardware screen can be PC display, mobile phone screen, projector, LED large-size screen monitors, television set etc.
Display terminal；Cloud server is a kind of calculating service provided by distance host, and service content includes but is not limited to that face is known
Not, processing and the calculating such as gender classification, age identification, skin analysis, user speech identification, text semantic understanding.
It is of the invention to be realized between each unit based on publish/subscribe mechanism by event communication flexible bus refering to Fig. 4
Event interactively communicate；Wherein, visual capacity unit can issue vision incoming event, system event, interface information output thing
Part, ordering system event；Speech capability unit can issue voice incoming event, system event, interface information outgoing event, order
Read system event；Application interface unit can issue third-party application event, system event, delivery system event；Emotional ability
Unit can issue affective state event, system event, ordering system event；Decision-making management unit can issue virtual human action
Control event, expression control event, dress ornament control event, voice output event, interface information outgoing event, system event, order
Read voice incoming event, vision incoming event, affective state event, third-party application event etc.；System event, in the present invention
For events such as the control instructions of system unit grade, such as unit starting/stopping, location mode response, system hardware fault message.
Embodiment two
On the other hand, the present invention is based on visual human's interactive software bus systems of embodiment one to provide a kind of visual human's friendship
The implementation method of mutual software bus system, applied to above-mentioned visual human's interactive software bus system, method specifically includes as follows
Step:
S1, visual capacity unit, speech capability unit, emotional ability unit, decision-making management unit and visual human's engine list
Member, which is crossed by bus interface, to be loaded on event communication flexible bus and registers；Wherein, registration refers to that each unit module is logical in event
Believe module instance enrollment process in flexible bus, specifically, it is provided with a unit module example list in communication flexible bus, whenever
When unit module is registered, the relevant information of corresponding unit module will be added in unit module example list, complete registration；Example
Such as, visual capacity unit, in the initialization of its unit, the initialization operation interface for needing that event communication flexible bus is called to provide,
Record operation of the visual capacity unit in unit module example list is completed, the registration principle of other unit modules is identical,
This is no longer repeated.
S2, setting visual capacity unit, speech capability unit, emotional ability unit, decision-making management unit and visual human draw
The demand for holding up each unit in unit subscribes to the subscription statement that event forms corresponding each unit, and subscription statement record is stored in
In event communication flexible bus, especially by the Demand mapping relationship established between module instance list and different event type；Example
Such as, decision-making management unit subscribes to vision input by the bus events subscription operation interface for calling event communication flexible bus to provide
Event, voice incoming event, affective state event, third-party application event etc., at this point, communicating flexible bus internal record decision
Administrative unit example is to the subscription demand of the above-mentioned type event, and when system has the event of correlation type to generate, which will
It is sent in decision-making management unit and handles via communication flexible bus, the subscription statement principle of other unit modules is identical, herein not
It is repeated again.
S3, visual capacity unit, speech capability unit, emotional ability unit, decision-making management unit and visual human's engine list
Member is separately operable and issues the event, and event communication flexible bus subscribes to the relationship of statement according to each unit, distributes the event
To corresponding unit, the normal operation of the system is driven；Wherein, real-time image information is persistently obtained by visual capacity unit,
And the vision incoming event is issued, including user reaches, user leaves, user's face location, user's face character, Yong Hubiao
The events such as feelings, user gesture；Speech capability unit persistently obtains external sound signal and carries out data, obtains user speech text
Information calls cloud service, carries out semantic understanding, issues user speech incoming event；Visual human's voice output event is subscribed to, is broadcast
Report the personalized response voice of visual human；The vision incoming event and voice incoming event are subscribed to by emotional ability unit,
And the affective state event of current virtual people is issued by user interface；It is defeated that the voice is subscribed to by decision-making management unit
Incoming event, the vision incoming event and the affective state event, are uploaded to cloud server and are computed, publication visual human's control
Event and Interface Control event processed, including action control, expression control, vivid dress ornament, picture is shown, text is shown, video is shown
Show, the control instructions event such as changing interface；The control instruction of third-party application is obtained by application interface unit, issues visual human
Relevant control event and Interface Control event；By visual human's engine unit define visual human's action control, expression control,
Vivid dress ornament, interface information show event, and driving rendering engine animation is shown and interface alternation.
S4, visual capacity unit, speech capability unit, emotional ability unit, decision-making management unit and visual human's engine list
Member shows the virtual human animation and interface content by user interface.
Visual human's interactive software bus system and its implementation based on above-mentioned offer, user interact packet with visual human's
It includes: when visual human detects that user comes by visual unit, can actively smile, wave to greet, and say that " you are good, welcomes light
Face "；User and visual human carry out voice interface, for example, user inquires weather condition, say " today, how is weather? ", language at this time
When sound unit detects user speech input, user instruction text can be identified, and submit cloud service to carry out semantic understanding, and adjust
With cloud weather lookup service interface, current weather conditions are returned, then, visual human voice informing user, current weather；User
Evaluation and test is carried out with visual human to interact, for example, user says visual human: " I wants to survey the skin of today ", likewise, language
After sound unit identifies and understand the instruction of user, visual unit can guide user to shoot a mug shot, will upload to cloud,
It user's facial skin situation and is returned in cloud service analytical calculation picture, according to calculated result, visual human passes through movement, table
Feelings and voice broadcast give user " your skin condition is good, it is proposed that you keep good mood "；When user terminates interactive process, from
When opening visual human's equipment, visual human detects that user leaves, and can wave bye bye to user, and smile: " welcoming you next again
Come "；Certainly, this is only the conventional interactive process of user and visual human that visual human's interaction flexible bus system of the present invention is realized, and
It is not to the interaction summation between the achievable visual human of visual human of the present invention interaction flexible bus system and user；Meanwhile it can root
According to the difference of application scenarios, carry out distinct interaction process deletes and increases operation.
Compared with prior art, the beneficial effect of visual human's interactive software bus system of the invention and its implementation
Are as follows: the present invention has many advantages, such as that compatibility is high, it is quick to integrate；Each unit module is by event bus interface carry in event communication
On flexible bus, after third-party application system is accessed according to interface protocol, be able to achieve to visual human's image, movement, expression, sound and
The operations such as dress ornament transformation be uniformly controlled and fast integration, simultaneously because system extends visual human's interaction capabilities, user be
Interaction between system to which greatly the user experience is improved more naturally, experience.
The foregoing is merely a prefered embodiment of the invention, is not intended to limit the scope of the patents of the invention, although referring to aforementioned reality
Applying example, invention is explained in detail, still can be to aforementioned each tool for coming for those skilled in the art
Technical solution documented by body embodiment is modified, or carries out equivalence replacement to part of technical characteristic.All benefits
The equivalent structure made of description of the invention and accompanying drawing content is directly or indirectly used in other related technical areas,
Similarly within the invention patent protection scope.
Claims (7)
1. a kind of visual human's interactive software bus system, which is characterized in that the system is connect with cloud server, the system
For being uniformly controlled visual human's image, dress ornament, expression, movement and sound, user's interaction, visual human's control and third party are realized
The comprehensive integration of application, wherein the system comprises visual capacity unit, speech capability unit, emotional ability unit, decision pipes
Manage unit, visual human's engine unit and event communication flexible bus, the visual capacity unit, speech capability unit, emotional ability
Unit, decision-making management unit and visual human's engine unit are by event interaction bus interface carry in the event communication flexible bus
On, the event communication flexible bus is for realizing the visual capacity unit, speech capability unit, emotional ability unit, decision
The event of administrative unit and visual human's engine unit between each other based on distribution subscription mechanism interactively communicates；Wherein:
Visual capacity unit is uploaded to the cloud server meter for obtaining user image data, and by described image data
It calculates, generates Face datection, the events such as tracking, identification, personnel reach, leave；
Decision-making management unit for managing the resource and configuration of visual human, and receives the visual capacity unit, speech capability list
The incoming event of member and emotional ability unit generates the behaviour control instruction of visual human based on the incoming event；
Speech capability unit is uploaded to the cloud for obtaining user speech input data, and by the input voice data
Server realizes understanding to user voice command meaning, generates voice command input event, and according to the control instruction,
Generate the voice answer-back output of visual human；
Emotional ability unit, the input based on active user calculate the affective state of visual human according to the input, generate emotion
State event；
Visual human's engine unit, visual animation and behavior for driving visual human show.
2. visual human's interactive software bus system as described in claim 1, which is characterized in that the system also includes applications to connect
Mouth unit and user interface, the application interface unit are logical in the event by the event interaction bus interface carry
Believe on flexible bus, the application interface unit is used to carry out data interaction with third-party application；
Interface alternation interface, user's interaction circle are provided between the user interface and visual human's engine unit
Face and visual human's engine unit pass through interface alternation interface realization data interaction.
3. visual human's interactive software bus system as claimed in claim 2, which is characterized in that the application interface unit and institute
It states third-party application and data interaction is realized by TCP/IP interface.
4. visual human's interactive software bus system as described in claim 1, which is characterized in that the system uses character illustration and text juxtaposed setting
This progress data interaction, the character string text are described using JSON format.
5. visual human's interactive software bus system as described in claim 1, which is characterized in that it is described it is virtual artificially have 2D or
The software robot of the virtual animating image of 3D, the software robot operate in fictitious host computer equipment.
6. visual human's interactive software bus system as described in claim 1, which is characterized in that the visual capacity unit, language
Sound capacity unit, emotional ability unit, decision-making management unit and visual human's engine unit pass through in the event communication flexible bus
In mutually transmit event realize data interaction, the event is made of event type and message content, wherein the event type
Include:
System event, vision incoming event, voice incoming event, interface alternation event, third-party application event, affective state thing
Part, voice output event, expression control event, action control event, dress ornament control event, interface information outgoing event.
7. it is described in any item virtual to be applied to claim 1~6 for a kind of implementation method of visual human's interactive software bus system
People's interactive software bus system, which is characterized in that the method includes the steps:
S1, the visual capacity unit, speech capability unit, emotional ability unit, decision-making management unit and visual human's engine list
Member on the event communication flexible bus and is registered by the bus interface carry；
S2, the setting visual capacity unit, speech capability unit, emotional ability unit, decision-making management unit and visual human draw
The demand for holding up each unit in unit subscribes to the subscription statement that event forms corresponding each unit, and subscription statement record is stored in
In the event communication flexible bus；
S3, the visual capacity unit, speech capability unit, emotional ability unit, decision-making management unit and visual human's engine list
Member is separately operable and issues the event, and the event communication flexible bus subscribes to the relationship of statement according to each unit, distribution
The event drives the normal operation of the system to corresponding unit；
S4, the visual capacity unit, speech capability unit, emotional ability unit, decision-making management unit and visual human's engine list
Member shows the virtual human animation and interface content by the user interface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910167941.7A CN109917917A (en) | 2019-03-06 | 2019-03-06 | A kind of visual human's interactive software bus system and its implementation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910167941.7A CN109917917A (en) | 2019-03-06 | 2019-03-06 | A kind of visual human's interactive software bus system and its implementation |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109917917A true CN109917917A (en) | 2019-06-21 |
Family
ID=66963609
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910167941.7A Pending CN109917917A (en) | 2019-03-06 | 2019-03-06 | A kind of visual human's interactive software bus system and its implementation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109917917A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111063346A (en) * | 2019-12-12 | 2020-04-24 | 第五维度(天津)智能科技有限公司 | Cross-media star emotion accompany interaction system based on machine learning |
| CN111401921A (en) * | 2020-03-05 | 2020-07-10 | 成都威爱新经济技术研究院有限公司 | Remote customer service method based on virtual human |
| CN111443854A (en) * | 2020-03-25 | 2020-07-24 | 北京百度网讯科技有限公司 | Action processing method, device and equipment based on digital person and storage medium |
| CN112367436A (en) * | 2020-10-30 | 2021-02-12 | 深圳前海微众银行股份有限公司 | Robot voice interaction processing method and robot |
| CN113852833A (en) * | 2021-08-30 | 2021-12-28 | 阿里巴巴（中国）有限公司 | Multi-device collaborative live broadcast method and device and electronic device |
| CN113946209A (en) * | 2021-09-16 | 2022-01-18 | 南昌威爱信息科技有限公司 | Interaction method and system based on virtual human |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170177080A1 (en) * | 2013-05-20 | 2017-06-22 | Intel Corporation | Natural human-computer interaction for virtual personal assistant systems |
| CN108257218A (en) * | 2018-01-17 | 2018-07-06 | 北京网信云服信息科技有限公司 | Information interactive control method, device and equipment |
| CN108470533A (en) * | 2018-03-30 | 2018-08-31 | 南京七奇智能科技有限公司 | Enhanced smart interactive advertisement system based on visual human and device |
| CN108491147A (en) * | 2018-04-16 | 2018-09-04 | 青岛海信移动通信技术股份有限公司 | A kind of man-machine interaction method and mobile terminal based on virtual portrait |
-
2019
- 2019-03-06 CN CN201910167941.7A patent/CN109917917A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170177080A1 (en) * | 2013-05-20 | 2017-06-22 | Intel Corporation | Natural human-computer interaction for virtual personal assistant systems |
| CN108257218A (en) * | 2018-01-17 | 2018-07-06 | 北京网信云服信息科技有限公司 | Information interactive control method, device and equipment |
| CN108470533A (en) * | 2018-03-30 | 2018-08-31 | 南京七奇智能科技有限公司 | Enhanced smart interactive advertisement system based on visual human and device |
| CN108491147A (en) * | 2018-04-16 | 2018-09-04 | 青岛海信移动通信技术股份有限公司 | A kind of man-machine interaction method and mobile terminal based on virtual portrait |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111063346A (en) * | 2019-12-12 | 2020-04-24 | 第五维度(天津)智能科技有限公司 | Cross-media star emotion accompany interaction system based on machine learning |
| CN111401921A (en) * | 2020-03-05 | 2020-07-10 | 成都威爱新经济技术研究院有限公司 | Remote customer service method based on virtual human |
| CN111401921B (en) * | 2020-03-05 | 2023-04-18 | 成都威爱新经济技术研究院有限公司 | Virtual human-based remote customer service method |
| CN111443854A (en) * | 2020-03-25 | 2020-07-24 | 北京百度网讯科技有限公司 | Action processing method, device and equipment based on digital person and storage medium |
| CN111443854B (en) * | 2020-03-25 | 2022-01-18 | 北京百度网讯科技有限公司 | Action processing method, device and equipment based on digital person and storage medium |
| CN112367436A (en) * | 2020-10-30 | 2021-02-12 | 深圳前海微众银行股份有限公司 | Robot voice interaction processing method and robot |
| CN113852833A (en) * | 2021-08-30 | 2021-12-28 | 阿里巴巴（中国）有限公司 | Multi-device collaborative live broadcast method and device and electronic device |
| CN113852833B (en) * | 2021-08-30 | 2024-03-22 | 阿里巴巴（中国）有限公司 | Multi-device collaborative live broadcast method and device and electronic device |
| CN113946209A (en) * | 2021-09-16 | 2022-01-18 | 南昌威爱信息科技有限公司 | Interaction method and system based on virtual human |
| CN113946209B (en) * | 2021-09-16 | 2023-05-09 | 南昌威爱信息科技有限公司 | Interaction method and system based on virtual person |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109917917A (en) | A kind of visual human's interactive software bus system and its implementation | |
| CN110400251A (en) | Method for processing video frequency, device, terminal device and storage medium | |
| CN104780093B (en) | Expression information processing method and processing device during instant messaging | |
| Le et al. | Live speech driven head-and-eye motion generators | |
| CN108470533A (en) | Enhanced smart interactive advertisement system based on visual human and device | |
| CN104170318B (en) | Use the communication of interaction incarnation | |
| CN110413841A (en) | Polymorphic exchange method, device, system, electronic equipment and storage medium | |
| CN103368816A (en) | Instant communication method based on virtual character and system | |
| CN107340859A (en) | The multi-modal exchange method and system of multi-modal virtual robot | |
| CN106506464B (en) | A kind of toy exchange method and system based on augmented reality | |
| KR102491140B1 (en) | Method and apparatus for generating virtual avatar | |
| CN106231434A (en) | A kind of living broadcast interactive specially good effect realization method and system based on Face datection | |
| CN107197385A (en) | A kind of real-time virtual idol live broadcasting method and system | |
| CN107343225B (en) | The method, apparatus and terminal device of business object are shown in video image | |
| WO2013120851A1 (en) | Method for sharing emotions through the creation of three-dimensional avatars and their interaction through a cloud-based platform | |
| CN107632706A (en) | The application data processing method and system of multi-modal visual human | |
| TWI678628B (en) | Information Processing System | |
| CN107135387A (en) | Online Customer Reception method and its system based on VR technologies | |
| CN103517029A (en) | Data processing method of video call, terminal and system | |
| CN106471444A (en) | A kind of exchange method of virtual 3D robot, system and robot | |
| CN112839196B (en) | Method, device and storage medium for realizing online conference | |
| CN108648251A (en) | 3D expressions production method and system | |
| CN103607445A (en) | Internet of things-based digital media creation system and creation method | |
| CN105472358A (en) | Intelligent terminal about video image processing | |
| US20200412773A1 (en) | Method and apparatus for generating information |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190621 |