CN108519816A - Information processing method, device, storage medium and electronic equipment - Google Patents
Information processing method, device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN108519816A CN108519816A CN201810254545.3A CN201810254545A CN108519816A CN 108519816 A CN108519816 A CN 108519816A CN 201810254545 A CN201810254545 A CN 201810254545A CN 108519816 A CN108519816 A CN 108519816A
- Authority
- CN
- China
- Prior art keywords
- article
- voice messaging
- virtual role
- initial pictures
- information processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 43
- 238000003672 processing method Methods 0.000 title claims abstract description 30
- 238000003860 storage Methods 0.000 title claims abstract description 18
- 230000004044 response Effects 0.000 claims abstract description 16
- 238000012545 processing Methods 0.000 claims description 10
- 238000000034 method Methods 0.000 claims description 6
- 230000000694 effects Effects 0.000 abstract description 10
- 230000003993 interaction Effects 0.000 abstract description 10
- 238000010586 diagram Methods 0.000 description 11
- 230000006870 function Effects 0.000 description 8
- 230000003190 augmentative effect Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 230000033001 locomotion Effects 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 238000004519 manufacturing process Methods 0.000 description 4
- 238000012546 transfer Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 230000001815 facial effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the present application discloses a kind of information processing method, device, storage medium and electronic equipment.The information processing method creates virtual role by receiving the open command of voice service according to open command；Start the initial pictures that target camera obtains reality scene, initial pictures include meeting the first article for presetting feature；Based on the first position where the first article, the corresponding second position shows virtual role in initial pictures, to generate target picture；Target picture is updated according to the realtime graphic of reality scene acquired in target camera；The first voice messaging input by user is identified during updating target picture, and exports corresponding second voice messaging in response to the first voice messaging.The program can be that the voice service of electronic equipment configures virtual role, improve man-machine interaction effect.
Description
Technical field
This application involves fields of communication technology more particularly to a kind of information processing method, device, storage medium and electronics to set
It is standby.
Background technology
Augmented reality (Augmented Reality, AR) be it is a kind of in real time calculate camera image position and
Angle and the technology for adding respective image, video, threedimensional model.True environment and virtual object are added in real time
The same picture or space exist simultaneously, and virtual world is merged in real world and carries out interaction.With the continuous hair of science and technology
Exhibition, AR technologies are more paid close attention to by industry.
Invention content
A kind of information processing method of the embodiment of the present application offer, device, storage medium and electronic equipment, can be promoted man-machine
Interaction effect.
In a first aspect, the embodiment of the present application provides a kind of information processing method, it is applied to electronic equipment, the method packet
It includes：
The open command for receiving voice service creates virtual role according to the open command；
Start the initial pictures that target camera obtains reality scene, the initial pictures include meeting to preset feature
First article；
Based on the first position where the first article, the corresponding second position shows described virtual in the initial pictures
Role, to generate target picture；
The target picture is updated according to the realtime graphic of reality scene acquired in the target camera；
The first voice messaging input by user is identified during updating the target picture, and in response to described first
Voice messaging exports corresponding second voice messaging.
Second aspect, the embodiment of the present application provide a kind of information processing unit, are applied to electronic equipment, described device packet
It includes：
Receiving module, the open command for receiving voice service create virtual role according to the open command；
Starting module, the initial pictures of reality scene are obtained for starting target camera, and the initial pictures include
Meet the first article for presetting feature；
Display module is used for based on the first position where the first article, the corresponding second in the initial pictures
The display virtual role is set, to generate target picture；
Update module is drawn for updating the target according to the realtime graphic of reality scene acquired in the target camera
Face；
Processing module, for identifying the first voice messaging input by user during updating the target picture, and
Corresponding second voice messaging is exported in response to first voice messaging.
The third aspect is stored with a plurality of finger the embodiment of the present application also provides a kind of storage medium in the storage medium
It enables, described instruction is suitable for being loaded by processor to execute above-mentioned information processing method.
Fourth aspect, the embodiment of the present application also provides a kind of electronic equipment, including processor and memory, the processing
Device and the memory are electrically connected, and the memory is for storing instruction and data；Processor is for executing above-mentioned information
Processing method.
The embodiment of the present application discloses a kind of information processing method, device, storage medium and electronic equipment.The information processing
Method creates virtual role by receiving the open command of voice service according to open command；Start target camera to obtain now
The initial pictures of real field scape, initial pictures include meeting the first article for presetting feature；Based on first where the first article
Position, the corresponding second position shows virtual role in initial pictures, to generate target picture；It is obtained according to target camera
The realtime graphic of reality scene is taken to update target picture；The first voice input by user is identified during updating target picture
Information, and export corresponding second voice messaging in response to the first voice messaging.The program can be that the voice of electronic equipment takes
Business configuration virtual role, improves man-machine interaction effect.
Description of the drawings
In order to more clearly explain the technical solutions in the embodiments of the present application, make required in being described below to embodiment
Attached drawing is briefly described, it should be apparent that, the accompanying drawings in the following description is only some embodiments of the present application, for
For those skilled in the art, without creative efforts, it can also be obtained according to these attached drawings other attached
Figure.
Fig. 1 is the system architecture schematic diagram of information processing method provided by the embodiments of the present application.
Fig. 2 is a kind of flow diagram of information processing method provided by the embodiments of the present application.
Fig. 3 is a kind of signaling process schematic diagram of information processing method provided by the embodiments of the present application.
Fig. 4 is a kind of application example schematic diagram of information processing method provided by the embodiments of the present application.
Fig. 5 is a kind of structural schematic diagram of information processing unit provided by the embodiments of the present application.
Fig. 6 is another structural schematic diagram of information processing unit provided by the embodiments of the present application.
Fig. 7 is another structural schematic diagram of information processing unit provided by the embodiments of the present application.
Fig. 8 is the yet another construction schematic diagram of information processing unit provided by the embodiments of the present application.
Fig. 9 is a kind of structural schematic diagram of electronic equipment provided by the embodiments of the present application.
Figure 10 is another structural schematic diagram of electronic equipment provided by the embodiments of the present application.
Specific implementation mode
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application carries out clear, complete
Site preparation describes, it is clear that described embodiments are only a part of embodiments of the present application, instead of all the embodiments.It is based on
Embodiment in the application, the every other implementation that those skilled in the art are obtained without creative efforts
Example, shall fall in the protection scope of this application.
A kind of information processing method of the embodiment of the present application offer, device, storage medium and electronic equipment.Below will respectively into
Row is described in detail.
Referring to Fig. 1, Fig. 1 is the system architecture schematic diagram of information processing method provided by the embodiments of the present application.
Such as Fig. 1, electronic equipment is established with server and is communicated to connect by wireless network or data network.Work as electronic equipment
The camera for when receiving the open command of voice service, creating virtual role, while starting electronic equipment obtains current display
The initial pictures of scene, and include being increased with generating on the specific position of the initial pictures by the virtual role created
Strong reality picture.Then, according to the real-time scene image update of the camera acquisition augmented reality picture, according to real-time scene figure
The change of article as in and adjust the display location of virtual role in real time.
During updating augmented reality picture, electronic equipment can receive the first voice messaging input by user.Then,
Electronic equipment can parse first voice messaging, be identified, and the communications conduit by being established between server to
Server sends the content after parsing, so that server searches corresponding response according in the parsed content to database
Data, and the reply data is returned into electronic equipment.Electronic equipment generates the second voice letter according to the reply data received
Breath, and export.During exporting the second voice messaging, the display of virtual role is adjusted according to the content of the second voice messaging
State (such as nozzle type, limb action), to build a kind of illusion made a sound by virtual role.
Wherein, it can be, but not limited between electronic equipment and server using any one of following transport protocol：HTTP
(Hypertext transfer protocol, hypertext transfer protocol), FTP (File Transfer Protocol, file
Transport protocol), P2P (Peer to Peer, peer-to-peer network), P2SP (Peer to Server＆Peer, put to server and point)
Deng.
Electronic equipment can be mobile terminal, such as mobile phone, tablet computer, laptop, and the embodiment of the present application is to this
Without limiting.
In one embodiment, a kind of information processing method is provided, as shown in Fig. 2, flow can be as follows：
101, the open command for receiving voice service creates virtual role according to open command.
Wherein, the voice service in electronic equipment can be voice assistant, be a intelligent electronic apparatus application, lead to
The intelligent interaction of Intelligent dialogue and instant question and answer is crossed, realizes that help user solves the problems, such as.
In the embodiment of the present application, triggering receive voice service open command mode can there are many.For example, can be
One trigger control is set on the display interface of electronic equipment, reception voice service can be triggered by clicking the trigger control side
Open command；For another example, it can trigger and receive by the secondary or physical bond (such as main screen key) or virtual key on long-press electronic equipment
The open command of voice service.
It should be noted that the virtual role created show form can there are many.For example, can be cartoon figure
Threedimensional model, can also be animal threedimensional model, or can also be other with facial characteristics (such as eyes, face, nose
Son etc.) any form object.
102, start the initial pictures that target camera obtains reality scene, which includes meeting to preset feature
The first article.
Specifically, after creating completion virtual role, electronic equipment can be with automatic trigger image acquisition instruction.Then basis
The image acquisition instruction starts camera built-in in electronic equipment, and obtains present reality by the camera function of the camera
The image of scene, the initial pictures as display scene.
Wherein, the article for having and meeting and presetting feature is included at least in initial pictures.In practical application, which can be with
By production, manufacturer is set, and can be the feature-set on shape, color, structure and/or texture, for example be set as having
Quadrupedal article (such as desk, chair).In addition, can also include in the initial pictures other multiple people/or object and other
The entities such as natural resources, product.
When it is implemented, the article in the initial pictures can be identified in electronic equipment, it is determined whether there is satisfaction
The article of default feature.Electronic equipment will prompt user to be unsatisfactory for use condition if being not present, or execute other automatically
Substitute scheme.
103, based on the first position where the first article, the corresponding second position shows the virtual angle in initial pictures
Color, to generate target picture.
Specifically, according to the first position where the first article, to determine that virtual role correspondence in initial pictures need to be shown
The second position shown.In some embodiments, step is " based on the first position where the first article, in the initial pictures
The corresponding second position shows the virtual role " may include following below scheme：
Identify the first form of the first article；
First position where determining the first article in initial pictures according to the first form；
The corresponding second position is determined in initial pictures based on first position；
The virtual role is shown in the second place.
Wherein, the first form is specifically as follows the shape of article, by identifying the shape of article, can be precisely calculated
Go out the information such as article position size shared in initial pictures and coordinate.Then, in the specifying information that first position is determined
Afterwards, the second position that virtual role need to be shown is determined based on these information.
It in some embodiments, can be with step " based on first position in initial graph in order to enable display effect is truer
The corresponding second position is determined as in " may include following below scheme：
Determine the second form of virtual role；
Identify the marginal information of first position；
Based on the second form and marginal information, the corresponding second position is determined in initial pictures using preset rules.
Wherein, the second form is specifically as follows the information such as shape, texture, color and the space structure of virtual role.
The marginal information for identifying first position, may be used image processing algorithm, calculates the marginal information of first position.It is then based on
Second form of virtual role and the marginal information of first position, by preset rules, determination needs to show in initial pictures
The second position of virtual role.
It should be noted that preset rules can be set by production manufacturer or programming personnel.For example, can
According to the difference of the color of the first article and/or shape, virtual role to be shown on the different location of first article, or
Different movement locus is set for the virtual role.Such as when the first item color is red, based on the second form, Yi Jibian
Virtual role is shown in the top of the first article by edge information.For another example, when the shape of the second article is a spherical shape, if
Determine virtual role to enclose around the second article periphery one, during which can be based on the second form and marginal information sets movement locus,
The display effect of picture is collided and influenced to avoid the second article and virtual role.
104, target picture is updated according to the realtime graphic of reality scene acquired in target camera.
When it is implemented, since electronic equipment can move, the image of reality scene acquired in camera is caused also to be sent out
Changing, therefore, it is necessary to the realtime graphic according to reality scene acquired in target camera, adjustment update target pictures.That is,
In some embodiments, step " updating target picture according to the realtime graphic of reality scene acquired in target camera " can wrap
Include following below scheme：
The realtime graphic of reality scene is obtained by target camera；
Whether judge in realtime graphic comprising the second article for meeting default feature；
If so, the display location of virtual role is adjusted according to the position where the second article, to update target picture.
Specifically, when occurring meeting the second article for presetting feature in the realtime graphic for recognizing reality scene, it is adjustable
The dispaly state (including display location and display posture) of whole virtual role.Period need to determine the second confidence of the second article
Breath, the equally shape information based on second position information and virtual role, display position of the adjustment virtual role in real-time scene
It sets, to update target picture.
105, the first voice messaging input by user is identified during updating target picture, and in response to the first voice
Information exports corresponding second voice messaging.
In the embodiment of the present application, realize output the second voice messaging mode can there are many.For example, can be by electronics
Equipment itself executes all operationss during speech signal analysis.That is, in some embodiments, step is " in more fresh target
The first voice messaging input by user is identified during picture, and exports corresponding second voice in response to the first voice messaging
Information " may include following below scheme：
During updating target picture, the first voice messaging input by user is received；
Voice messaging is parsed, identifies voice content entrained by the first voice messaging；
Corresponding reply data is matched from presetting database according to voice content；
The second voice messaging is generated based on reply data and is exported.
Wherein, presetting database can be stored in the storage region of electronic equipment local.It, can by speech recognition algorithm
The voice content in the first voice messaging to be identified, then from search, matching in presetting database in the voice
The reply data of appearance.Finally, it based on the reply data being matched to, is converted the second voice messaging of generation and is output to the external world.
During exporting the second voice messaging, dispaly state (such as mouth of virtual role is adjusted according to the content of the second voice messaging
Type, limb action), to build a kind of illusion made a sound by virtual role.
In addition, in order to reduce the load of processor in electronic equipment, in some embodiments, can also be executed by server
Share search, the matching operation of voice messaging.Specifically, during updating augmented reality picture, electronic equipment can receive
First voice messaging input by user.Then, electronic equipment can parse first voice messaging, be identified, and pass through
The communications conduit established between server sends the content after parsing to server, so that server is parsed according to this
Corresponding reply data is searched in content to database, and the reply data is returned into electronic equipment.Electronic equipment is according to connecing
The reply data received generates the second voice messaging, and exports.During exporting the second voice messaging, according to the second voice
The dispaly state (such as nozzle type, limb action) of the content adjustment virtual role of information, is sent out to build one kind by virtual role
Go out the illusion of sound.
From the foregoing, it will be observed that the application is the information processing method that embodiment provides, by receiving the open command of voice service,
Virtual role is created according to open command, then the initial pictures of startup target camera acquisition reality scene, in initial pictures
Include meeting the first article for presetting feature, and based on the first position where the first article, corresponding the in initial pictures
Two positions show virtual role, to generate target picture.Then according to the realtime graphic of reality scene acquired in target camera
Target picture is updated, the first voice messaging input by user is identified during updating target picture, and in response to the first language
Message breath exports corresponding second voice messaging.The program can be that the voice service of electronic equipment configures virtual role, be promoted
Man-machine interaction effect.
In one embodiment, another information processing method is also provided, as shown in figure 3, flow can be as follows：
201, electronic equipment receives the open command of voice service, and virtual role is created according to open command.
Wherein, the voice service in electronic equipment can be voice assistant, be a intelligent electronic apparatus application, lead to
The intelligent interaction of Intelligent dialogue and instant question and answer is crossed, realizes that help user solves the problems, such as.And the virtual role that is created shows
Form can there are many.For example, can be the threedimensional model of cartoon figure, it can also be the threedimensional model of animal, or may be used also
Think other any form objects with facial characteristics (such as eyes, face, nose).
When it is implemented, a trigger control can be arranged on the display interface of electronic equipment, by clicking the triggering
Control side can trigger the open command for receiving voice service.
202, electronic equipment starts the initial pictures that target camera obtains reality scene, which includes meeting
First article of default feature.
After creating completion virtual role, electronic equipment can be with automatic trigger image acquisition instruction.Then according to the image
Acquisition instruction starts camera built-in in electronic equipment, and obtains present reality scene by the camera function of the camera
Image, the initial pictures as display scene.
When it is implemented, the article in the initial pictures can be identified in electronic equipment, it is determined whether there is satisfaction
The article of default feature.In practical application, which can be set by production manufacturer, can be shape, face
Feature-set on color, structure and/or texture, for example it is set as having quadrupedal article (such as desk, chair).In addition, this is first
Can also include other multiple people/or the entities such as object and other natural resources, product in beginning image
203, electronic equipment identifies the first form of the first article, and determines the first article in initial graph according to the first form
First position where as in.
Wherein, the first form is specifically as follows the shape of article, by identifying the shape of article, can be precisely calculated
Go out the information such as article position size shared in initial pictures and coordinate.
204, electronic equipment determines the second form of virtual role and identifies the marginal information of first position.
Wherein, the second form is specifically as follows the information such as shape, texture, color and the space structure of virtual role.
The marginal information for identifying first position, may be used image processing algorithm, calculates the marginal information of first position.
205, electronic equipment is based on the second form and marginal information, using preset rules determining pair in initial pictures
The second position answered, and show the virtual role in the second place.
It should be noted that preset rules can be set by production manufacturer or programming personnel.For example, can
According to the difference of the color of the first article and/or shape, virtual role to be shown on the different location of first article, or
Different movement locus is set for the virtual role.Such as when the first item color is red, based on the second form, Yi Jibian
Virtual role is shown in the top of the first article by edge information.For another example, when the shape of the second article is a spherical shape, if
Determine virtual role to enclose around the second article periphery one, during which can be based on the second form and marginal information sets movement locus,
The display effect of picture is collided and influenced to avoid the second article and virtual role.
206, electronic equipment obtains the realtime graphic of reality scene by target camera.
When it is implemented, since electronic equipment can move, the image of reality scene acquired in camera is caused also to be sent out
Changing, therefore, it is necessary to the realtime graphics according to reality scene acquired in target camera, are drawn subsequently to adjust more fresh target
Face.
207, whether electronic equipment judges in realtime graphic comprising the second article for meeting default feature；If so, executing step
Rapid 208, if otherwise terminating flow.
Specifically, image recognition algorithm may be used, it is special by acquiring the color characteristic of article, texture in realtime graphic
Sign, shape feature and spatial structure characteristic etc. further confirm that the second article with the presence or absence of the condition that meets.
208, electronic equipment adjusts the display location of virtual role according to the position where the second article, is drawn with more fresh target
Face.
Specifically, when occurring meeting the second article for presetting feature in the realtime graphic for recognizing reality scene, it is adjustable
The dispaly state (including display location and display posture) of whole virtual role.Period need to determine the second confidence of the second article
Breath, the equally shape information based on second position information and virtual role, display position of the adjustment virtual role in real-time scene
It sets, to update target picture
209, the first voice messaging input by user is identified during updating target picture, and in response to the first voice
Information exports corresponding second voice messaging.
Specifically, during updating target picture, can be received by the microphone in electronic equipment input by user
First voice messaging.Then, it is based on speech recognition algorithm, the first voice messaging of input is parsed, to identify the first language
The entrained voice content of message breath.Then, it according to the voice content identified, is searched for from presetting database, matching is directed to
The reply data of the voice content, then based on the reply data being matched to, be converted the second voice messaging of generation and be output to
It is extraneous.
With reference to figure 4, under a reality scene, electronic equipment obtains the realtime graphic of reality scene, and it is default to recognize satisfaction
The article A (chair i.e. in figure) of feature.Then the virtual role S created is shown in the top position of article A.One
In a little embodiments, virtual role can be adjusted according to the content of the second voice messaging during exporting the second voice messaging
Dispaly state (such as nozzle type, limb action), to build a kind of illusion made a sound by virtual role.
From the foregoing, it will be observed that information processing method provided by the embodiments of the present application, can be that the voice service of electronic equipment configures
Then virtual role exports corresponding response voice messaging according to voice content input by user, and lip-sync by virtual role
It sends out, builds a kind of illusion made a sound by virtual role, improve man-machine interaction effect.
In the another embodiment of the application, also provide a kind of information processing unit, the information processing unit can with software or
The form of hardware is integrated in the electronic device, which can specifically include mobile phone, tablet computer, laptop etc. and set
It is standby.As shown in figure 5, the information processing unit 300 may include receiving module 31, starting module 32, display module 33, update mould
Block 34 and processing module 35, wherein：
Receiving module 31, the open command for receiving voice service create virtual role according to the open command；
Starting module 32 obtains the initial pictures of reality scene for starting target camera, is wrapped in the initial pictures
Include the first article for meeting and presetting feature；
Display module 33 is used for based on the first position where the first article, the corresponding second in the initial pictures
It sets and shows the virtual role, to generate target picture；
Update module 34 is drawn for updating the target according to the realtime graphic of reality scene acquired in the target camera
Face；
Processing module 35, for identifying the first voice messaging input by user during updating the target picture, and
Corresponding second voice messaging is exported in response to first voice messaging.
In some embodiments, with reference to figure 6, which may include：
Identify submodule 331, for identification the first form of first article；
First determination sub-module 332, for determining first article place in initial pictures according to first form
First position；
Second determination sub-module 333, for determining the corresponding second position in the initial pictures based on the first position；
Display sub-module 334, for showing the virtual role in the second place.
In some embodiments, with reference to figure 7, which may include：
Acquisition submodule 341, the realtime graphic for obtaining reality scene by the target camera；
Judging submodule 342, for whether judging in the realtime graphic comprising the second article for meeting the default feature；
Submodule 343 is adjusted, if be judged to being for judging submodule, the position adjustment where second article
The display location of the virtual role, to update the target picture.
In some embodiments, with reference to figure 8, which may include：
Word modules 351 are inputted, for during updating the target picture, receiving the first voice letter input by user
Breath；
Analyzing sub-module 352 is identified for being parsed to the voice messaging in voice entrained by first voice messaging
Hold；
Matched sub-block 353, for matching corresponding reply data from presetting database according to the voice content；
Output sub-module 354, for being based on reply data the second voice messaging of generation and exporting.
From the foregoing, it will be observed that information processing unit provided by the embodiments of the present application, by receiving the open command of voice service, root
Virtual role is created according to open command；Start the initial pictures that target camera obtains reality scene, initial pictures include full
First article of the default feature of foot；Based on the first position where the first article, the corresponding second position is aobvious in initial pictures
Show virtual role, to generate target picture；Target picture is updated according to the realtime graphic of reality scene acquired in target camera；
The first voice messaging input by user is identified during updating target picture, and is answered in response to the first voice messaging the output phase
The second voice messaging.The program can be that the voice service of electronic equipment configures virtual role, improve man-machine interaction effect.
A kind of electronic equipment is also provided in the another embodiment of the application, which can be smart mobile phone, tablet
Apparatus such as computer.As shown in figure 9, electronic equipment 400 includes processor 401 and memory 402.Wherein, processor 401 and storage
Device 402 is electrically connected.
Processor 401 is the control centre of electronic equipment 400, utilizes various interfaces and the entire electronic equipment of connection
Various pieces by the application of operation or load store in memory 402, and call the number being stored in memory 402
According to, execute electronic equipment various functions and processing data, to electronic equipment carry out integral monitoring.
In the present embodiment, processor 401 in electronic equipment 400 can according to following step, by one or one with
On the corresponding instruction of process of application be loaded into memory 402, and be stored in memory 402 by processor 401 to run
In application, to realize various functions：
The open command for receiving voice service creates virtual role according to the open command；
Start the initial pictures that target camera obtains reality scene, which includes meet default feature the
One article；
Based on the first position where the first article, the corresponding second position shows the virtual angle in the initial pictures
Color, to generate target picture；
The target picture is updated according to the realtime graphic of reality scene acquired in the target camera；
The first voice messaging input by user is identified during updating the target picture, and in response to first voice
Information exports corresponding second voice messaging.
In some embodiments, processor 401 can further execute following operation：
Identify the first form of first article；
First position where determining first article in initial pictures according to first form；
The corresponding second position is determined in the initial pictures based on the first position；
The virtual role is shown in the second place.
In some embodiments, processor 401 can further execute following operation：
Determine the second form of the virtual role；
Identify the marginal information of the first position；
Based on second form and the marginal information, corresponding the is determined in the initial pictures using preset rules
Two positions.
In some embodiments, processor 401 can further execute following operation：
The realtime graphic of reality scene is obtained by the target camera；
Whether judge in the realtime graphic comprising the second article for meeting the default feature；
If so, the display location of the virtual role is adjusted according to the position where second article, to update the target
Picture.
In some embodiments, during updating the target picture, processor 401 can further execute following behaviour
Make：
Receive the first voice messaging input by user；
The voice messaging is parsed, identifies voice content entrained by first voice messaging；
Corresponding reply data is matched from presetting database according to the voice content；
The second voice messaging is generated based on reply data and is exported.
Memory 402 can be used for storing application and data.Including in the application that memory 402 stores can be in the processor
The instruction of execution.Using various functions module can be formed.Processor 401 is stored in the application of memory 402 by operation, from
And perform various functions application and data processing.
In some embodiments, as shown in Figure 10, electronic equipment 400 further includes：Display screen 403, is penetrated at control circuit 404
Frequency circuit 405, input unit 406, voicefrequency circuit 407, sensor 408 and power supply 409.Wherein, processor 401 respectively with it is aobvious
Display screen 403, control circuit 404, radio circuit 405, input unit 406, voicefrequency circuit 407, sensor 408 and power supply 409
It is electrically connected.
Display screen 403 can be used for showing information input by user or be supplied to user information and electronic equipment it is each
Kind graphical user interface, these graphical user interface can be made of image, text, icon, video and its arbitrary combination.
Control circuit 404 is electrically connected with display screen 403, and information is shown for control display screen 403.
Radio circuit 405 is used for transceiving radio frequency signal, to be built by radio communication with the network equipment or other electronic equipments
Vertical wireless telecommunications, the receiving and transmitting signal between the network equipment or other electronic equipments.
Input unit 406 can be used for receiving number, character information or the user's characteristic information (such as fingerprint) of input, and
Generate keyboard related with user setting and function control, mouse, operating lever, optics or the input of trace ball signal.Wherein,
Input unit 406 may include fingerprint recognition module.
Voicefrequency circuit 407 can provide the audio interface between user and electronic equipment by loud speaker, microphone.
Sensor 408 is for acquiring external environmental information.Sensor 408 may include ambient light sensor, acceleration
Sensor, optical sensor, motion sensor and other sensors.
All parts of the power supply 409 for electron equipment 400 are powered.In some embodiments, power supply 409 can pass through
Power-supply management system and processor 401 are logically contiguous, to realize management charging, electric discharge, Yi Jigong by power-supply management system
The functions such as consumption management.
Although being not shown in Figure 10, electronic equipment 400 can also include camera, bluetooth module etc., and details are not described herein.
From the foregoing, it will be observed that electronic equipment provided by the embodiments of the present application, by receiving the open command of voice service, according to opening
It opens instruction and creates virtual role；Start the initial pictures that target camera obtains reality scene, initial pictures include meeting in advance
If the first article of feature；Based on the first position where the first article, corresponding second position display is empty in initial pictures
Quasi- role, to generate target picture；Target picture is updated according to the realtime graphic of reality scene acquired in target camera；More
Identify the first voice messaging input by user during fresh target picture, and in response to the first voice messaging output corresponding the
Two voice messagings.The program can be that the voice service of electronic equipment configures virtual role, improve man-machine interaction effect.
In some embodiments, a kind of storage medium is additionally provided, a plurality of instruction is stored in the storage medium, the instruction
Suitable for being loaded by processor to execute any of the above-described information processing method.
One of ordinary skill in the art will appreciate that all or part of step in the various methods of above-described embodiment is can
It is completed with instructing relevant hardware by program, which can be stored in a computer readable storage medium, storage
Medium may include：Read-only memory (ROM, Read Only Memory), random access memory (RAM, Random
Access Memory), disk or CD etc..
Term " one " and " described " and similar word have been used during describing the concept of the application (especially
In the appended claims), it should be construed to not only cover odd number by these terms but also cover plural number.In addition, unless herein
In be otherwise noted, otherwise herein narration numberical range when merely by quick method belong to the every of relevant range to refer to
A independent value, and each independent value is incorporated into this specification, just as these values have individually carried out statement one herein
Sample.In addition, unless otherwise stated herein or context has specific opposite prompt, otherwise institute described herein is methodical
Step can be executed by any appropriate order.The change of the application is not limited to the step of description sequence.Unless in addition
Advocate, otherwise uses any and all example or exemplary language presented herein (for example, " such as ") to be all only
The concept of the application is better described, and not the range of the concept of the application limited.Spirit and model are not being departed from
In the case of enclosing, those skilled in the art becomes readily apparent that a variety of modifications and adaptation.
Information processing method, device, storage medium and the electronic equipment provided above the embodiment of the present application carries out
It is discussed in detail, specific examples are used herein to illustrate the principle and implementation manner of the present application, above example
Illustrate to be merely used to help understand the present processes and its core concept；Meanwhile for those skilled in the art, according to this
The thought of application, there will be changes in the specific implementation manner and application range, in conclusion the content of the present specification is not answered
It is interpreted as the limitation to the application.
Claims (11)
1. a kind of information processing method is applied to electronic equipment, which is characterized in that the method includes：
The open command for receiving voice service creates virtual role according to the open command；
Start the initial pictures that target camera obtains reality scene, the initial pictures include meeting preset feature first
Article；
Based on the first position where the first article, the corresponding second position shows the virtual angle in the initial pictures
Color, to generate target picture；
The target picture is updated according to the realtime graphic of reality scene acquired in the target camera；
The first voice messaging input by user is identified during updating the target picture, and in response to first voice
Information exports corresponding second voice messaging.
2. information processing method according to claim 1, which is characterized in that first based on where the first article
It sets, the corresponding second position shows the virtual role in the initial pictures, including：
Identify the first form of first article；
First position where determining first article in initial pictures according to first form；
The corresponding second position is determined in the initial pictures based on the first position；
The virtual role is shown in the second place.
3. information processing method according to claim 2, which is characterized in that described to be based on the first position described first
The corresponding second position is determined in beginning image, including：
Determine the second form of the virtual role；
Identify the marginal information of the first position；
Based on second form and the marginal information, using preset rules, determination is corresponding in the initial pictures
The second position.
4. information processing method according to claim 1, which is characterized in that described according to acquired in the target camera
The realtime graphic of reality scene updates the target picture, including：
The realtime graphic of reality scene is obtained by the target camera；
Whether judge in the realtime graphic comprising the second article for meeting the default feature；
If so, the display location of the virtual role is adjusted according to the position where second article, to update the mesh
Mark picture.
5. according to claim 1-4 any one of them information processing methods, which is characterized in that described to update the target picture
The first voice messaging input by user is identified during face, and exports corresponding second language in response to first voice messaging
Message ceases, including：
During updating the target picture, the first voice messaging input by user is received；
The voice messaging is parsed, identifies voice content entrained by first voice messaging；
Corresponding reply data is matched from presetting database according to the voice content；
The second voice messaging is generated based on reply data and is exported.
6. a kind of information processing unit is applied to electronic equipment, including：
Receiving module, the open command for receiving voice service create virtual role according to the open command；
Starting module, the initial pictures of reality scene are obtained for starting target camera, and the initial pictures include meeting
First article of default feature；
Display module, for based on the first position where the first article, the corresponding second position to be aobvious in the initial pictures
Show the virtual role, to generate target picture；
Update module, for updating the target picture according to the realtime graphic of reality scene acquired in the target camera；
Processing module for identifying the first voice messaging input by user during updating the target picture, and responds
Corresponding second voice messaging is exported in first voice messaging.
7. information processing unit according to claim 6, which is characterized in that the display module includes：
Identify submodule, for identification the first form of first article；
First determination sub-module, for first where determining first article in initial pictures according to first form
Position；
Second determination sub-module, for determining the corresponding second position in the initial pictures based on the first position；
Display sub-module, for showing the virtual role in the second place.
8. information processing unit according to claim 6, which is characterized in that the update module includes：
Acquisition submodule, the realtime graphic for obtaining reality scene by the target camera；
Judging submodule, for whether judging in the realtime graphic comprising the second article for meeting the default feature；
Submodule is adjusted, if be judged to being for judging submodule, described in the position adjustment where second article
The display location of virtual role, to update the target picture.
9. according to claim 6-8 any one of them information processing units, which is characterized in that the processing module includes：
Word modules are inputted, for during updating the target picture, receiving the first voice messaging input by user；
Analyzing sub-module identifies voice content entrained by first voice messaging for being parsed to the voice messaging；
Matched sub-block, for matching corresponding reply data from presetting database according to the voice content；
Output sub-module, for being based on reply data the second voice messaging of generation and exporting.
10. a kind of storage medium, which is characterized in that be stored with a plurality of instruction in the storage medium, described instruction be suitable for by
Device load is managed to execute information processing method according to any one of claims 1-5.
11. a kind of electronic equipment, which is characterized in that including processor and memory, the processor and the memory are electrical
Connection, the memory is for storing instruction and data；The processor is for executing according to any one of claim 1-5 institutes
The information processing method stated.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810254545.3A CN108519816A (en) | 2018-03-26 | 2018-03-26 | Information processing method, device, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810254545.3A CN108519816A (en) | 2018-03-26 | 2018-03-26 | Information processing method, device, storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108519816A true CN108519816A (en) | 2018-09-11 |
Family
ID=63434420
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810254545.3A Pending CN108519816A (en) | 2018-03-26 | 2018-03-26 | Information processing method, device, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108519816A (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109542557A (en) * | 2018-10-31 | 2019-03-29 | 维沃移动通信有限公司 | A kind of interface display method and terminal device |
| CN110070481A (en) * | 2019-03-13 | 2019-07-30 | 北京达佳互联信息技术有限公司 | Image generating method, device, terminal and the storage medium of virtual objects for face |
| CN111047384A (en) * | 2018-10-15 | 2020-04-21 | 北京京东尚科信息技术有限公司 | Information processing method of intelligent device and intelligent device |
| CN111079496A (en) * | 2019-06-09 | 2020-04-28 | 广东小天才科技有限公司 | Display method of click-to-read state and electronic equipment |
| CN111323007A (en) * | 2020-02-12 | 2020-06-23 | 北京市商汤科技开发有限公司 | Positioning method and device, electronic equipment and storage medium |
| CN111324329A (en) * | 2018-12-17 | 2020-06-23 | 上海博泰悦臻电子设备制造有限公司 | Vehicle and voice interaction method and system based on article display information |
| CN111860252A (en) * | 2020-07-09 | 2020-10-30 | 北京市商汤科技开发有限公司 | Image processing method, apparatus and storage medium |
| CN111862341A (en) * | 2020-07-09 | 2020-10-30 | 北京市商汤科技开发有限公司 | Virtual object driving method and device, display equipment and computer storage medium |
| CN112689854A (en) * | 2018-11-30 | 2021-04-20 | 多玩国株式会社 | Moving picture composition device, moving picture composition method, and recording medium |
| CN113313839A (en) * | 2021-05-27 | 2021-08-27 | 百度在线网络技术（北京）有限公司 | Information display method, device, equipment, storage medium and program product |
| CN113327311A (en) * | 2021-05-27 | 2021-08-31 | 百度在线网络技术（北京）有限公司 | Virtual character based display method, device, equipment and storage medium |
| CN113742460A (en) * | 2020-05-28 | 2021-12-03 | 华为技术有限公司 | Method and device for generating virtual role |
| CN114115528A (en) * | 2021-11-02 | 2022-03-01 | 深圳市雷鸟网络传媒有限公司 | Virtual object control method and device, computer equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104740869A (en) * | 2015-03-26 | 2015-07-01 | 北京小小牛创意科技有限公司 | True environment integrated and virtuality and reality combined interaction method and system |
| KR20160103897A (en) * | 2015-02-25 | 2016-09-02 | 이은미 | System for augmented reality image display and method for augmented reality image display |
| CN106492461A (en) * | 2016-09-13 | 2017-03-15 | 广东小天才科技有限公司 | A kind of implementation method of augmented reality AR game and device, user terminal |
| CN106683194A (en) * | 2016-12-13 | 2017-05-17 | 安徽乐年健康养老产业有限公司 | Augmented reality medical communication system |
| CN106802716A (en) * | 2016-12-30 | 2017-06-06 | 维沃移动通信有限公司 | The data processing method and virtual reality terminal of a kind of virtual reality terminal |
| CN107016733A (en) * | 2017-03-08 | 2017-08-04 | 北京光年无限科技有限公司 | Interactive system and exchange method based on augmented reality AR |
| CN107045844A (en) * | 2017-04-25 | 2017-08-15 | 张帆 | A kind of landscape guide method based on augmented reality |
| CN107451207A (en) * | 2017-07-11 | 2017-12-08 | 河南书网教育科技股份有限公司 | Interactive books interaction systems and method |
-
2018
- 2018-03-26 CN CN201810254545.3A patent/CN108519816A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20160103897A (en) * | 2015-02-25 | 2016-09-02 | 이은미 | System for augmented reality image display and method for augmented reality image display |
| CN104740869A (en) * | 2015-03-26 | 2015-07-01 | 北京小小牛创意科技有限公司 | True environment integrated and virtuality and reality combined interaction method and system |
| CN106492461A (en) * | 2016-09-13 | 2017-03-15 | 广东小天才科技有限公司 | A kind of implementation method of augmented reality AR game and device, user terminal |
| CN106683194A (en) * | 2016-12-13 | 2017-05-17 | 安徽乐年健康养老产业有限公司 | Augmented reality medical communication system |
| CN106802716A (en) * | 2016-12-30 | 2017-06-06 | 维沃移动通信有限公司 | The data processing method and virtual reality terminal of a kind of virtual reality terminal |
| CN107016733A (en) * | 2017-03-08 | 2017-08-04 | 北京光年无限科技有限公司 | Interactive system and exchange method based on augmented reality AR |
| CN107045844A (en) * | 2017-04-25 | 2017-08-15 | 张帆 | A kind of landscape guide method based on augmented reality |
| CN107451207A (en) * | 2017-07-11 | 2017-12-08 | 河南书网教育科技股份有限公司 | Interactive books interaction systems and method |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111047384A (en) * | 2018-10-15 | 2020-04-21 | 北京京东尚科信息技术有限公司 | Information processing method of intelligent device and intelligent device |
| CN109542557A (en) * | 2018-10-31 | 2019-03-29 | 维沃移动通信有限公司 | A kind of interface display method and terminal device |
| CN112689854A (en) * | 2018-11-30 | 2021-04-20 | 多玩国株式会社 | Moving picture composition device, moving picture composition method, and recording medium |
| CN111324329A (en) * | 2018-12-17 | 2020-06-23 | 上海博泰悦臻电子设备制造有限公司 | Vehicle and voice interaction method and system based on article display information |
| CN110070481A (en) * | 2019-03-13 | 2019-07-30 | 北京达佳互联信息技术有限公司 | Image generating method, device, terminal and the storage medium of virtual objects for face |
| CN111079496A (en) * | 2019-06-09 | 2020-04-28 | 广东小天才科技有限公司 | Display method of click-to-read state and electronic equipment |
| CN111079496B (en) * | 2019-06-09 | 2023-05-26 | 广东小天才科技有限公司 | Click-to-read state display method and electronic equipment |
| CN111323007A (en) * | 2020-02-12 | 2020-06-23 | 北京市商汤科技开发有限公司 | Positioning method and device, electronic equipment and storage medium |
| CN113742460A (en) * | 2020-05-28 | 2021-12-03 | 华为技术有限公司 | Method and device for generating virtual role |
| CN113742460B (en) * | 2020-05-28 | 2024-03-29 | 华为技术有限公司 | Method and device for generating virtual roles |
| CN111862341A (en) * | 2020-07-09 | 2020-10-30 | 北京市商汤科技开发有限公司 | Virtual object driving method and device, display equipment and computer storage medium |
| CN111860252A (en) * | 2020-07-09 | 2020-10-30 | 北京市商汤科技开发有限公司 | Image processing method, apparatus and storage medium |
| CN113313839A (en) * | 2021-05-27 | 2021-08-27 | 百度在线网络技术（北京）有限公司 | Information display method, device, equipment, storage medium and program product |
| CN113327311A (en) * | 2021-05-27 | 2021-08-31 | 百度在线网络技术（北京）有限公司 | Virtual character based display method, device, equipment and storage medium |
| CN113327311B (en) * | 2021-05-27 | 2024-03-29 | 百度在线网络技术（北京）有限公司 | Virtual character-based display method, device, equipment and storage medium |
| CN114115528A (en) * | 2021-11-02 | 2022-03-01 | 深圳市雷鸟网络传媒有限公司 | Virtual object control method and device, computer equipment and storage medium |
| CN114115528B (en) * | 2021-11-02 | 2024-01-19 | 深圳市雷鸟网络传媒有限公司 | Virtual object control method, device, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108519816A (en) | Information processing method, device, storage medium and electronic equipment | |
| US20210383586A1 (en) | Artificial intelligence-based animation character drive method and related apparatus | |
| CN108520552A (en) | Image processing method, device, storage medium and electronic equipment | |
| CN108525305B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| CN110400251A (en) | Method for processing video frequency, device, terminal device and storage medium | |
| CN111046150A (en) | Human-computer interaction processing system and method, storage medium and electronic device | |
| CN109521927B (en) | Robot interaction method and equipment | |
| CN111240777B (en) | Dynamic wallpaper generation method and device, storage medium and electronic equipment | |
| KR102491140B1 (en) | Method and apparatus for generating virtual avatar | |
| CN110555507B (en) | Interaction method and device for virtual robot, electronic equipment and storage medium | |
| WO2017084483A1 (en) | Video call method and device | |
| CN108563327B (en) | Augmented reality method, device, storage medium and electronic equipment | |
| CN110557699B (en) | Intelligent sound box interaction method, device, equipment and storage medium | |
| CN111240774B (en) | Dynamic wallpaper generation method and device, storage medium and electronic equipment | |
| CN113362263A (en) | Method, apparatus, medium, and program product for changing the image of a virtual idol | |
| EP4287068A1 (en) | Model training method, scene recognition method, and related device | |
| CN110794964A (en) | Interaction method and device for virtual robot, electronic equipment and storage medium | |
| US20230107213A1 (en) | Method of generating virtual character, electronic device, and storage medium | |
| CN112206517A (en) | Rendering method, device, storage medium and computer equipment | |
| CN111308707A (en) | Picture display adjusting method and device, storage medium and augmented reality display equipment | |
| CN110622218A (en) | Image display method, device, storage medium and terminal | |
| CN112870697B (en) | Interaction method, device, equipment and medium based on virtual relation maintenance program | |
| CN108537149B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| CN112149599B (en) | Expression tracking method and device, storage medium and electronic equipment | |
| CN113426129A (en) | User-defined role appearance adjusting method, device, terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant after: OPPO Guangdong Mobile Communications Co., Ltd. Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant before: Guangdong OPPO Mobile Communications Co., Ltd. |
|
| CB02 | Change of applicant information | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180911 |
|
| RJ01 | Rejection of invention patent application after publication |