CN105511599B - Information processing method and device - Google Patents

Information processing method and device Download PDF

Info

Publication number
CN105511599B
CN105511599B CN201410513125.4A CN201410513125A CN105511599B CN 105511599 B CN105511599 B CN 105511599B CN 201410513125 A CN201410513125 A CN 201410513125A CN 105511599 B CN105511599 B CN 105511599B
Authority
CN
China
Prior art keywords
virtual objects
space
display screen
user
virtual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201410513125.4A
Other languages
Chinese (zh)
Other versions
CN105511599A (en
Inventor
李适
彭世峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lenovo Beijing Ltd
Original Assignee
Lenovo Beijing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lenovo Beijing Ltd filed Critical Lenovo Beijing Ltd
Priority to CN201410513125.4A priority Critical patent/CN105511599B/en
Publication of CN105511599A publication Critical patent/CN105511599A/en
Application granted granted Critical
Publication of CN105511599B publication Critical patent/CN105511599B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the present application provides a kind of information processing method and device, applied in electronic equipment, by the mirror effect of the display screen of electronic equipment present with positioned at the corresponding virtual image space of environment space before display screen, include in virtual image space and the one-to-one M virtual image object of M real-world object in environment space, which comprises building digital space corresponding with virtual image space;Include M virtual objects in digital space, is corresponded with M virtual image object;The first sensed parameter of user of the detection in the environment space before display screen;The corresponding N number of virtual objects of user's visual zone in digital space are determined according to the first sensed parameter;Detect the second sensed parameter of user;According to the second sensed parameter, K virtual objects in N number of virtual objects are determined;Based on K virtual objects, controlling electronic devices executes the corresponding processing operation of K virtual objects.The embodiment of the present application improves electronic equipment resource utilization.

Description

Information processing method and device
Technical field
This application involves electronic technology field, more particularly to a kind of information processing method and electronic equipment.
Background technique
With the development of electronic technology, the function of electronic equipment is more and more, in the prior art, a kind of by plane mirror and aobvious The electronic equipment that display screen combines has come into being.
But the existing this electronic equipment for combining plane mirror and display screen is typically only capable to realize that simple mirror surface is imitated Fruit, so that user feels to place oneself in the midst of in the content of display screen output, purposes is relatively simple, and the resource of electronic equipment is not filled The utilization divided.
Summary of the invention
In view of this, providing electronic equipment resource this application provides a kind of information processing method and electronic equipment Utilization rate.
To achieve the above object, the application provides the following technical solutions:
A kind of information processing method is applied in electronic equipment, and the electronic equipment includes the display with mirror effect Virtual image space corresponding with the environment space before the display screen, institute is presented by the mirror effect of the display screen in screen Stating in virtual image space includes corresponding M virtual image object with M real-world object in the environment space, wherein M for greater than etc. In 1 integer, which comprises
Construct digital space corresponding with the virtual image space;It wherein, include M virtual objects, the M in digital space A virtual objects and the M virtual image object correspond;
The first sensed parameter of user of the detection in the environment space before the display screen, first sensed parameter Characterize the visual zone in the virtual image space that the user observes;
The corresponding N number of virtual objects of visual zone described in the digital space, M are determined according to first sensed parameter >=N, N are the integer more than or equal to 1;
The second sensed parameter of the user is detected, second sensed parameter is used to characterize the described of user's selection K virtual image object in visual zone in N number of virtual image object;N >=K, K are the integer more than or equal to 1;
According to second sensed parameter, K virtual objects in N number of virtual objects are determined;
Based on the K virtual objects, controls the electronic equipment and execute the corresponding processing behaviour of the K virtual objects Make.
The above method, it is preferred that it is described to be based on the K virtual objects, control the processing operation packet of the electronic equipment It includes:
Based on the K virtual objects, the determining and one-to-one K display object of the K virtual objects;
The K display object is shown in the display screen.
The above method, it is preferred that described to show that the K display object includes: in the display screen
Based on the digital space, the K display object is shown in the display screen, wherein the K display object It when showing on the display screen, combines together with the virtual image space, so that user observation passes through the display screen Mirror effect present the virtual image space when feel that there are M+K real-world objects in the environment space.
The above method, it is preferred that after the display screen shows the K display object, the method also includes:
The third sensed parameter of detection user in environment space before the display screen, the third sensed parameter characterization Input operation of the user for described K display object;
The input operation is determined according to the third sensed parameter;
Respond the input operation.
The above method, it is preferred that the electronic equipment is the control device in the environment space, and the method is also wrapped It includes:
Data channel is established respectively with L smart machine in the M real-world object in the environment space.
The above method, it is preferred that described when the K virtual objects are the virtual objects of the corresponding smart machine Based on the K virtual objects, the processing operation for controlling the electronic equipment includes:
Smart machine is corresponded to the K virtual objects by the data channel and sends wake up instruction, so that described Smart machine is based on the wake up instruction and switches to normal operating conditions from low power consumpting state.
The above method, it is preferred that when the K virtual objects are the virtual objects of corresponding smart machine, the K display Object is the control interface of the corresponding smart machine of the K virtual objects called based on the K virtual objects;
The third sensed parameter for detecting the user in environment space before the display screen is that the user is directed to The input of the control interface operates;
The response input, which operates, includes:
The corresponding control instruction of the input operation K virtual objects are sent to by the data channel to correspond to Smart machine so that the smart machine responds the control instruction.
Present invention also provides a kind of electronic equipment, including display screen and information processing unit with mirror effect, Virtual image space corresponding with the environment space before the display screen, the void is presented by the mirror effect of the display screen It include corresponding M virtual image object with M real-world object in the environment space in image space, wherein M is more than or equal to 1 Integer, the information processing unit include:
Space construction unit, for constructing digital space corresponding with the virtual image space;Wherein, include in digital space M virtual objects, the M virtual objects and the M virtual image object correspond;
First detection unit, for detecting the first induction ginseng of the user in the environment space before being located at the display screen Number, first sensed parameter characterize the visual zone in the virtual image space that the user observes;
First object determination unit, for determining visual area described in the digital space according to first sensed parameter The corresponding N number of virtual objects in domain, M >=N, N are the integer more than or equal to 1;
Second detection unit, for detecting the second sensed parameter of the user, second sensed parameter is for characterizing K virtual image object in the visual zone of user's selection in N number of virtual image object;N >=K, K are whole more than or equal to 1 Number;
Second object determination unit, for according to second sensed parameter, determining that the K in N number of virtual objects is a virtual Object;
Processing unit controls the electronic equipment and executes the K virtual objects for being based on the K virtual objects Corresponding processing operation.
Above-mentioned electronic equipment, it is preferred that the processing unit is specifically used for:
Based on the K virtual objects, the determining and one-to-one K display object of the K virtual objects;
The K display object is shown in the display screen.
Above-mentioned electronic equipment, it is preferred that the processing unit shows that the K display object is specific in the display screen It is that the K display object is shown in the display screen, wherein the K display object is shown in based on the digital space It when on the display screen, combines together with the virtual image space, so that user observation passes through the mirror surface of the display screen Feel that there are M+K real-world objects in the environment space when virtual image space that effect is presented.
Above-mentioned electronic equipment, it is preferred that the information processing unit further include:
Third detection unit, for detecting the third sensed parameter of the user in environment space before the display screen, institute It states third sensed parameter and characterizes the user for the input operation of described K display object;
Operation determination unit, for determining that the input operates according to the third sensed parameter;
Response unit, for responding the input operation.
Above-mentioned electronic equipment, it is preferred that the electronic equipment is the control device in the environment space, at the information Manage device further include:
Unit is communicated to connect, for distinguishing with L smart machine in the M real-world object in the environment space Establish data channel.
Above-mentioned electronic equipment, it is preferred that the processing unit is specifically used for:
When the K virtual objects are the virtual objects of the corresponding smart machine, by the data channel to institute It states K virtual objects and corresponds to smart machine and send wake up instruction, so that the smart machine is based on the wake up instruction from low Power consumption state switches to normal operating conditions.
Above-mentioned electronic equipment, it is preferred that when the K virtual objects are the virtual objects of corresponding smart machine, the K Display object is the control interface of the corresponding smart machine of the K virtual objects called based on the K virtual objects;
The third detection unit detects that the third sensed parameter of the user in environment space before the display screen is The user operates for the input of the control interface;
The response unit is specifically used for:
The corresponding control instruction of the input operation K virtual objects are sent to by the data channel to correspond to Smart machine so that the smart machine responds the control instruction.
It can be seen via above technical scheme that compared with prior art, this application provides a kind of information processing method and Electronic equipment, user is by the mirror image of the display screen of Soviet Union's Sohu's electronic equipment it can be seen that with M in the environment space The one-to-one M virtual image object of real-world object;Therefore, by constructing digital space, the available and M virtual image object One-to-one M virtual objects, allow electronic equipment to determine the content of user's observation.It is located at by detection described aobvious The first sensed parameter of the user in environment space before display screen can determine user's visual zone pair in the digital space The N number of virtual objects answered can determine that K in N number of virtual objects are virtual by detecting the second sensed parameter of the user Object;To be based on the K virtual objects, controls the electronic equipment and execute the corresponding processing of the K virtual objects Operation.The embodiment of the present application makes the resource of electronic equipment be fully used, and improves the experience of user.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this The embodiment of application for those of ordinary skill in the art without creative efforts, can also basis The attached drawing of offer obtains other attached drawings.
Fig. 1 is a kind of flow chart of information processing method one embodiment provided by the embodiments of the present application;
Fig. 2 a is what user was observed by the mirror effect of the display screen in electronic equipment provided by the embodiments of the present application A kind of virtual image space;
Fig. 2 b is that the mirror effect of the display screen in the electronic equipment that user passes through the embodiment of the present application observes another Kind virtual image space;
Fig. 2 c is a kind of digital space of the embodiment of the present application building;
Fig. 2 d, Fig. 2 e, Fig. 2 f, Fig. 3 a and Fig. 3 b are respectively that user observes electronic equipment provided by the embodiments of the present application Observed content when display screen;
Fig. 4 is the structural schematic diagram of information processing unit one embodiment in electronic equipment provided by the embodiments of the present application.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of embodiments of the present application, instead of all the embodiments.It is based on Embodiment in the application, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall in the protection scope of this application.
In the embodiment of the present application, user is by the mirror image of the display screen of electronic equipment it can be seen that with the environment The one-to-one M virtual image object of M real-world object in space;Therefore, by constructing digital space, the available and M A one-to-one M virtual objects of virtual image object allow electronic equipment to determine the content of user's observation.Pass through detection The first sensed parameter of user in the environment space before the display screen, can determine user in the digital space The corresponding N number of virtual objects of visual zone can determine N number of virtual objects by detecting the second sensed parameter of the user In K virtual objects;To be based on the K virtual objects, controls the electronic equipment and execute the K virtual objects pair The processing operation answered.The embodiment of the present application makes the resource of electronic equipment be fully used, and improves the body of user It tests.
With reference to the accompanying drawing, the application embodiment is described in detail.
Fig. 1 is a kind of flow chart of information processing method one embodiment provided by the embodiments of the present application, the method tool Body is applied in electronic equipment.
The electronic equipment includes the display screen with mirror effect, is presented by the mirror effect of the display screen Be located at the corresponding virtual image space of environment space before the display screen, include in the virtual image space in the environment space M real-world object corresponds M virtual image object, and wherein M is the integer more than or equal to 1.
Namely no matter in the case where whether display screen powers on, the physical phenomenon that display screen surface can be transferred through itself is presented The virtual image of environment space in front of display screen out.According to optical physics principle it is found that the size in virtual image space, positional relationship and The environment space before each object and display screen in virtual image space is full symmetric.
User exports the content shown to display screen in addition to that can watch electronic equipment by display screen, can also be by aobvious The mirror effect viewing of display screen is located at the virtual image space that the environment space in front of display screen is gone out by mirror-reflection.
The method may include following steps:
101: building digital space corresponding with the virtual image space;It wherein, include M virtual objects in digital space, The M virtual objects and the M virtual image object correspond.
Wherein, digital space is that the environment space acquired in front of display screen by acquisition modules such as cameras obtains.
The case where by mirror effect, user can observe virtual image space, can know that environment space by virtual image space, such as ring The size in border space, the M real object etc. in environment space, still, electronic equipment is not aware that virtual image space is , therefore need to construct a digital space just come the case where making electronic equipment determine environment space and virtual image space.In the application In embodiment, digital space and virtual image space are corresponding consistent.
Acquisition module can be 3D (three-dimensional, three-dimension) video camera, depth camera, binocular camera, It can be two common cameras, the application is limited not to this.
Acquisition module can obtain at least one of environment space by shooting at least two frame images or dynamic image Parameter.Wherein, at least one parameter includes but is not limited to the depth information, each in environment space that each in environment space is put The size of coordinate value of the point under the three-dimensional system of coordinate of acquisition module, environment space, M real object distance is adopted in environment space Collect the distance of module, the distance between the size of M real object and M real object and angle etc., such as environment space For the study of observer, then by least one parameter that acquisition module obtains may include study be one 2.7 meters × 3 meters × There is a sect in 2.9 meters of space in 2.64 meters of acquisition module of environment space, there is a window, door and window beside door The distance of mouth is 0.45 meter, while desk etc. in 0~0.3 meter of range image acquisition unit of horizontal direction.
The mode for constructing digital space can be a variety of, and the application limits not to this.For example, environment will be collected The depth of each point and in the horizontal and vertical directions with respect to the distance of acquisition module in space, i.e., it is every in acquisition environment space Coordinate value of a point under acquisition module three-dimensional system of coordinate, then the Z axis of each coordinate value is taken into opposite number, it will be able to obtain with Virtual Space corresponds to consistent digital space.
102: the first sensed parameter of user of the detection in the environment space before the display screen, first induction The visual zone in the virtual image space that user described in parameter characterization observes.
Since user is when different angle observes virtual image space, virtual image space can generate change because of the vision of user difference Change.As shown in Figure 2 a and 2 b, when subscriber station is in the virtual image space that the observation display screen 100 of position 1 is presented, it can at least see and lean on The turning of the wall of nearly window, and when subscriber station is in the virtual image space that the observation display screen 100 of position 2 is presented, then it cannot see that and lean on The turning of the wall of nearly window, but can see the turning of the wall close to door.
Therefore, in the embodiment of the present application, the first sensed parameter of user can be detected, which characterizes user and see The visual zone in virtual image space observed.
First sensed parameter may include position of human eye information of user etc..In practical applications, it can use acquisition The image of module acquisition, the number of people position of observer is obtained using the skeleton data extracting method of Kinect SDK from image, Number of people position is obtained to the vision of observer as position of human eye.It can also be modeled using three-dimensional face, thus accurately Position of human eye is extracted, specific implementation process similarly to the prior art, just repeats no more here.
103: determining that visual zone described in the digital space is corresponding N number of virtual right according to first sensed parameter As M >=N, N are the integer more than or equal to 1.
According to the visual zone for the user that the first sensed parameter is determined, i.e. user observes virtual image space, due to number Space is corresponding with virtual image space, therefore can determine that the visual zone of user in the digital space is corresponding N number of virtual Object.
104: detecting the second sensed parameter of the user, second sensed parameter is used to characterize user's selection K virtual image object in the visual zone in N number of virtual image object;N >=K, K are the integer more than or equal to 1.
User observes that, by the virtual image space of the mirror effect presentation of display screen, user can also execute corresponding void to it Quasi- operation.For example a virtual image object in instruction virtual image space, touch display screen cause to touch the illusion etc. in virtual image space.User One or more virtual image objects may be selected to be operated.
Therefore in the embodiment of the present application, the second sensed parameter of user can be detected, which used in detection When family executes corresponding operating to K virtual image object in N number of virtual image object in its visual zone, obtained parameter.
105: according to second sensed parameter, determining K virtual objects in N number of virtual objects.
By analyzing second sensed parameter, since virtual image space and digital space correspond, thus may determine that N out K virtual objects in a virtual objects, K virtual image object and K virtual objects are correspondingly, so that electronics is set It is standby to know user executes operation for which virtual image object.
Second sensed parameter can refer to limbs information, including gesture information etc., can also refer to eyeball action message Deng.
It is also possible to acquire image by acquisition module, using human body recognition method, gesture identification method and use The skeleton data extracting method etc. of Kinect SDK obtains limbs information or eyeball action message of user etc. from image.
106: being based on the K virtual objects, control the electronic equipment and execute the corresponding processing of the K virtual objects Operation.
After determining K virtual objects, the K virtual objects, the processing operation of controlling electronic devices can be based on.
The embodiment of the present application is in by mirror effect in conjunction with user and display screen using the display screen with mirror effect The interaction in existing virtual image space can trigger electronic equipment and execute corresponding processing operation, user experience be improved, so that electronics The resource of equipment is fully used.
Based on the K virtual objects, controls the electronic equipment and execute the corresponding processing operation of the K virtual objects It can be there are many possible implementation.
In one possible implementation, the K virtual objects should be based on, were controlled described in the electronic equipment execution The corresponding processing operation of K virtual objects may include:
Based on the K virtual objects, the determining and one-to-one K display object of the K virtual objects;
The K display object is shown in the display screen.
This K display object is exported to display screen and is shown, when so that user observing display screen, in addition to being observed that Virtual image space, it can also be observed that this K display object of display screen output.The mode of electronic device information processing is increased, Meet Diversity of information.
User can also execute corresponding input operation for this K display object.Such as it clicks and shows that object, sliding are aobvious Show object, or display object etc. is indicated by gesture operation.
Therefore, after the display screen shows the K display object, the method can also include:
The third sensed parameter of detection user in environment space before the display screen, the third sensed parameter characterization Input operation of the user for described K display object;
The input operation is determined according to the third sensed parameter;
Respond the input operation.
Third sensed parameter can refer to limbs information, such as gesture information etc. may also mean that Rotation of eyeball information etc..
Input operation can be determined by third sensed parameter, and responds input operation.Such as input operation be finger from First position is moved to the second position, then by response input operation, can determine the display object of operation, and control the display Object is mobile, so that user observes that the display object is moved to the 4th position from the third place in virtual image space.
Wherein, show that this K display object can be determined based on the digital space in display screen, so that the K aobvious It when showing that object is shown on the display screen, combines together with the virtual image space, so that user observation is described in Feel that there are M+K real-world objects in the environment space when virtual image space that the mirror effect of display screen is presented.Pass through mirror As actual situation combination, a kind of completely new user experience is provided.
Based on digital space, show that this K display object can be based on the digital space in display screen, determine described in Display parameters of the K display object in the display screen show the K display object according to the display parameters.
This K display object can be pre-set object, or K generated according to the feature of K virtual objects Show object, or the K display pair obtained from other electronic equipments or network server according to the information of K virtual objects As etc..
Display parameters include at least display position.Therefore show that this K display object can be specifically in display screen:
Determine the K display object and the K display object in the digital space based on the digital space In K position;
Determine the K position in the digital space corresponding K display position on a display screen;
The K display object is shown in the K display position of the display screen.
When in order to determine that K display object of display is displayed on the screen, K display object can be built to user K display object can be placed in the digital space of itself acquisition first, determine K by the feeling to combine together with virtual image space Object is shown in the position of digital space, to obtain display position of the K display object in display screen.
As illustrated in fig. 2 c, the number sky to be obtained by the corresponding environment space in virtual image space for acquiring Fig. 2 a and Fig. 2 b Between, as shown in Fig. 2 a~Fig. 3 b, it is known that environment space is a study, includes desk, window and door etc. in study.Therefore scheme M virtual image object includes virtual image desk 201, virtual image window 202 and virtual image door 203, M void in digital space in 2a and Fig. 2 b Quasi- object includes virtual desk 204, virtual window 205 and virtual door 206.Know M virtual image object and M virtual objects one One is corresponding.
K display object assumes to include cup, since cup can be generally placed on desk, by determining in number The position of word space cup can export the cup in display screen, user is allowed to feel that cup exists in environment space, And cup is not actually real-world object.
It is set to example in A point with subscriber station, Fig. 2 d is that user observes content observed when display screen, cup in figure 207 be the content of display screen reality output.The other content for not including cup 207 is that the virtual image that display screen mirror effect is presented is empty Between.From the user's point of view, cup combines together with virtual image space.
After the display screen shows the K display object, it is empty that the environment before the display screen can also be detected Between middle user third sensed parameter, the third sensed parameter characterize the user for described K show object input Operation;
The input operation is determined according to the third sensed parameter;
Respond the input operation.
For example, the input operation determined by third sensed parameter is the shifting that finger is moved to the second position from first position Dynamic operation can change the display object movement of input operation instruction by responding input operation.
As shown in figures 2 d and 2e, movement has occurred in position of the cup on desk.Fig. 2 e is user for Fig. 2 d Its content observed performs corresponding input operation to cup, such as cup is corresponding from Fig. 2 d in display screen for finger Display position is moved to the corresponding display position of cup in Fig. 2 e.
As shown in figure 2f, when showing K display object and showing on the display screen, melting with the virtual image space is one Another schematic diagram of body.
In Fig. 2 f, user 200 is located at the environment space before display screen 100, by detecting its first sensed parameter and Two sensed parameters etc. can determine display object 208 (for a people), when user observes display screen 100, it can be seen that mirror surface The virtual image space that effect is presented, and the display object 208 to combine together with the virtual image space, so that user feels in environment There is real-world object corresponding with display object 208 in space.According to visual imaging theory, when user observes display object 208, In user's visual zone, actually seeing is object 209 in Fig. 2 f.
In addition, by the third sensed parameter of detection user, for example, user indicates that the display execution of object 208 " waving " is dynamic When making, display object 208 can also be controlled and moved, so that the visual effect that display object 208 is come over from the distant to the near is presented.
In the embodiment of the present application, electronic equipment can be specifically the control device in the environment space, the control device Data channel is established respectively with L smart machine in the M real-world object in the environment space.It can be to the L Smart machine is controlled.
Smart machine can refer to TV, computer, air-conditioning, intelligent door lock, intelligent switch;Intelligent camera head etc..
Therefore, in alternatively possible implementation, when the void that the K virtual objects are the corresponding smart machine Described to be based on the K virtual objects when quasi- object, the processing operation for controlling the electronic equipment may include:
Smart machine is corresponded to the K virtual objects by the data channel and sends wake up instruction, so that described Smart machine is based on the wake up instruction and switches to normal operating conditions from low power consumpting state.
Namely after according to the second sensed parameter of user, determining K virtual objects, it can control K is virtually The corresponding state of object, such as normal operation is switched to from suspend mode, or switch to booting etc. from off-mode, therefore pass through this Application embodiment provides a kind of mode for facilitating control smart machine, even if so that smart machine can not be manually operated in user When, it still is able to realize the control to smart machine, improves user experience.
In addition, being based on the K virtual objects, the one-to-one K display pair of the determining and K virtual objects As, and show in the display screen in the mode of the K display object, if K virtual objects are correspondence smart machine When virtual objects, the K display object can specifically refer to call the K virtual objects based on the K virtual objects The control interface of corresponding smart machine;
After the control interface for showing the corresponding smart machine of the K virtual objects, the method can also include:
The third sensed parameter of detection user in environment space before the display screen, the third sensed parameter is institute The input that user is stated for the control interface operates;
The input operation is determined according to the third sensed parameter;
The corresponding control instruction of the input operation K virtual objects are sent to by the data channel to correspond to Smart machine so that the smart machine responds the control instruction.
Wherein, the corresponding smart machine of each virtual objects can all have a control interface, wrap in control interface Different controls is included, therefore is determined after inputting operation according to the third sensed parameter, can first be grasped according to the input It determines the target widget that user is directed to, the input is then operated by corresponding control instruction by the data channel again It is sent to the corresponding smart machine of the destination virtual object.
As shown in Figure 3a and Figure 3b shows, Fig. 3 a is that user observes content observed when display screen, and the display screen of Fig. 3 a is only Environment space corresponding virtual image space content before showing display screen is true including air conditioner etc. in the environment space before display screen Real object, in the virtual image space that user observes, the virtual image object 301 including corresponding air conditioner, while can also be seen that certainly Oneself virtual image object 302 etc..
By detecting the first sensed parameter and the second sensed parameter of user, it can determine that user selects visual zone In virtual image object, and corresponding virtual objects are determined according to virtual image object, thus the display object exported.
As shown in Figure 3a, the virtual image object that user selects can be determined for the void of air conditioner according to the gesture information of user As object 301, Fig. 3 b is the display object 302 that the virtual image object 301 selected according to user exports.The display object 302 is specific For content in the control interface of the air conditioner, as described in Fig. 3 b, display object includes multiple controls in the control interface.
User can carry out input operation for the control interface, such as described in Fig. 3 b, user executes gesture operation, So that virtual image hand executes the input operation of one control of touch-control in the virtual image object of user, which is specially that a temperature is adjusted Control.The input operates temperature that corresponding control instruction be adjustment air conditioner to assigned temperature etc..Therefore implemented by the application Example is not necessarily to direct operating air conditioner machine, and the purpose of temperature adjusting can be realized.
Meanwhile being operated according to the input of user, it can also determine the display object of corresponding target widget, and in display screen It is shown.In example as above, after user carries out clicking operation for some control, the control can also be exported in display screen The display interface etc. of the corresponding application program of part.
For the various method embodiments described above, for simple description, therefore, it is stated as a series of action combinations, but Be those skilled in the art should understand that, the application is not limited by the described action sequence because according to the application, certain A little steps can be performed in other orders or simultaneously.Secondly, those skilled in the art should also know that, it is retouched in specification The embodiment stated belongs to preferred embodiment, necessary to related actions and modules not necessarily the application.
The embodiment of the present application also provides a kind of electronic equipment, the electronic equipment include have the display screen of mirror effect with And information processing unit, it is presented by the mirror effect of the display screen corresponding with the environment space before the display screen Virtual image space includes corresponding M virtual image object with M real-world object in the environment space in the virtual image space, Middle M is the integer more than or equal to 1.
As shown in figure 4, for information processing unit one embodiment in a kind of electronic equipment provided by the embodiments of the present application Structural schematic diagram.
The information processing unit may include:
Space construction unit 401, for constructing digital space corresponding with the virtual image space;Wherein, in digital space Including M virtual objects, the M virtual objects and the M virtual image object are corresponded.
First detection unit 402, for detecting the first induction of the user in the environment space before being located at the display screen Parameter, first sensed parameter characterize the visual zone in the virtual image space that the user observes;
First object determination unit 403, for determining view described in the digital space according to first sensed parameter Feel that the corresponding N number of virtual objects in region, M >=N, N are the integer more than or equal to 1;
Second detection unit 404, for detecting the second sensed parameter of the user, second sensed parameter is used for table Levy K virtual image object in the visual zone of user's selection in N number of virtual image object;N >=K, K are more than or equal to 1 Integer;
Second object determination unit 405, for according to second sensed parameter, determining K in N number of virtual objects void Quasi- object;
It is virtual right to control described K of the electronic equipment execution for being based on the K virtual objects for processing unit 406 As corresponding processing operation.
The embodiment of the present application is in by mirror effect in conjunction with user and display screen using the display screen with mirror effect The interaction in existing virtual image space can trigger electronic equipment and execute corresponding processing operation, user experience be improved, so that electronics The resource of equipment is fully used.
Wherein, as a kind of possible implementation, which can be specifically used for:
Based on the K virtual objects, the determining and one-to-one K display object of the K virtual objects;
The K display object is shown in the display screen.
This K display object is exported to display screen and is shown, when so that user observing display screen, in addition to being observed that Virtual image space, it can also be observed that this K display object of display screen output.The mode of electronic device information processing is increased, Meet Diversity of information.
User can also execute corresponding input operation for this K display object.Such as it clicks and shows that object, sliding are aobvious Show object, or display object etc. is indicated by gesture operation.
Therefore, which can also include:
Third detection unit, for detecting the third sensed parameter of the user in environment space before the display screen, institute It states third sensed parameter and characterizes the user for the input operation of described K display object;
Operation determination unit, for determining that the input operates according to the third sensed parameter;
Response unit, for responding the input operation.
Wherein, the processing unit shows that this K display object specifically can be based on the digital space in display screen It determines, when so that the K display object being shown on the display screen, combines together with the virtual image space, so that institute Feel that there are M+K in the environment space when stating the virtual image space that user's observation is presented by the mirror effect of the display screen A real-world object.It is combined by mirror image actual situation, provides a kind of completely new user experience.
Based on digital space, show that this K display object can be based on the digital space in display screen, determine described in Display parameters of the K display object in the display screen show the K display object according to the display parameters.
This K display object can be pre-set object, or K generated according to the feature of K virtual objects Show object, or the K display pair obtained from other electronic equipments or network server according to the information of K virtual objects As etc..
Display parameters include at least display position.Therefore show that this K display object can be specifically in display screen:
Determine the K display object and the K display object in the digital space based on the digital space In K position;
Determine the K position in the digital space corresponding K display position on a display screen;
The K display object is shown in the K display position of the display screen.
Wherein, the embodiment of the present application, the electronic equipment can be specifically the control device in the environment space, in this L smart machine in the M real-world object in control equipment and the environment space establishes data channel respectively.It can be right The L smart machine is controlled.
Therefore, which can also include a communication connection unit, for true with the M in the environment space L smart machine in object establishes data channel respectively.
Wherein, smart machine can refer to TV, computer, air-conditioning, intelligent door lock, intelligent switch;Intelligent camera head etc..
Therefore, in alternatively possible implementation, the processing unit can be specifically used for:
When the K virtual objects are the virtual objects of the corresponding smart machine, by the data channel to institute It states K virtual objects and corresponds to smart machine and send wake up instruction, so that the smart machine is based on the wake up instruction from low Power consumption state switches to normal operating conditions.
In addition, if the K display object can be specific when K virtual objects are the virtual objects of corresponding smart machine Refer to the control interface for calling the K virtual objects to correspond to smart machine based on the K virtual objects;
The third sensed parameter tool of user in environment space before the display screen of the third detection unit detection Body is that the user operates for the input of the control interface;
The response unit is specifically used for that the input is operated corresponding control instruction transmission by the data channel To the corresponding smart machine of the K virtual objects, so that the smart machine responds the control instruction.
Wherein, the corresponding smart machine of each virtual objects can all have a control interface, wrap in control interface Different controls is included, therefore is determined after inputting operation according to the third sensed parameter, can first be grasped according to the input It determines the target widget that user is directed to, the input is then operated by corresponding control instruction by the data channel again It is sent to the corresponding smart machine of the destination virtual object.
Each embodiment in this specification is described in a progressive manner, the highlights of each of the examples are with other The difference of embodiment, the same or similar parts in each embodiment may refer to each other.For device disclosed in embodiment For, since it is corresponded to the methods disclosed in the examples, so being described relatively simple, related place is said referring to method part It is bright.
It should be noted that, in this document, relational terms such as first and second and the like are used merely to a reality Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to Non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that There is also other identical elements in process, method, article or equipment including the element.
For convenience of description, it is divided into various units when description apparatus above with function to describe respectively.Certainly, implementing this The function of each unit can be realized in the same or multiple software and or hardware when application.
As seen through the above description of the embodiments, those skilled in the art can be understood that the application can It realizes by means of software and necessary general hardware platform.Based on this understanding, the technical solution essence of the application On in other words the part that contributes to existing technology can be embodied in the form of software products, the computer software product It can store in storage medium, such as ROM/RAM, magnetic disk, CD, including some instructions are used so that a computer equipment (can be personal computer, server or the network equipment etc.) executes the certain of each embodiment of the application or embodiment Method described in part.
The foregoing description of the disclosed embodiments makes professional and technical personnel in the field can be realized or use the application. Various modifications to these embodiments will be readily apparent to those skilled in the art, as defined herein General Principle can be realized in other embodiments without departing from the spirit or scope of the application.Therefore, the application It is not intended to be limited to the embodiments shown herein, and is to fit to and the principles and novel features disclosed herein phase one The widest scope of cause.

Claims (14)

1. a kind of information processing method, which is characterized in that be applied in electronic equipment, the electronic equipment includes having mirror surface effect The virtual image corresponding with the environment space before the display screen is presented by the mirror effect of the display screen in the display screen of fruit Space includes corresponding M virtual image object with M real-world object in the environment space in the virtual image space, and wherein M is Integer more than or equal to 1, which comprises
Construct digital space corresponding with the virtual image space;Wherein, digital space is before acquiring display screen by acquisition module The environment space of side obtains, and acquisition module is obtained in environment space at least by shooting at least two frame images or dynamic image One parameter includes M virtual objects, the M virtual objects and M virtual image object one-to-one correspondence in digital space;
The first sensed parameter of user of the detection in the environment space before the display screen, the first sensed parameter characterization The visual zone in the virtual image space that the user observes;
The corresponding N number of virtual objects of visual zone described in the digital space are determined according to first sensed parameter, M >=N, N is the integer more than or equal to 1;
The second sensed parameter of the user is detected, second sensed parameter is used to characterize the vision of user's selection K virtual image object in region in N number of virtual image object;N >=K, K are the integer more than or equal to 1;
According to second sensed parameter, K virtual objects in N number of virtual objects are determined;
Based on the K virtual objects, controls the electronic equipment and execute the corresponding processing operation of the K virtual objects.
2. controlling the electronics the method according to claim 1, wherein described be based on the K virtual objects The processing operation of equipment includes:
Based on the K virtual objects, the determining and one-to-one K display object of the K virtual objects;
The K display object is shown in the display screen.
3. according to the method described in claim 2, it is characterized in that, described show the K display pair in the display screen As including:
Based on the digital space, the K display object is shown in the display screen, wherein the K display object is shown It when on the display screen, combines together with the virtual image space, so that user observation passes through the mirror of the display screen Feel that there are M+K real-world objects in the environment space when virtual image space that face effect is presented.
4. according to the method in claim 2 or 3, which is characterized in that the display screen show the K display object it Afterwards, the method also includes:
Detection is located at the third sensed parameter of user in environment space before the display screen, described in the third sensed parameter characterization Input operation of the user for described K display object;
The input operation is determined according to the third sensed parameter;
Respond the input operation.
5. according to the method described in claim 2, it is characterized in that, the electronic equipment sets for the middle control in the environment space It is standby, the method also includes:
Data channel is established respectively with L smart machine in the M real-world object in the environment space.
6. according to the method described in claim 5, it is characterized in that, when the K virtual objects are the corresponding smart machine Virtual objects when, described to be based on the K virtual objects, the processing operation for controlling the electronic equipment includes:
Smart machine is corresponded to the K virtual objects by the data channel and sends wake up instruction, so that the intelligence Equipment is based on the wake up instruction and switches to normal operating conditions from low power consumpting state.
7. according to the method described in claim 5, it is characterized in that, the K virtual objects are the virtual of corresponding smart machine When object, the K display object is to be set based on the corresponding intelligence of the K virtual objects that the K virtual objects call Standby control interface;
The third sensed parameter for detecting user in environment space before being located at the display screen is the user for the control The input at interface operates;
Response input, which operates, includes:
The input is operated into corresponding control instruction by the data channel and is sent to the corresponding intelligence of the K virtual objects Energy equipment, so that the smart machine responds the control instruction.
8. a kind of electronic equipment, which is characterized in that including display screen and information processing unit with mirror effect, pass through institute Virtual image space corresponding with the environment space before the display screen, the virtual image space is presented in the mirror effect for stating display screen In include corresponding M virtual image object with M real-world object in the environment space, wherein M is the integer more than or equal to 1, The information processing unit includes:
Space construction unit, for constructing digital space corresponding with the virtual image space;Wherein, digital space is to pass through acquisition Environment space in front of module acquisition display screen obtains, and acquisition module is obtained by shooting at least two frame images or dynamic image At least one parameter in environment space includes M virtual objects, the M virtual objects and the M void in digital space As object corresponds;
First detection unit, for detecting the first sensed parameter of the user in the environment space before being located at the display screen, institute It states the first sensed parameter and characterizes visual zone in the virtual image space that the user observes;
First object determination unit, for determining visual zone pair described in the digital space according to first sensed parameter The N number of virtual objects answered, M >=N, N are the integer more than or equal to 1;
Second detection unit, for detecting the second sensed parameter of the user, second sensed parameter is described for characterizing K virtual image object in the visual zone of user's selection in N number of virtual image object;N >=K, K are the integer more than or equal to 1;
Second object determination unit, for determining K virtual objects in N number of virtual objects according to second sensed parameter;
It is corresponding to control the electronic equipment execution K virtual objects for being based on the K virtual objects for processing unit Processing operation.
9. electronic equipment according to claim 8, which is characterized in that the processing unit is specifically used for:
Based on the K virtual objects, the determining and one-to-one K display object of the K virtual objects;
The K display object is shown in the display screen.
10. electronic equipment according to claim 9, which is characterized in that the processing unit is shown in the display screen The K display object is specifically to be based on the digital space, shows the K display object in the display screen, wherein institute It when stating K display object and showing on the display screen, combines together with the virtual image space, so that user observation is logical Feel that there are M+K real-world objects in the environment space when crossing the virtual image space of the mirror effect presentation of the display screen.
11. electronic equipment according to claim 9 or 10, which is characterized in that the information processing unit further include:
Third detection unit, for detecting the third sensed parameter for being located at user in environment space before the display screen, described the Three sensed parameters characterize the user for the input operation of described K display object;
Operation determination unit, for determining that the input operates according to the third sensed parameter;
Response unit, for responding the input operation.
12. electronic equipment according to claim 9, which is characterized in that the electronic equipment is in the environment space Control device, the information processing unit further include:
Unit is communicated to connect, for establishing respectively with L smart machine in the M real-world object in the environment space Data channel.
13. electronic equipment according to claim 12, which is characterized in that the processing unit is specifically used for:
When the K virtual objects are the virtual objects of the corresponding smart machine, by the data channel to the K Virtual objects correspond to smart machine and send wake up instruction, so that the smart machine is based on the wake up instruction from low-power consumption shape State switches to normal operating conditions.
14. electronic equipment according to claim 12, which is characterized in that the K virtual objects are corresponding smart machine Virtual objects when, the K display object is that the K virtual objects that are called based on the K virtual objects are corresponding The control interface of smart machine;
Third detection unit detects that the third sensed parameter of the user in environment space before the display screen is the user For the input operation of the control interface;
Response unit is specifically used for:
The input is operated into corresponding control instruction by the data channel and is sent to the corresponding intelligence of the K virtual objects Energy equipment, so that the smart machine responds the control instruction.
CN201410513125.4A 2014-09-29 2014-09-29 Information processing method and device Active CN105511599B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410513125.4A CN105511599B (en) 2014-09-29 2014-09-29 Information processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410513125.4A CN105511599B (en) 2014-09-29 2014-09-29 Information processing method and device

Publications (2)

Publication Number Publication Date
CN105511599A CN105511599A (en) 2016-04-20
CN105511599B true CN105511599B (en) 2019-06-25

Family

ID=55719650

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410513125.4A Active CN105511599B (en) 2014-09-29 2014-09-29 Information processing method and device

Country Status (1)

Country Link
CN (1) CN105511599B (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102253713A (en) * 2011-06-23 2011-11-23 康佳集团股份有限公司 Display system orienting to three-dimensional images

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8970569B2 (en) * 2005-03-01 2015-03-03 Eyesmatch Ltd Devices, systems and methods of virtualizing a mirror
US20110084983A1 (en) * 2009-09-29 2011-04-14 Wavelength & Resonance LLC Systems and Methods for Interaction With a Virtual Environment
US8782565B2 (en) * 2012-01-12 2014-07-15 Cisco Technology, Inc. System for selecting objects on display
US9325943B2 (en) * 2013-02-20 2016-04-26 Microsoft Technology Licensing, Llc Providing a tele-immersive experience using a mirror metaphor

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102253713A (en) * 2011-06-23 2011-11-23 康佳集团股份有限公司 Display system orienting to three-dimensional images

Also Published As

Publication number Publication date
CN105511599A (en) 2016-04-20

Similar Documents

Publication Publication Date Title
US11747893B2 (en) Visual communications methods, systems and software
CN107111365B (en) The application presented in Virtual Space is subjected to selective matching with physical display
CN105593785B (en) Stare auxiliary touch-screen input
CN103999018B (en) The user of response three-dimensional display object selects the method and system of posture
EP2919093A1 (en) Method, system, and computer for identifying object in augmented reality
US20120056989A1 (en) Image recognition apparatus, operation determining method and program
CN105808071B (en) A kind of display control method, device and electronic equipment
CN110378914A (en) Rendering method and device, system, display equipment based on blinkpunkt information
CN104731338B (en) One kind is based on enclosed enhancing virtual reality system and method
WO2015136250A1 (en) Interactive information display
CN111226187A (en) System and method for interacting with a user through a mirror
US11195341B1 (en) Augmented reality eyewear with 3D costumes
CN107577345A (en) A kind of method and device for controlling virtual portrait roaming
CN204990186U (en) Desktop formula stereoscopic display interaction system
CN108534295B (en) Method, device and system for displaying data
Caggianese et al. Situated visualization in augmented reality: Exploring information seeking strategies
JP6695997B2 (en) Information processing equipment
KR20110070514A (en) Head mount display apparatus and control method for space touch on 3d graphic user interface
CN108205823A (en) MR holographies vacuum experiences shop and experiential method
EP3625673A1 (en) Methods and systems for viewing and editing ar/vr computer-based designs allowing impaired vision simulation
CN105511599B (en) Information processing method and device
CN109643182B (en) Information processing method and device, cloud processing equipment and computer program product
CN105676656A (en) Processing method and electronic device
WO2016102948A1 (en) Coherent touchless interaction with stereoscopic 3d images
CN105446672B (en) A kind of information processing method and electronic equipment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant