CN108829256A - A kind of control method and device - Google Patents
A kind of control method and device Download PDFInfo
- Publication number
- CN108829256A CN108829256A CN201810690164.XA CN201810690164A CN108829256A CN 108829256 A CN108829256 A CN 108829256A CN 201810690164 A CN201810690164 A CN 201810690164A CN 108829256 A CN108829256 A CN 108829256A
- Authority
- CN
- China
- Prior art keywords
- display screen
- target object
- display
- signal
- screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
This application discloses a kind of control method and device, wherein the method includes：Second signal is exported, with the displaying target object in second display screen；Attribute information and/or the target object based on the second display screen, export the first signal, to show related information in the first display screen, wherein, at least one in first display screen and the second display screen is virtual screen, and the virtual screen is that light is projected the virtual image to be formed to show by optics module.
Description
Technical field
This application involves augmented reality (Augmented Reality, abbreviation AR) technical fields, and in particular to a kind of control
Method and device.
Background technique
Currently, user realizes the control to AR content, this head control often through headwork when using AR equipment
Mode processed usually operate it is time-consuming and laborious so that interactive efficiency is lower.
Summary of the invention
In view of this, the application provides a kind of control method and device, the first display screen and second display screen phase are given
In conjunction with display mode, can improve the interactive efficiency between AR and physical display screen, promote AR usage experience.
In order to achieve the above objectives, the technical solution of the application is realized in：
The embodiment of the present application provides a kind of control method, the method includes：
Second signal is exported, with the displaying target object in second display screen；
Attribute information and/or the target object based on the second display screen export the first signal, with aobvious first
Related information is shown in display screen, wherein at least one in first display screen and the second display screen is virtual screen, institute
Stating virtual screen is that light is projected the virtual image to be formed to show by optics module.
In above scheme, optionally, the first signal is exported, to show related information in the first display screen, including：
The first signal is exported, the related information is shown with the target display location in first display screen, wherein institute
The attribute information of the attribute information and/or the target object of stating target display location and the second display screen matches.
In above scheme, optionally, the first signal is exported, to show institute in the target display location of first display screen
Related information is stated, including：
Spatial relation and/or the target pair based on the second display screen relative to first display screen
As the display position in the second display screen, the target display location is determined.
In above scheme, optionally, the first signal of output is also wrapped before showing related information in the first display screen
Include at least one of：
Acquisition receives the first trigger action signal on first display screen；Or
Acquisition receives the second trigger action signal on the second display screen.
In above scheme, optionally, the related information, including at least one of：
For adjusting the first information of the second display screen attribute；Or
For adjusting the second information of the target object；Or
The third information of the associated display content of the target object is neutralized for adjusting the second display screen；Or
Associated 4th information of content of the target object is neutralized for adjusting the second display screen.
In above scheme, optionally, the method also includes：
Obtain the object run signal based on the related information；
Based on the object run signal, at least one of is adjusted：
The attribute of the second display screen；Or
The target object；Or
The second display screen neutralizes the associated display content of target object.
In above scheme, optionally, the method also includes：
When the predeterminable area of the second display screen is active, the first signal is exported, in the first display screen
Middle display related information；
When the predeterminable area of the second display screen is in unactivated state, third signal is exported, described first
Display screen carries out hiding the related information when content display.
In above scheme, optionally, the first signal of output is also wrapped before showing related information in the first display screen
It includes：
Obtain operation data；
Related information to be shown is determined based on the operation data.
The embodiment of the present application provides a kind of control device, and the control device includes：
First control unit, for exporting second signal, with the displaying target object in second display screen；
Determination unit, for determining the attribute information and/or the target object of second display screen；
Second control unit, for attribute information and/or the target object based on the second display screen, output the
One signal, to show related information in the first display screen；
Wherein, first display screen and at least one in the second display screen are virtual screen, and the virtual screen is
Light is projected the virtual image to be formed to show by optics module.
The embodiment of the present application provides a kind of control device, and the control device includes：
Processor, for determining the attribute information and/or the target object of second display screen；
Controller, for exporting second signal, with the displaying target object in second display screen；Based on second display
The attribute information of screen and/or the target object export the first signal, to show related information in the first display screen, wherein
At least one in first display screen and the second display screen is virtual screen, and the virtual screen is optics module by light
The virtual image of formation is projected to be shown.
The embodiment of the present application also provides a kind of computer storage medium, calculating is stored in the computer storage medium
Machine executable instruction, the computer executable instructions are for executing control method described in the embodiment of the present application.
Using the technical solution of the embodiment of the present application, second signal is exported, with the displaying target object in second display screen；
Attribute information and/or the target object based on the second display screen export the first signal, to show in the first display screen
Show related information, wherein at least one in first display screen and the second display screen is virtual screen, the virtual screen
Light is projected to the virtual image to be formed for optics module to show；In this way, by the displaying target object in second display screen,
Related information is shown in the first display screen simultaneously, gives the display mode that the first display screen and second display screen combine,
The interactive efficiency between virtual screen and physical display screen can be improved.
Detailed description of the invention
Fig. 1 is the implementation process schematic diagram one of control method provided by the embodiments of the present application；
Fig. 2 is the schematic diagram one provided by the embodiments of the present application that related information is shown in the first display screen；
Fig. 3 is the schematic diagram two provided by the embodiments of the present application that related information is shown in the first display screen；
Fig. 4 is the schematic diagram three provided by the embodiments of the present application that related information is shown in the first display screen；
Fig. 5 is the schematic diagram four provided by the embodiments of the present application that related information is shown in the first display screen；
Fig. 6 is the schematic diagram five provided by the embodiments of the present application that related information is shown in the first display screen；
Fig. 7 is the implementation process schematic diagram two of control method provided by the embodiments of the present application；
Fig. 8 is the implementation process schematic diagram three of control method provided by the embodiments of the present application；
Fig. 9 is the structural schematic diagram one of control device provided by the embodiments of the present application；
Figure 10 is the structural schematic diagram two of control device provided by the embodiments of the present application.
Specific embodiment
The characteristics of in order to more fully hereinafter understand the application and technology contents, with reference to the accompanying drawing to the reality of the application
It is now described in detail, appended attached drawing purposes of discussion only for reference, is not used to limit the application.
The technical solution of the application is further elaborated in the following with reference to the drawings and specific embodiments.
Embodiment one
A kind of control method is present embodiments provided, as shown in Figure 1, the control method mainly includes the following steps that：
Step 101：Second signal is exported, with the displaying target object in second display screen.
In the present embodiment, the second display screen is preferably virtual screen.
Here, the target object can be including but not limited to：Object either control.
For example, the target object can be the objects such as three-dimension object, 3D video.
For example, the target object can be the controls such as AR button.
Step 102：Attribute information and/or the target object based on the second display screen export the first signal, with
Related information is shown in the first display screen.
Wherein, first display screen and at least one in the second display screen are virtual screen, and the virtual screen is
Light is projected the virtual image to be formed to show by optics module.
Optionally, first display screen is virtual screen or physics screen.
Preferably, first display screen is physics screen.
Optionally, the related information, including at least one of：
For adjusting the first information of the second display screen attribute；Or
For adjusting the second information of the target object；Or
The third information of the associated display content of the target object is neutralized for adjusting the second display screen；Or
Associated 4th information of content of the target object is neutralized for adjusting the second display screen.
That is, the related information includes that the control information of screen, the control information of object, the information content of object are bigger
Supplemental information etc..
As an implementation, the attribute information based on the second display screen exports the first signal, with aobvious first
Related information is shown in display screen；Wherein, the related information includes the first information for adjusting the second display screen attribute.
Here, the attribute includes but is not limited to resolution ratio, display pattern, color format space, refreshing frequency etc..
Fig. 2 shows a kind of schematic diagrames that related information is shown in the first display screen, as shown in Fig. 2, second display screen
(virtual screen) is located at right side, and the first display screen (physics screen) is located at left side, shows control on the first display screen (physics screen)
The toolbar of virtual screen.As shown in Fig. 2, the toolbar is for controlling close to the edge show toolbar of virtual screen on physics screen
Scaling, movement, shape, position and size of virtual screen processed etc..
That is, display object has been not necessarily intended in second display screen, because what can be showed on the first display screen is
The control button of second display screen entirety.
In this way, the first display screen can be based on the category of the second display screen when displaying target object in second display screen
Property information, shows related information, consequently facilitating showing or controlling second display screen at the first display screen end in the first display screen
Attribute.
As an implementation, the target object shown based on second display screen exports the first signal, with aobvious first
Related information is shown in display screen；Wherein, the related information includes the second information for adjusting the target object.
Here, second information includes but is not limited to use in toolbar, the button etc. for controlling the target object.
Fig. 3 shows a kind of schematic diagram that related information is shown in the first display screen, as shown in figure 3, in the second display
AR threedimensional model is shown on screen (virtual screen), and the tool of control AR threedimensional model is shown on the first display screen (physics screen)
Column.As shown in figure 3, the edge of close model shows the associated toolbar on physics screen if virtual screen is showing threedimensional model, use
The real-time scaling to the AR threedimensional model, rotation, mobile etc. can be realized in the mouse action toolbar.
Fig. 4 shows a kind of schematic diagram that related information is shown in the first display screen, as shown in figure 4, in the second display
3D video being played on is shown on screen (virtual screen), and the work of control video playing is shown on the first display screen (physics screen)
Has column.As shown in figure 4, physics platen edge shows the associated toolbar if virtual screen is playing 3D video, the toolbar is controllable
Video playing, pause, adjusting progress, adjusting volume etc..
In this way, the first display screen can be shown based on the second display screen when displaying target object in second display screen
Target object, related information is shown in the first display screen, consequently facilitating it is aobvious to show or control second at the first display screen end
Target object in display screen.
As an implementation, the target object shown based on second display screen exports the first signal, with aobvious first
Related information is shown in display screen；Wherein, the related information includes neutralizing the target pair for adjusting the second display screen
As the third information of associated display content.
Here, the third information includes but is not limited to associated more detailed or specifically or more with target object
The information of further sum.
Fig. 5 shows a kind of schematic diagram that related information is shown in the first display screen, as shown in figure 5, in the second display
Multiple AR objects are shown on screen (virtual screen), and the details text letter of some AR object is shown on the first display screen (physics screen)
Breath.As shown in figure 5, when user sees to certain AR object, in the related details text letter of the physically displayed screen display AR object
Breath.
In this way, the first display screen can be shown based on the second display screen when displaying target object in second display screen
Target object, related information is shown in the first display screen, consequently facilitating showing or adjusting and second at the first display screen end
The associated display content of target object in display screen.
As an implementation, the target object shown based on second display screen exports the first signal, with aobvious first
Related information is shown in display screen；Wherein, the related information includes for adjusting in second display screen and the content of target object
Associated 4th information.
Here, the 4th information includes and the associated information of the content of target object.
Fig. 6 shows a kind of schematic diagram that related information is shown in the first display screen, as shown in fig. 6, in the second display
Multiple AR buttons are shown on screen (virtual screen), and setting window corresponding with the AR button is shown on the first display screen (physics screen)
Mouthful.As shown in fig. 6, window is arranged accordingly in physics screen display, user can be grasped by mouse when user sees to AR button
The setting window of opposing is configured.
In this way, the first display screen can be shown based on the second display screen when displaying target object in second display screen
Target object, related information is shown in the first display screen, consequently facilitating it is aobvious to show or adjust second at the first display screen end
The content of target object in display screen.
The display control technology scheme of the embodiment of the present application, by the displaying target object in second display screen, while
Related information is shown in first display screen, namely has related letter corresponding to second display screen by showing on the first display screen
Breath, gives the display mode that the first display screen and second display screen combine, and can improve second display screen (virtual screen) and the
Interactive efficiency between one display screen (physics screen).
Embodiment two
A kind of control method is present embodiments provided, as shown in fig. 7, the control method mainly includes the following steps that：
Step 701：Second signal is exported, with the displaying target object in second display screen.
In the present embodiment, the second display screen is preferably virtual screen.
Here, the target object can be including but not limited to：Object either control.
For example, the target object can be the objects such as three-dimension object, 3D video.
For example, the target object can be the controls such as AR button.
Step 702：Attribute information and/or the target object based on the second display screen export the first signal, with
The related information is shown in the target display location of first display screen, wherein the target display location and described the
The attribute information of the attribute information of two display screens and/or the target object matches.
In some alternative embodiments, the first signal is exported, in the target display location of first display screen
Show the related information, including：
Spatial relation and/or the target pair based on the second display screen relative to first display screen
As the display position in the second display screen, the target display location is determined.
In some alternative embodiments, the target display location in first display screen shows the association
Information, including：
Determining the first display area being adapted with the related information；
The first display area on the first display screen, shows the related information；
Wherein, first display area is the fringe region of first display screen nearest apart from the target object.
In this way, since target display location is the spatial relation with second display screen relative to the first display screen, and/
Or display position of the target object in second display screen is referring to foundation, the related information is shown in nearby location, makes
User is obtained in comfortable visual angle, can see the real-time change of AR object, but also in virtual screen not only convenient for operating on physics screen
AR object is controlled, so that more intuitive to the adjusting of target object in virtual screen, faster.
In above scheme, optionally, the method also includes：
Obtain the object run signal based on the related information；
Based on the object run signal, at least one of is adjusted：
The attribute of the second display screen；Or
The target object；Or
The second display screen neutralizes the associated display content of target object.
In this way, being controlled by the related information to the first display screen display, to realize to second display screen or the
The control of target object on two display screens.
Embodiment three
A kind of control method is present embodiments provided, as shown in figure 8, the control method mainly includes the following steps that：
Step 801：Second signal is exported, with the displaying target object in second display screen.
In the present embodiment, the second display screen is preferably virtual screen.
Here, the target object can be including but not limited to：Object either control.
For example, the target object can be the objects such as three-dimension object, 3D video.
For example, the target object can be the controls such as AR button.
Step 802：Operation data is obtained, related information to be shown is determined based on the operation data.
In some alternative embodiments, the acquisition operation data, including：
Obtain the operation data for the target object using the input of AR equipment；Or
Obtain the operation data for the target object inputted from electronic equipment side.
In some alternative embodiments, the acquisition operation data, including：
Obtain the operation data for second display screen using the input of AR equipment；Or
Obtain the operation data for second display screen inputted from electronic equipment side.
In some alternative embodiments, the first signal is exported, before showing related information in the first display screen,
Further include：
Obtain the first trigger action signal received on the first display screen.
In some alternative embodiments, the first signal is exported, before showing related information in the first display screen,
Further include：
Obtain the second trigger action signal received on a second display.
In the present embodiment, the trigger timing of presentation is not defined, that is to say, that both can be by the second display
Operation on screen triggers, and can also be triggered by the operation on the first display screen.
Step 803：When the predeterminable area of the second display screen is active, the first signal is exported, the
Related information is shown in one display screen.
In some alternative embodiments, related information is shown in the first display screen, including：
When based on the operation data determine related information to be shown be text envelope relevant to the target object
When breath, the length of the text information is obtained；
If the length is greater than preset value, the text information described in the first display screen display.
In some alternative embodiments, related information is shown in the first display screen, including：
When based on the operation data determine related information to be shown be control strip relevant to the target object
When, determine the corresponding control strip setting window of the control strip；
On the first display screen, window is arranged with the control strip in display.
Step 804：When the predeterminable area of the second display screen is in unactivated state, export third signal, with
First display screen carries out hiding the related information when content display.
For example, the position and direction relationship according to AR helmet relative to computer, therefore can track and be sentenced with account is dynamic
Disconnected user currently see to AR object.When user sees to certain AR object, judges AR object space, correspond to position in physics platen edge
It sets expansion window and loads corresponding contents；When mouse window exterior domain, the window is hidden.
The display control technology scheme of the embodiment of the present application is associated with by show or hide in due course on the first display screen and is believed
Breath, convenient for preferably to second display screen or second display screen in target object control.
Example IV
A kind of control device is present embodiments provided, is applied to the first equipment, as shown in figure 9, described device includes：
First control unit 91, for exporting second signal, with the displaying target object in second display screen；
Determination unit 92, for determining the attribute information and/or the target object of second display screen；
Second control unit 93, for attribute information and/or the target object based on the second display screen, output
First signal, to show related information in the first display screen；
Wherein, first display screen and at least one in the second display screen are virtual screen, and the virtual screen is
Light is projected the virtual image to be formed to show by optics module.
Wherein, first display screen is the physics screen in the first equipment, and the second display screen can be understood as second
The display screen of equipment, second equipment are AR equipment, it is understood that the virtual screen being derived by the first equipment.
As an alternative embodiment, second control unit 93, is also used to：
The first signal is exported, the related information is shown with the target display location in first display screen, wherein institute
The attribute information of the attribute information and/or the target object of stating target display location and the second display screen matches.
As an alternative embodiment, second control unit 93, is also used to：
Spatial relation and/or the target pair based on the second display screen relative to first display screen
As the display position in the second display screen, the target display location is determined.
Still optionally further, described device further includes：
First acquisition unit 94, for exporting the first signal in second control unit 93, in the first display screen
It further include at least one of before showing related information：
Acquisition receives the first trigger action signal on first display screen；Or
Acquisition receives the second trigger action signal on the second display screen.
In above scheme, optionally, the related information, including at least one of：
For adjusting the first information of the second display screen attribute；Or
For adjusting the second information of the target object；Or
The third information of the associated display content of the target object is neutralized for adjusting the second display screen；Or
Associated 4th information of content of the target object is neutralized for adjusting the second display screen.
In above scheme, still optionally further, described device further includes：
Second acquisition unit 95, is used for：
Obtain the object run signal based on the related information；
Based on the object run signal, at least one of is adjusted：
The attribute of the second display screen；Or
The target object；Or
The second display screen neutralizes the associated display content of target object.
In above scheme, still optionally further, second control unit 93 is also used to：
When the predeterminable area of the second display screen is active, the first signal is exported, in the first display screen
Middle display related information；
When the predeterminable area of the second display screen is in unactivated state, third signal is exported, described first
Display screen carries out hiding the related information when content display.
In above scheme, still optionally further, described device further includes：
Third acquiring unit 96, for exporting the first signal in second control unit 93, in the first display screen
Before showing related information, operation data is obtained；Related information to be shown is determined based on the operation data.
It should be noted that：Control device provided by the above embodiment is when carrying out display control, only with above-mentioned each program
The division progress of module can according to need for example, in practical application and distribute above-mentioned processing by different program moulds
Block is completed, i.e., the internal structure of server is divided into different program modules, described above all or part of to complete
Processing.In addition, control device provided by the above embodiment and control method embodiment belong to same design, process is implemented
It is detailed in embodiment of the method, which is not described herein again.
In the present embodiment, first control unit 91, determination unit 92, the second control unit 93 in the control device,
First acquisition unit 94, second acquisition unit 95 and third acquiring unit 96, in practical applications can be by the control device
Or central processing unit (CPU, Central Processing Unit), number letter where the control device in the first equipment
Number processor (DSP, Digital Signal Processor), micro-control unit (MCU, Microcontroller Unit) or
Programmable gate array (FPGA, Field-Programmable Gate Array) etc. is realized.
First equipment described in the present embodiment includes but is not limited to have the equipment of physical display screen, such as desktop computer or pen
Remember this computer or tablet computer or mobile phone or TV etc..
Second equipment described in the present embodiment includes but is not limited to have the equipment of virtual display, such as AR equipment.
Control device described in the present embodiment is able to achieve the control to target object on second display screen or second display screen.
Embodiment five
A kind of control device is present embodiments provided, the first equipment, as shown in Figure 10, the control device packet are applied to
It includes：
Processor 10, for determining the attribute information and/or the target object of second display screen；
Controller 20, for exporting second signal, with the displaying target object in second display screen；It is aobvious based on described second
The attribute information of display screen and/or the target object export the first signal, to show related information in the first display screen,
In, at least one in first display screen and the second display screen is virtual screen, and the virtual screen will for optics module
Light projects the virtual image to be formed to be shown.
As an alternative embodiment, the controller 20, is also used to：
The first signal is exported, the related information is shown with the target display location in first display screen, wherein institute
The attribute information of the attribute information and/or the target object of stating target display location and the second display screen matches.
As an alternative embodiment, the controller 20, is also used to：
Spatial relation and/or the target pair based on the second display screen relative to first display screen
As the display position in the second display screen, the target display location is determined.
As an alternative embodiment, the processor 10, is also used to：
The first signal is exported in the controller 20, before showing related information in the first display screen,
Acquisition receives the first trigger action signal on first display screen；Or
Acquisition receives the second trigger action signal on the second display screen.
In above scheme, optionally, the related information, including at least one of：
For adjusting the first information of the second display screen attribute；Or
For adjusting the second information of the target object；Or
The third information of the associated display content of the target object is neutralized for adjusting the second display screen；Or
Associated 4th information of content of the target object is neutralized for adjusting the second display screen.
As an alternative embodiment, the processor 10, is also used to：Obtain the target based on the related information
Operation signal；
Accordingly, the controller 20 is also used to adjust at least one of based on the object run signal：
The attribute of the second display screen；Or
The target object；Or
The second display screen neutralizes the associated display content of target object.
In above scheme, the controller 20 is also used to：
When the predeterminable area of the second display screen is active, the first signal is exported, in the first display screen
Middle display related information；
When the predeterminable area of the second display screen is in unactivated state, third signal is exported, described first
Display screen carries out hiding the related information when content display.
As an alternative embodiment, the processor 10, is also used to：
The first signal is exported in the controller 20, before showing related information in the first display screen, obtains operation
Data；Related information to be shown is determined based on the operation data.
Wherein, first display screen is the physics screen in the first equipment, and the second display screen can be understood as second
The display screen of equipment, second equipment are AR equipment, it is understood that the virtual screen being derived by the first equipment.
First equipment described in the present embodiment includes but is not limited to have the equipment of physical display screen, such as desktop computer or pen
Remember this computer or tablet computer or mobile phone or TV etc..
Second equipment described in the present embodiment includes but is not limited to have the equipment of virtual display, such as AR equipment.
Control device described in the present embodiment is able to achieve the control to target object on second display screen or second display screen.
Embodiment six
Computer storage medium provided in this embodiment, is stored thereon with computer instruction, which is executed by processor
Shi Shixian：Second signal is exported, with the displaying target object in second display screen；Attribute information based on the second display screen
And/or the target object, the first signal is exported, to show related information in the first display screen, wherein first display
Screen is virtual screen at least one in the second display screen, and the virtual screen is that light is projected the void to be formed by optics module
As being shown.
It will be appreciated by those skilled in the art that in the computer storage medium of the present embodiment each program function, can refer to
The associated description of control method described in foregoing embodiments and understand, details are not described herein.
Herein described control program shows the contents such as object or control in virtual interface, in actual physics screen display
The contents such as corresponding text information or specific control strip do fine setting on main screen physics screen as far as possible, reduce in virtual interface
On setting, and then also just reduce the dynamic control of head, operated by mouse, Trackpad etc., control virtual interface on physics screen
On content, rapid operation more dynamic than AR and efficiently, accuracy rate is higher, more easily it is laborsaving.In this way, being combined using physics screen and AR
Interactive mode, the experience under AR environment can be improved.
Herein described control program at least has following advantage：
1. physics screen is better than virtual screen display effect, reduces to the greatest extent and does a large amount of word reads and fine setting in AR environment,
Mitigate eye fatigue burden.
2. mouse on physics screen, Trackpad operate rapid operation more dynamic than AR and efficiently, it is in main screen physics screen as far as possible
On do fine setting, accuracy rate is higher, more easily it is laborsaving.
3. it can see the real-time change of AR object in visual field scope when the toolbar of screen edge is adjusted,
Compared with opening directly on physics screen, setting window adjusting is more intuitive quick.
It, in the absence of conflict, can be in any combination between technical solution documented by each embodiment of the application.
In several embodiments provided herein, it should be understood that disclosed server and method can pass through
Other modes are realized.Apparatus embodiments described above are merely indicative, for example, the division of the unit, only
For a kind of logical function partition, there may be another division manner in actual implementation, such as：Multiple units or components can combine,
Or it is desirably integrated into another system, or some features can be ignored or not executed.In addition, shown or discussed each composition
Partially mutual coupling or direct-coupling or communication connection can be through some interfaces, the indirect coupling of equipment or unit
It closes or communicates to connect, can be electrical, mechanical or other forms.
Above-mentioned unit as illustrated by the separation member, which can be or may not be, to be physically separated, aobvious as unit
The component shown can be or may not be physical unit, it can and it is in one place, it may be distributed over multiple network lists
In member；Some or all of units can be selected to achieve the purpose of the solution of this embodiment according to the actual needs.
In addition, each functional unit in each embodiment of the application can be fully integrated in one processing unit, it can also
To be each unit individually as a unit, can also be integrated in one unit with two or more units；It is above-mentioned
Integrated unit both can take the form of hardware realization, can also realize in the form of hardware adds SFU software functional unit.
Those of ordinary skill in the art will appreciate that：Realize that all or part of the steps of above method embodiment can pass through
The relevant hardware of program instruction is completed, and program above-mentioned can be stored in a computer readable storage medium, the program
When being executed, step including the steps of the foregoing method embodiments is executed；And storage medium above-mentioned includes：It is movable storage device, read-only
Memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or
The various media that can store program code such as person's CD.
If alternatively, the above-mentioned integrated unit of the application is realized in the form of software function module and as independent product
When selling or using, it also can store in a computer readable storage medium.Based on this understanding, the application is implemented
Substantially the part that contributes to existing technology can be embodied in the form of software products the technical solution of example in other words,
The computer software product is stored in a storage medium, including some instructions are used so that computer equipment (can be with
Personal computer, server or network equipment etc.) execute each embodiment the method for the application all or part.
And storage medium above-mentioned includes：Movable storage device, ROM, RAM, magnetic or disk etc. are various to can store program code
Medium.
The above, the only specific embodiment of the application, but the protection scope of the application is not limited thereto, it is any
Those familiar with the art within the technical scope of the present application, can easily think of the change or the replacement, and should all contain
Lid is within the scope of protection of this application.Therefore, the protection scope of the application should be based on the protection scope of the described claims.
Claims (10)
1. a kind of control method, which is characterized in that the method includes：
Second signal is exported, with the displaying target object in second display screen；
Attribute information and/or the target object based on the second display screen export the first signal, in the first display screen
Middle display related information, wherein at least one in first display screen and the second display screen is virtual screen, the void
Quasi- screen is that light is projected the virtual image to be formed to show by optics module.
2. according to the method described in claim 1, output the first signal, to show related information in the first display screen, including：
The first signal is exported, the related information is shown with the target display location in first display screen, wherein the mesh
Mark display position matches with the attribute information of the second display screen and/or the attribute information of the target object.
3. according to the method described in claim 2, the first signal is exported, with aobvious in the target display location of first display screen
Show the related information, including：
Existed based on the second display screen relative to the spatial relation of first display screen and/or the target object
Display position in the second display screen determines the target display location.
4. according to the method described in claim 1, output the first signal, before showing related information in the first display screen,
It further include at least one of：
Acquisition receives the first trigger action signal on first display screen；Or
Acquisition receives the second trigger action signal on the second display screen.
5. according to the method described in claim 1, the related information, including at least one of：
For adjusting the first information of the second display screen attribute；Or
For adjusting the second information of the target object；Or
The third information of the associated display content of the target object is neutralized for adjusting the second display screen；Or
Associated 4th information of content of the target object is neutralized for adjusting the second display screen.
6. according to the method described in claim 1, the method also includes：
Obtain the object run signal based on the related information；
Based on the object run signal, at least one of is adjusted：
The attribute of the second display screen；Or
The target object；Or
The second display screen neutralizes the associated display content of target object.
7. according to the method described in claim 1, the method also includes：
When the predeterminable area of the second display screen is active, the first signal is exported, to show in the first display screen
Show related information；
When the predeterminable area of the second display screen is in unactivated state, third signal is exported, in first display
Screen carries out hiding the related information when content display.
8. the method according to claim 1, wherein the first signal is exported, to show pass in the first display screen
Before joining information, further include：
Obtain operation data；
Related information to be shown is determined based on the operation data.
9. a kind of control device, which is characterized in that the control device includes：
First control unit, for exporting second signal, with the displaying target object in second display screen；
Determination unit, for determining the attribute information and/or the target object of second display screen；
Second control unit, for attribute information and/or the target object based on the second display screen, the first letter of output
Number, to show related information in the first display screen；
Wherein, first display screen and at least one in the second display screen are virtual screen, and the virtual screen is optics
Light is projected the virtual image to be formed to show by mould group.
10. a kind of control device, which is characterized in that the control device includes：
Processor, for determining the attribute information and/or the target object of second display screen；
Controller, for exporting second signal, with the displaying target object in second display screen；Based on the second display screen
Attribute information and/or the target object export the first signal, to show related information in the first display screen, wherein described
At least one in first display screen and the second display screen is virtual screen, and the virtual screen is that optics module projects light
The virtual image of formation is shown.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810690164.XA CN108829256A (en) | 2018-06-28 | 2018-06-28 | A kind of control method and device |
| PCT/CN2018/116455 WO2020000880A1 (en) | 2018-06-28 | 2018-11-20 | Control method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810690164.XA CN108829256A (en) | 2018-06-28 | 2018-06-28 | A kind of control method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108829256A true CN108829256A (en) | 2018-11-16 |
Family
ID=64134472
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810690164.XA Pending CN108829256A (en) | 2018-06-28 | 2018-06-28 | A kind of control method and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108829256A (en) |
| WO (1) | WO2020000880A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020000880A1 (en) * | 2018-06-28 | 2020-01-02 | 联想(北京)有限公司 | Control method and device |
| CN114398112A (en) * | 2021-12-01 | 2022-04-26 | 瑞芯微电子股份有限公司 | Method, system and computer readable medium for controlling screen switching |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024013724A1 (en) | 2022-07-15 | 2024-01-18 | Pheon Therapeutics Ltd | Antibody-drug conjugates |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104657028A (en) * | 2013-11-18 | 2015-05-27 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN106774821A (en) * | 2016-11-08 | 2017-05-31 | 广州视源电子科技股份有限公司 | Display methods and system based on virtual reality technology |
| CN107544676A (en) * | 2017-09-08 | 2018-01-05 | 北京枭龙科技有限公司 | A kind of input method of AR glasses |
| CN107678715A (en) * | 2016-08-02 | 2018-02-09 | 北京康得新创科技股份有限公司 | The sharing method of virtual information, device and system |
| CN107728349A (en) * | 2016-08-12 | 2018-02-23 | 深圳市掌网科技股份有限公司 | The interactive device and method of changeable displaying content |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6733451B2 (en) * | 2015-12-17 | 2020-07-29 | 株式会社リコー | Coordinate detection system, coordinate detection method, image processing device, and program |
| CN106502604A (en) * | 2016-09-28 | 2017-03-15 | 北京小米移动软件有限公司 | Throw screen changing method and device |
| CN108829256A (en) * | 2018-06-28 | 2018-11-16 | 联想(北京)有限公司 | A kind of control method and device |
-
2018
- 2018-06-28 CN CN201810690164.XA patent/CN108829256A/en active Pending
- 2018-11-20 WO PCT/CN2018/116455 patent/WO2020000880A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104657028A (en) * | 2013-11-18 | 2015-05-27 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN107678715A (en) * | 2016-08-02 | 2018-02-09 | 北京康得新创科技股份有限公司 | The sharing method of virtual information, device and system |
| CN107728349A (en) * | 2016-08-12 | 2018-02-23 | 深圳市掌网科技股份有限公司 | The interactive device and method of changeable displaying content |
| CN106774821A (en) * | 2016-11-08 | 2017-05-31 | 广州视源电子科技股份有限公司 | Display methods and system based on virtual reality technology |
| CN107544676A (en) * | 2017-09-08 | 2018-01-05 | 北京枭龙科技有限公司 | A kind of input method of AR glasses |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020000880A1 (en) * | 2018-06-28 | 2020-01-02 | 联想(北京)有限公司 | Control method and device |
| CN114398112A (en) * | 2021-12-01 | 2022-04-26 | 瑞芯微电子股份有限公司 | Method, system and computer readable medium for controlling screen switching |
| CN114398112B (en) * | 2021-12-01 | 2024-05-14 | 瑞芯微电子股份有限公司 | Method, system and computer readable medium for controlling screen switching |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020000880A1 (en) | 2020-01-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10860838B1 (en) | Universal facial expression translation and character rendering system | |
| US20150089452A1 (en) | System and Method for Collaborative Computing | |
| US20150286364A1 (en) | Editing method of the three-dimensional shopping platform display interface for users | |
| CN108829256A (en) | A kind of control method and device | |
| JP3705826B2 (en) | Virtual three-dimensional window display control method | |
| JP5771329B2 (en) | Method and apparatus for generating dynamic wallpaper | |
| US20100231590A1 (en) | Creating and modifying 3d object textures | |
| WO2022218146A1 (en) | Devices, methods, systems, and media for an extended screen distributed user interface in augmented reality | |
| WO2007035988A1 (en) | An interface for computer controllers | |
| US20220358739A1 (en) | Method, device and computer program product for manipulating virtual bounding volumes | |
| De Almeida et al. | Looking behind bezels: French windows for wall displays | |
| US9384593B2 (en) | Level of detail processing | |
| KR101809601B1 (en) | Apparatus and method for producing animation | |
| JP5920858B1 (en) | Program, information processing apparatus, depth definition method, and recording medium | |
| Miranda et al. | Sketch express: facial expressions made easy | |
| KR102388773B1 (en) | Method for three dimensions modeling service and Apparatus therefor | |
| JP5767371B1 (en) | Game program for controlling display of objects placed on a virtual space plane | |
| JP4931240B2 (en) | A system to support image recognition | |
| CN109461215A (en) | Generation method, device, computer equipment and the storage medium of role's artistic illustration | |
| GB2533777A (en) | Coherent touchless interaction with steroscopic 3D images | |
| EP2816521A1 (en) | Editing method of the three-dimensional shopping platform display interface for users | |
| JP7475625B2 (en) | Method and program for receiving and displaying input in three-dimensional space, and device for receiving and displaying input in three-dimensional space | |
| JPH1166351A (en) | Method and device for controlling object operation inside three-dimensional virtual space and recording medium recording object operation control program | |
| Palleis et al. | Novel indirect touch input techniques applied to finger-forming 3d models | |
| JPH07271998A (en) | Method and device for three-dimensional display |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |