CN102609177A - Display system for controlling a selector symbol within an image - Google Patents

Display system for controlling a selector symbol within an image Download PDF

Info

Publication number
CN102609177A
CN102609177A CN2011104068692A CN201110406869A CN102609177A CN 102609177 A CN102609177 A CN 102609177A CN 2011104068692 A CN2011104068692 A CN 2011104068692A CN 201110406869 A CN201110406869 A CN 201110406869A CN 102609177 A CN102609177 A CN 102609177A
Authority
CN
China
Prior art keywords
display screen
touch
operator
selector
dimensional
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2011104068692A
Other languages
Chinese (zh)
Other versions
CN102609177B (en
Inventor
J·努塔罗
S·格罗瑟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honeywell International Inc
Original Assignee
Honeywell International Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honeywell International Inc filed Critical Honeywell International Inc
Publication of CN102609177A publication Critical patent/CN102609177A/en
Application granted granted Critical
Publication of CN102609177B publication Critical patent/CN102609177B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C23/00Combined instruments indicating more than one navigational value, e.g. for aircraft; Combined measuring devices for measuring two or more variables of movement, e.g. distance, speed or acceleration
    • G01C23/005Flight directors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04812Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units

Abstract

A display system for controlling a selector symbol within an image includes, but is not limited to, a display screen that is configured to detect a touch of an operator on a surface of the display screen and that is further configured to display a three-dimensional image. The display system further includes a processor that is operatively coupled to the touch screen. The processor is configured to command the display screen to display a three-dimensional selector symbol within the three-dimensional image, and to command the display screen to move the selector symbol within the three-dimensional image in a manner that corresponds with the touch of the operator.

Description

The display system of the selector in the control chart picture
Technical field
The present technique field is usually directed to display system, and relates in particular to a kind of display system that is used for the selector in the control chart picture.
Background technology
Need not to wear professional glasses or other eyeshades and promptly can show that the three-dimensional display system that appears begins to come into the market in field of three dimension true to nature.This display system has adopted stereo technology, and it causes real depth of field impression for this part spectators.Estimate that this display system will significantly get into the market space of being captured by the traditional two-dimensional display system at present.
An intended use of this display system is in aircraft industry.Can field of three dimension true to nature show the three-dimensional display system that appear possibly to the pilot provide situation perception and the bigger ability of enhancing come perception aerial and below ground environment.Such display system for example, can be used to be presented at during the flight around the aircraft and the ground environment of below, is used to show the description of other aerial objects, and/or shows the tripleplane of the flight path of aircraft through three-dimensional environment.Existing systems; The vision system of synthetic for example; Attempt adopting two-dimensional display to provide this information to show two dimensional image to the pilot; This two dimensional image is to use the common image technology of creating perspective appearance to reproduce, but can be contemplated that the display system that can show real 3-D view will strengthen the ability of pilot's absorption about space environment information.
Though three-dimensional display system has just begun to come into the market, touch screen display system is well-known and has been widely used in all trades and professions and provides control to be input in the command system for many years.Although this large-scale Rapid Expansion, touch screen display system is very limited in the infiltration of aviation field.Yet recently, this situation has begun to change, and touch screen display system is just more and more frequent at present is applied to for example control the various systems of aircraft airborne in the various application relevant with aviation.
Be configured to some display systems that present 3-D view and also combined the touch-sensitive technology, thereby allow the operator directly mutual through touching with 3-D view.Yet; Because such display system presents 3-D view true to nature; Therefore, may be more and more challenging on the symbol that shows in the 3-D view thereby select icon exactly or be locked in through the part on the surface of the display screen of touch display system only.This is to be in diverse location because the object that the operator is attempting to click will look like, and this depends on the angle that this 3-D view is observed.Because can not reaching through the surface of this display screen and enter into this three-dimensional environment, the operator touches object; When operator's trial was mutual with 3-D view, the use of normal touch screen technology showed that together with being configured to the display system of 3-D view can cause bluring.
Summary of the invention
Disclosed herein is the various embodiment that are used for the display system of selector in the control chart picture.
In one embodiment, display system includes but not limited to, display screen, and it is configured to detecting operation person in the lip-deep touch of this display screen and further be configured to show 3-D view.This system further comprises processor, and it operatively is coupled to this touch-screen.This processor is configured to this display screen of order and in 3-D view, shows three-dimensional selector, and orders this display screen in this 3-D view, to move this selector according to the mode that conforms to operator's touch.
In another embodiment, display system includes but not limited to, display screen, and it is configured to the lip-deep touch of detecting operation person at this display screen, and further is configured to show 3-D view.This display system further comprises processor, and it operatively is coupled to this touch-screen.This processor is configured to this display screen of order and in 3-D view, shows three-dimensional selector.This three-dimensional selector has first end and second end; First end is displayed on this touch-screen; Initially touch the primary importance at the surface place of this display screen near the operator, second end is displayed on this touch-screen, is positioned at and isolated second position of this first end.This processor is configured to further that this display screen of order shows should the three-dimensional selector, so that second end conforms to primary importance with respect to the direction of first end.This processor also further be configured to the order display screen in this 3-D view (38) according to touching position angle and the inclination angle that the mode conform to is adjusted this selector with the operator.
In another embodiment, display system includes but not limited to, display screen, and it is configured to the lip-deep touch of detecting operation person at this display screen, and further is configured to show 3-D view.This system further comprises input block, and it is configured to receive operator's input.This system also further comprises processor; It operatively is coupled to this touch-screen and this input block; This processor is configured to this display screen of order and in 3-D view, shows three-dimensional selector, and orders this display screen in this 3-D view, to move this three-dimensional selector according to the mode that the input with operator's touch and operator conforms to.
Description of drawings
To the present invention be described together with accompanying drawing below, the element that wherein identical numeral is identical, and
Fig. 1 is the synoptic diagram that the embodiment of the display system that is used to control the selector in the image that training centre according to the present invention processes is shown.
Fig. 2 is illustrated in the expression of the 3-D view that reproduces on the display system of Fig. 1 according to exemplary embodiment.
Fig. 3 illustrates the 3-D view as operator operation (engage) display screen Fig. 2 when starting the demonstration to three-dimensional selector according to exemplary embodiment.
Fig. 4 to Fig. 6 illustrates another strategy of the demonstration that starts three-dimensional selector according to exemplary embodiment.
Fig. 7 to Fig. 9 illustrates the another strategy of the demonstration that starts three-dimensional selector according to exemplary embodiment.
Figure 10 illustrates the distance between three-dimensional selector and the desired target according to exemplary embodiment.
Figure 11 to Figure 12 illustrates the orientation of the three-dimensional selector of control and the technology at inclination angle according to exemplary embodiment.
Figure 13 to Figure 14 illustrates the orientation of the three-dimensional selector of control and another technology at inclination angle according to exemplary embodiment.
Figure 15 to Figure 16 illustrates the orientation of the three-dimensional selector of control and another technology at inclination angle according to exemplary embodiment.
Figure 17 to Figure 19 illustrates the orientation of the three-dimensional selector of control and the another technology at inclination angle according to exemplary embodiment.
Figure 20 illustrates according to exemplary embodiment and need not to change its orientation or inclination angle and the technology of moving three dimension selector.
Figure 21 illustrates the technology of using three-dimensional selector to select and follow the trail of the objective according to exemplary embodiment.
Figure 22 is illustrated in the reproduction of a plurality of three-dimensional selectors in the 3-D view according to exemplary embodiment.
Embodiment
Following detailed only is exemplary in essence, rather than in order to limit the present invention or application of the present invention and use.In addition, all abandoned intention of any theory that is appeared in front background or the following detailed.
The invention discloses a kind of improved display system that is used for the selector in the control chart picture.This display system comprises display screen, and it is configured to reproduce 3-D view, is also referred to as stereo-picture.Term as used herein " three-dimensional " refers to the 3-D view that manifests true to nature that uses stereo technology or other technologies to reproduce; Wherein said other technologies are created image and/or (field), and this image and/or field have this image and/or in various elements between outward appearance true to nature and the depth of field true to nature of spatial relationship describe.The display that can show 3-D view is in U.S. Patent number 7,796,200; 7,796,134; 7,786,953 and 7,777, be disclosed in 950 the patent, therefore disclosed content whole merges in the present invention for your guidance.This display screen further is configured to the touch of detection on this display screen surface.Such touch can be used for command system input is provided, and this command system is by this display screen control or by the processor control of being coupled to this display screen communicatedly or operatively.Touch-screen display is well known in the art.Had multiple technologies, it allows the touch on the surface of this display screen is detected.The example of touch-screen display is in U.S. Patent number 4,521,870; 4,821,031; 5,038,142; 5,956,021; 6,259,491; Open in 6,297,811 and 6,492,979, therefore disclosed content whole merges in the present invention for your guidance.Term as used herein " touch " refers to any action of being taked by the operator, and it can be touched that panel type display detects and is identified as mutual and/actuation event by this touch-screen display.Touch can include, but not limited to contact with this touch-screen display actual physical.The operator can use finger, writing pencil, glo-stick, laser, or some other equipment touches the surface of this display screen.Such finger or other equipment will be referred to as " touch tool " at this.
This display system further comprises processor, and it is coupled to this display screen communicatedly and operatively and is configured to this display screen of order with the demonstration 3-D view, and further is presented at the three-dimensional selector in this 3-D view.For example; If this 3-D view is such landscape map (landscape): aircraft flies just in the above; And it comprises various structures and navigation flame float; Runway and for example based on the navigation flame float on ground etc., this three-dimensional selector possibly be shown as spotlight, and it looks like and extends into this landscape map from the surface of this display screen or extend into the sky more than the local horizon.In one embodiment, spotlight possibly be included in the illuminated zone of reproducing on the ground of this landscape map and extend to the visual drawing of the spotlight light beam in ground illuminated zone from the surface of this display screen.In other embodiments, this three-dimensional selector possibly be illuminated zone on the ground, and does not extend to the illuminated light beam part of display screen from ground.Still in other embodiment, this three-dimensional selector can be taked any suitable and/or required form, and can't help this discussion it is defined in any specific embodiment.
Processor further be configured to be based on detected touch on the surface of display screen and move should the three-dimensional selector through this 3-D view.For example, the position angle of this three-dimensional selector and inclination angle can based on touch tool on this display screen surface or moving of crossing this display screen surface and being modified.In certain embodiments, can in this display system, comprise additional input equipment.Should be operatively coupled to this processor by additional input equipment, and used to control moving of this three-dimensional selector together with this display screen by the operator.Through with input into this display system being provided via this touch-screen and via any additional input equipment, the operator can around and spread all over this 3-D view and rotate, rotate, and translation should the three-dimensional selector.In certain embodiments, when illuminated zone was positioned on the optional item (for example, runway or another airplane), this illuminated zone can change it and be configured to indicate and should the bright project of height can be selected.In this mode, the operator can handle this three-dimensional selector to be chosen in one or more in the various projects that shown in this 3-D view.
In certain embodiments, three-dimensional selector possibly look like and extend touch tool.For example, three-dimensional selector possibly appear to laser or the spotlight of pointing extension with operator's finger alignment and from the operator.This makes the operator can utilize the object that three-dimensional selector points to effectively and touch operation person hopes selection in the 3-D view.This display system can be configured to make when the operator rolls his or her finger on display screen; This three-dimensional selector its position angle of change and inclination angle are with the finger alignment of maintenance with the operator, and the extension of therefore serving as the operator's who arrives this 3-D view finger.In certain embodiments, this display system can make the operator to cross the surface of this display screen or in this 3-D view, to move whole three-dimensional selector through the use control panel through dragging his or her finger.
Utilization should the three-dimensional selector, and the operator can be chosen in the object that is shown in this 3-D view, its mode and operator can be in two dimension shows use cursor alternative or text identical.When the selectable object of illuminated zone process, its configuration can change.For example, thus this illuminated zone can change on color, size, shape and/or its combination in any and indication is provided for the operator: this to as if selectable.In certain embodiments, when illuminated zone through out-of-date, object itself can change on size, shape and/or color.In certain embodiments, this display system can be reproduced a plurality of three-dimensional selectors and has selecteed a plurality of selectable objects simultaneously for pilot's manipulation to allow the pilot in 3-D view.
Through to the review of the explanation that the application followed together with review to following detailed description, can obtain better understanding to the embodiment of the display system of selector in the control chart picture.
Fig. 1 is a synoptic diagram, and the display system 30 that is used to control three-dimensional selector is shown.Display system 30 comprise display screen 32, processor 34 and, in certain embodiments, additional input block 36.In other embodiments, because display screen 32 senses touch and the therefore ability of detecting operation person's input, additional input block 36 there is no need.Display screen 32 can be any suitable display screen, and it is configured to show this 3-D view, and further be configured to detection on this display screen surface touch and will be sent to processor 34 with the signal that detected touch conforms to.Additional input block 36 can be any traditional input equipment that is associated with computer system usually, and it is used by the operator thinks that computer system provides input.Such input equipment includes, but not limited to keyboard, touch pad, trace ball, mouse, operating rod, microphone, camera and motion detector.Input and generation that additional input block 36 is configured to receive from the operator also are transferred to processor 34 with this signal with the electronic signal that operator's input conforms to.
Processor 34 can be that set, state machine or any other of computing machine, computer system, microprocessor, the logical device of any kind is configured to calculate and/or execution algorithm and/or executive software application program and/or the analog or digital circuit carrying out subroutine and/or be loaded with and carry out the computer program of any kind.Processor 34 can comprise single-processor or a plurality of processors of keeping strokes.In certain embodiments, processor 34 can be specially and display system 30 be used, and in other embodiments, processor 34 can be shared with other system.In the embodiment of other other, processor 34 can be integrated in any other assembly of display system 30.For example, in certain embodiments, processor 34 can be the assembly of display screen 32 or additional input unit 36.
Processor 34 operatively is coupled to display screen 32 and additional input unit 36.Such operational coupled can be through using any suitable transmission mode to comprise wired and the wireless connections completion.For example, each assembly can connect through the line of concentric cable or the effective transmission of electric signals through any other type and physically is connected to processor 34.In other embodiments, each element can be coupled to processor 34 through bus or other similar communication ports.The example of the wireless connections that are fit to includes, but not limited to the wireless communication protocol by identifications such as bluetooth trade mark, Wi-Fi connection, infrared connections.
Operational coupled between processor 34 on the one hand and display screen on the other hand 32 and the additional input unit 36 is reception and the transmission that processor 34 provides signal, order, instruction and inquiry that the path is used to come and go each assembly.Display screen 32 and additional input block 36 all be configured to processor 34 transmission with by each component detection separately to the operator import the input signal that conforms to.For example; When on display screen 32 surfaces, detecting touch; Or work as the operator and click the mouse or the pull-up operating rod, display screen 32 is configured the electronic signal of generation corresponding to detected input with additional input block 36, and gives processor 34 with those electronic signal transmission.Processor 34 is configured (promptly; Processor 34 is loaded with and can carries out suitable computer code, software and/or application program) to receive the electronic signal that display screen 32 and additional input unit 36 are generated; And carry out mutual and coordination with display screen 32 and additional input unit 36, purpose is the three-dimensional selector that is controlled in the 3-D view that is shown on the display screen 32.When processor 34 receives the input signal that is provided by display screen 32 and/or by additional input block 36; Processor 34 sends a command to display screen 32, and its indicated number screen 32 is enabled in the demonstration of the three-dimensional selector on the display screen 32 and/or passes through 3-D view according to the mode moving three dimension selector that conforms to input signal.The demonstration of the three-dimensional selector of initialization, three-dimensional selector move and other characteristic will disclose hereinafter in more detail.
Fig. 2 illustrates the expression of the 3-D view 38 that the display screen 32 by the display system 30 of Fig. 1 reproduced.As directed, 3-D view 38 is the drawing that are positioned at aircraft (aircraft is not shown) below and/or landform on every side and other characteristics.Covering on the 3-D view 38 is traditional icon and symbol, such as but not limited to, compass 40, pitching gradient (pitch ladder) 42 and flight path mark 44.These icons offer the position of the relevant aircraft of operator and the information of direction with symbol.
What in 3-D view 38, illustrate equally is optional then target 46.Hope to select the operator of optional then target 46 at first will take to start the startup action that three-dimensional selector shows.In an illustrated embodiment, this startup action is the touch on display screen.For ease of reference, refer to " start and touch " this its.Fig. 2 only shows and is making the operator 48 who starts before touching.Operator 48 will make starting on the position 51 of display screen 32 and touch with finger 50.At some embodiment, before making the startup touch, the operator possibly at first need switch to appropriate mode to generate three-dimensional selector with display system 30.For example, the operator possibly at first need soft-touch control 52 display system 30 is arranged at a pattern, and it is enabled and generates three-dimensional selector in this pattern.In current embodiment, switch 52 is illustrated as the icon on the display screen.Be to be understood that any other equipment can be used to encourage three-dimensional selector, what comprise switch, button, lever or any other type is positioned at the driver on the flight-deck so that can generate three-dimensional selector.In other embodiments, three-dimensional selective system can occur based on any appropriate condition or environment automatically.In other embodiment, three-dimensional selector can show constantly.
Fig. 3 shows the 3-D view of Fig. 2 when operator's 48 operating display 32 start the demonstration of three-dimensional selector 54.Continue with reference to figure 1-3, when pointing 50 when contacting with position 51, display screen 32 detect point 50 and position 51 between contact and transfer signals to processor 34.Processor 34 receive this signal and, as the result of its programming, order is sent to display screen 32 to show three-dimensional selector 54.As 3-D view 38, three-dimensional selector 54 also is used the stereoscopic rendering technology and reproduces to pass on depth of field impression true to nature with real three-dimensional pattern.Three-dimensional selector 54 comprise illuminated regional 56 with light beam part 58.Shown in be in the example, three-dimensional selector 54 is similar to spotlight.In other embodiments, three-dimensional selector 54 possibly taked any other suitable shape and/or configuration.Illuminated regional 56 are reproduced so that it looks like the landform that touch is described in 3-D view 38.Light beam part 58 is extended towards display screen 32 from illuminated regional 56 backward, and has to look like and will touch the base portion of the display screen 32 under finger 50 just.In other embodiments; Three-dimensional selector 54 will have and (for example look like some objects of being parked in the 3-D view 38; Selectable object on landform, the landform, aerial object etc.) on away from part (for example illuminated regional 56); Look like the low coverage part that is parked on the display screen 32, and from low coverage part to away from the main body that extends partially in the 3-D view.Three-dimensional selector 54 is different from traditional selector, is that the three-dimensional reproduction of three-dimensional selector 54 quilts is to produce true to nature manifesting.
Processor 34 can use various strategies to control the inceptive direction of three-dimensional selector 54 in response to the startup on display screen 32 touches.In example shown in Figure 3, but processor 34 be configured to the directed so that three-dimensional selector 54 of three-dimensional selector 54 51 is extended to immediate select target from the position, in this case, be optional then target 46.Under this mode, three-dimensional selector 54 looks like from finger tip 50 and extends to optional then target 46.Discuss as present, other the strategy that is used for three-dimensional selector 54 initial reproducing also can be processed 34 uses of device.
Fig. 4-6 illustrates another strategy that starts the demonstration of three-dimensional selector.As shown in Figure 4, operator 48 is 61 touch display screens 32 in the position.Continue with reference to figure 1-6, the position of this touch and be shown and shield 32 and detect will pass on the signal about the information of this touch to send to processor 34 subsequently, comprise its lip-deep position at display screen 32 about the information of this touch.Thereby processor 34 shows that illuminated zone responds for display screen 32 order display screens 32 through sending signal.
As shown in Figure 5, after the order that receives from processor 34, display screen 32 in the position that conforms to the lip-deep position 61 of display screen 32 shows 3-D view 38 illuminated regional 56.In this, before the remainder of this three-dimensional selector can be reproduced, display system 30 was waited for and further being imported from operator 48.
As shown in Figure 6, operator 48 is through to the right and on downward a little direction, drag finger 50 and cross display screen 32 so additional input is provided.The screen 32 that should mobile be shown that finger 50 crosses the surface of display screen 32 detects and is transferred to processor 34.As response, processor 34 offers display screen 32 instruction with reconstruction beam part 58, just as from illuminated regional 56 parts that extend at the display screen 32 of this point on the display screen below the finger tip 50 32 below tightly.Use this technology, the operator can " spur " three-dimensional selector 54, just as having any desired length.
Fig. 7-9 illustrates and starts the another strategy that three-dimensional selector shows.As shown in Figure 7, operator 48 use finger 50 in the position 62 touch display screens 32.Continue with reference to figure 1-9, display screen 32 will detect this touch, and will be transferred to processor 34 corresponding to the signal (comprising that it is in display screen 32 lip-deep positions) of this touch.As response, processor 34 is transferred to display screen 32 with the projection three-dimensional selector with instruction, this three-dimensional selector be with the mode that conforms to the position of the lip-deep position 62 of display screen 32 from position 62 or finger tip 50 extend in the 3-D view 38.In an illustrated embodiment, if the optional position of the right half part of display screen 32 is dropped in position 62, then three-dimensional selector will be from the position 62 or finger tip 50 extend towards the left side of 3-D view 38.This is illustrated in Fig. 8, and wherein three-dimensional selector 54 upwards and left extends from pointing 50, and illuminated regional 56 fall into the left side of 3-D view 38.
Fig. 9 provides further specifying of this startup strategy.If detect initial touch in the left side of display screen 32 and the Lower Half of display screen 32.Then three-dimensional selector 54A will make progress and extend towards the right side of 3-D view 38.If detect initial touch on the right side of display screen 32 and the Lower Half of display screen 32, then three-dimensional selector 54B will extend upward and extend to the left side of 3-D view 38.If detect initial touch in the left side of display screen 32 and the first half of display screen 32, then three-dimensional selector 54C will extend downwards and towards the right side of 3-D view 38.If detect initial touch on the right side of display screen 32 and the first half of display screen 32, then three-dimensional selector 54D will extend downwards and towards the left side of 3-D view 38.Will be appreciated that aforementioned is not the startup Policy List of limit, and other startup strategy also is possible.In certain embodiments, after being activated, except controlling the direction of three-dimensional selector, display system 30 also can be configured to allow operator 48 to specify and/or revise length and/or other characteristics of this three-dimensional selector 54.
Figure 10 illustrates the distance between illuminated regional 56 and the optional then target 46 of three-dimensional selector 54.Because 3-D view 38 is three-dimensional three dimensional representations of operator's aircraft landform on every side; And because three-dimensional selector 54 is the tripleplanes that get in the 3-D view 38, therefore illuminated regional 56 and optional then target 46 between difference can be broken down into the component at position angle and the elevation angle or inclination angle.Inclination angle delta 64 representative illuminated regional 56 and optional then target 46 between the difference at the elevation angle.But position angle delta 66 representative illuminated regional 56 and select target 46 between azimuthal difference.Therefore; In order illuminated regional 56 to be positioned at optional then target 46 tops; The elevation angle of three-dimensional selector 54 is lowered the amount that equates with inclination angle delta 64, and the position angle of three-dimensional selector 54 is rotated the amount that equates with position angle delta 66 by counter clockwise direction (from the angle of Figure 10).The inclination angle of three-dimensional selector 54 and position angle can utilize suitable gesture to be input in the display system 30 and Be Controlled through using display screen 32, and in certain embodiments, can be through using the input block 36 that adds Be Controlled.
Figure 11-12 illustrates the technology at the position angle and the inclination angle that are used to control three-dimensional selector 54.Through operator 48 action that finger tip 50 rolls on the surface of display screen 32, three-dimensional selector 54 is rotated to position shown in Figure 11 from position shown in Figure 10.Be meant that about the employed term of finger tip " rolling " finger tip is not the surface that slips over display screen 32, but remain on a position and pivot.Therefore, when finger 50 when on the surface of display screen 32, rolling, the part of finger 50 will upwards be lifted from from the surface of display screen 32, contact with the surface formation of display screen 32 and point another part of 50.Continue with reference to figure 1-11; The ability of this touch sensible of touch-screen 32 be such so that: the startup of the contact between the parts that finger 50 part and display screen 32 before were not touched; Between the part that before had been touched with finger 50 other parts and display screen 32 contact stop to link together, the screen 32 that is touched detects and will be being passed on by the form of signal that processor 34 is interpreted as the rolling movement of finger 50.The position angle of three-dimensional selector 54 and the variation at inclination angle conform to this rolling movement.
In an example; If operator 48 has no the finger tip that rolls from a side to opposite side that moves up and down significantly of finger tip in the direction of common level; The position angle of then three-dimensional selector 54 will be changed into the reposition of pointing 50 and conform to, and the inclination angle of three-dimensional selector 54 will remain unchanged.Otherwise; If operator 48 does not have significant finger tip one side moving to a side at vertical above-below direction rolling finger tip 50; Then change into when conforming to the reposition of pointing 50 when the inclination angle of three-dimensional selector 54, the position angle of three-dimensional selector 54 will remain basically unchanged.If pointing 50 rolls in such a way: its existing side also has component up and down to the component of a side, and the position angle of then three-dimensional selector 54 will change with the mode that conform to the reposition of pointing 50 with the inclination angle.Under this mode, display system 30 can be so that its mode that looks like the extension that arrives the finger 50 in the 3-D view 38 be reproduced three-dimensional selector 54.Along with other corresponding mobile strategies of the three-dimensional selector 54 that moves of detected finger 50 on the surface of display screen 32 also are possible.
Figure 12 illustrates the selection of second optional then target 68.In this example, second optional then target 68 is not to be positioned on the landform of 3-D view 38, but aerial target.As directed, operator 48 rolls in downward direction and points 50, makes the inclination angle of three-dimensional selector 54 change.In certain embodiments, like the embodiment at Figure 12, display system 30 can so be configured to make the length of light beam part 58 to depend on the distance between the surface of landform that 3-D view 38 describes and display screen 32 and be changed.In such embodiment; With the mode identical: when the beam-pointing of electric torch in dark room has the different object apart from the different degree of closeness of electric torch with following mode; The light beam of this electric torch possibly look like and elongate and shortening, and the length of light beam part 58 will depend on where partly being positioned on it of the landform of being described illuminated regional 56 and shorten and extend.In other embodiments, when three-dimensional selector rotating tee was crossed 3-D view 38, light beam part 58 possibly have the length that remains unchanged.
Figure 13-14 illustrates another technology at the position angle and the inclination angle that are used to control three-dimensional selector.Continue with reference to figure 1-14, processor 34 can be configured to, and when no matter when three-dimensional selector 54 was shown, 32 display control panels 70 were shielded in indicated number.Control panel 70 can comprise and is used to control the control icon that three-dimensional selector 54 rotating tee are crossed 3-D view 38.For example; Control panel 70 can comprise first party parallactic angle adjustment icon 72 and second party parallactic angle adjustment icon 74 adjusting the position angle of three-dimensional selector 54, and can comprise that adjustment icon 76 in first inclination angle adjusts the inclination angle that icon 78 is controlled three-dimensional selector 54 with second inclination angle.For position angle or the inclination angle that changes three-dimensional selector 54, the operator only need touch one of these adjustment icons.Display screen 32 will detect this touch and will indicate the signal of this touch to be transferred to processor 34.Processor 34 will order display screen 32 to change the position angle and/or the inclination angle of three-dimensional selector 54 according to the mode that conforms to operator's 48 touch adjustment icons then.
Control panel 70 may further include position adjustment icon 80.In the embodiment shown, adjustment icon 80 in position is the circular icons of cardinal principle.In certain embodiments; When the operator hopes moving three dimension selector 54, a bit just can three-dimensional selector 54 being centered on 3-D view 38 and move to another place and can not change its position angle or inclination angle of the periphery of operator 48 through touching the position adjustment icon 80 conform to the direction of 3-D view 38 from one.
Figure 15-16 illustrates another kind and is used to control the three-dimensional position angle of symbol 54 and the technology at inclination angle selected.As shown in, Figure 15 and 16 comprises additional input block 36.In an illustrated embodiment, additional input block 36 be configured to detect move up and down, a side to a side shifting with and the operating rod of combination.Continue with reference to figure 1-16; It should be understood that; In other embodiments; Additional input block 36 can comprise that any suitable being configured to receives the input block (for example, mouse, touch pad etc.) that converts the electronic signal that is used to be transferred to processor 34 from operator's input and with those inputs into.
Operator 48 can use any suitable strategy to start the demonstration of three-dimensional selector 54, comprises any strategy of foregoing description.In case three-dimensional selector 54 is displayed in the 3-D view 38, and is then shown in figure 16, operator 48 uses additional input block 36 to change the position angle and the inclination angle of three-dimensional selector 54.
Figure 17-19 illustrates the other technology at the position angle and the inclination angle that are used to control three-dimensional selector 54.Continue with reference to figure 1-19, when processor 34 sends instructions to display screen 32 when showing three-dimensional selector 54, processor 34 further indicated numbers are shielded 32 and are also shown a plurality of touch points 82.In certain embodiments, the embodiment of example shown in figure 17, touch point 82 is arranged at the periphery of the bottom 84 of three-dimensional selector 54.Bottom 84 is the parts that look like the three-dimensional selector 54 of contact touch-screen 32.For position angle and/or the inclination angle that changes three-dimensional selector 54, operator 48 only need touch one or more touch points 82.This in Figure 18 and 19 by example.In Figure 18, operator's 48 moveable fingers 50 to be to touch a touch point 82, and in Figure 19, three-dimensional selector 54 is to rotate illuminated regional 56 modes that directly navigate on the optional then target 46.In certain embodiments, each touch point 82 will determine with respect to the position of bottom 84 whether position angle or the inclination angle (or both) of three-dimensional selector 54 are adjusted.For example, if operator 48 touches the touch point that is located immediately on the bottom 84, the inclination angle of three-dimensional selector 54 will promote.Be located immediately at right-hand touch point, bottom 84 if operator 48 touches, the position angle of then three-dimensional selector 54 will be adjusted by clockwise direction (from the angle of Figure 18-19).
Figure 20 illustrates the technology that is used for moving three dimension selector 54 and need not to change its position angle or inclination angle.Operator 48 can be placed on finger 50 on the bottom 84, drags finger 50 then and crosses the position of the surface of display screen 32 to any expectation.Such action will make this three-dimensional selector 54 move to operator 48 indicated positions and need not to cause inclination angle or azimuthal any variation of three-dimensional selector 54.
Figure 21 illustrates and uses three-dimensional selector 54 to select and follow the trail of the technology of optional then target 46.Continue with reference to figure 1-21, through using any method mentioned above, operator 48 can start the demonstration of three-dimensional selector 54 and can three-dimensional selector 54 be rotated so that navigate to optional then target 46 with illuminated regional 56.In certain embodiments; When illuminated regional 56 during through optional then target; Processor 34 can be configured to order display screen 32 displaying symbols, icon, text and/or other suitable figures, and it makes operator 48 can start the exercises relevant with optional then target 46.For example, processor 34 can make display screen 32 Show Options icons 86 and follow the trail of icon 88.In order to select optional then target 46, operator 48 can touch option icons 86.In order to select to follow the trail of icon 88, operator 48 can touch and follow the trail of icon 88.In any incident, touch will be detected by display screen 32, said display screen 32 and then will send the signal that indication touches and give processor 34.Processor 34 will send order conforms to for display screen 32 with the selection that shows with operator 48 has done additional text, figure or its combination subsequently.
In example shown in Figure 21, operator 48 has selected tracking icon 88.In certain embodiments, but the selection of following the trail of icon 88 can make three-dimensional selector 54 remain locked on the select target 46.Therefore, along with aircraft continues flight and 3-D view 38 continuation changes (indicating relatively moving between landform and aircraft thus), three-dimensional selector 54 will keep illuminated regional 56 position on optional then target 46.Operator 48 selects to follow the trail of icon 88 and can accomplish through any suitable traditional mode, for example, but is not limited to, and touches or knock tracking icon 88.Follow the trail of being chosen in this and being meant lock out action of icon 88.In other embodiments, lock out action possibly comprise and makes three-dimensional selector 54 be locked in the operator's 48 on the optional then target 46 other actions or indication.
Figure 22 is illustrated in the reproduction of a plurality of three-dimensional selectors in the 3-D view 38.Shown in figure 22, except three-dimensional selector 54, three-dimensional selector 90 is arranged also.Continue with reference to figure 1-22, in certain embodiments, display system 30 can be configured to the three-dimensional selector that generates any desired quantity.Shown in figure 22, but three-dimensional selector 54 is locked on the optional then target 46 and operator 48 navigates to second select target 94 with illuminated regional 92 of three-dimensional selector 90.By this way, operator 48 can follow the trail of the optional then target of any desired quantity.
Continue with reference to figure 1-22, in certain embodiments, processor can be configured to and prevent that display screen from reproducing three-dimensional selector at ad-hoc location.What possibly expect is to prevent that three-dimensional selector from pointing to the zone on the display screen that does not have selective image or symbol.For example, if near aircraft, do not detect aerial object in the air, what then possibly expect is that the three-dimensional selector of restriction is so that it can not move apart ground.In another example, near the aircraft or below existing ground have again under the situation of water, what possibly expect is that three-dimensional selector only is restricted to kiss the earth and prevents that it from passing through water.Other restriction also can be expected.
Although be to use display system 30 aboard in the context of above-mentioned discussion, should be realized that display system 30 is not limited only to cooperate aircraft utilization.Display system 30 is of many uses in aircraft industry, and can be used for other aspects of aircraft industry, include, but not limited to tower controller, air traffic controller and with the relevant employed display system of other staff of flight operation.Should further understand display system 30 and only be not limited in aircraft industry and use, but also can be used to use any other industry of display system.In addition, above-described with spread all over three-dimensional selector of the present disclosure and be not limited only to cooperate three-dimensional (solid) image to use.On the contrary, should be understood that three-dimensional selector described above also can be implemented in the traditional two-dimensional display system, said traditional display system uses traditional display technique stimulated three-dimensional image to create the outward appearance of skeleton view.For example, three-dimensional selector described herein is with through using well-known perspective technology to describe around the aircraft with accurate three-dimensional mode or traditional synthetic vision system (Synthetic Vision System) of the landform in the place ahead uses.
In the aforementioned detailed description of the present invention, presented at least one exemplary embodiment, will be appreciated that various deformation exists.Will be appreciated that also one or more exemplary embodiments only are examples, and be not intended to limit by any way scope of the present invention, practicality or configuration.On the contrary, aforementioned detailed those skilled in the art that are described as provide traditional wiring diagram of carrying out exemplary embodiment of the present invention.Be appreciated that and make various changes and not break away from the scope of setting forth in additional claim of the present invention with arranging the function of the element described in the exemplary embodiment.

Claims (10)

1. display system (30) that is used for the selector (54) in the control chart picture; This display system (30) is configured to be used with display screen (32); This display screen (32) is configured to the lip-deep touch of detecting operation person at this display screen (32); And further be configured to show 3-D view (38), this display system (30) comprising:
Processor (34); It is configured to operatively be coupled to this display screen (32); This processor (34) is configured to this display screen of order (32) and in this 3-D view (38), shows three-dimensional selector (54), and orders this display screen (32) in this 3-D view (38), to move this selector (34) according to the mode that conforms to operator's touch.
2. display system as claimed in claim 1 (30), wherein this processor (34) further is configured to this display screen of order (32) demonstration a plurality of three-dimensional selectors (54).
3. display system as claimed in claim 1 (30); Wherein, Operator's touch is included in the rolling of the lip-deep touch tool of this display screen (32), and wherein this processor (34) by further be configured to this display screen of order (32) according to the mode that conforms to the rolling of this touch tool change should three-dimensional selector (54) position angle and inclination angle.
4. display system as claimed in claim 3 (30); Wherein this processor (34) is configured to this display screen of order (32) and shows and should advance this three-dimensional instrument (38) to look like from this touch tool projection by three-dimensional selector (54), and looks like with this touch tool and align basically.
5. display system as claimed in claim 1 (30); Wherein this processor (34) further is configured to approaching a plurality of touch points (82), position that this display screen of order (32) shows that the operator touches on the surface with this display screen (32); And when the operator touches these a plurality of touch points (82), order this display screen (32) according to the mode that conforms to the touch of operator on these a plurality of touch points (82) change should three-dimensional selector (54) position angle and inclination angle.
6. display system as claimed in claim 1 (30); Wherein this processor (34) further is configured to this display screen of order (32) and goes up display control panel (70) at this display screen (32); And when the operator touches this control panel (70), order this display screen (32) to move this three-dimensional selector (54) according to the mode that conforms to the touch of operator on this control panel (70).
7. display system as claimed in claim 1 (30); Wherein this processor (34) further is configured to when the operator uses this display screen (32) input lock out action, and ordering this display screen (32) to show according to the mode on the target (46) that is shown in this 3-D view (38) of being locked in should three-dimensional selector (54).
8. display system as claimed in claim 1 (30), wherein this processor (34) further is configured to this display screen of order (32) and should three-dimensional selector (54) be shown as and has the startup of on the surface of this display screen (32), carrying out with the operator and touch the inceptive direction that the position of (51) this touch conforms to.
9. display system (30) that is used for the selector (54) in the control chart picture, this display system (30) comprising:
Display screen (32), it is configured to the lip-deep touch of detecting operation person at this display screen (32), and further is configured to show 3-D view (38); And
Processor (34), it operatively is coupled to this display screen (32), and this processor (34) is configured to:
Order this display screen (32) in this 3-D view (38), to show three-dimensional selector (54); This three-dimensional selector (54) has what this display screen (32) go up to show and initially touches first end of primary importance (51) at the place, surface of this display screen (32) near the operator; And have what this display screen (32) go up to show and be positioned at second end of locating with the isolated second place of this first end (62)
Order this display screen (32) show should three-dimensional selector (54) so that second end conforms to primary importance (51) with respect to the direction of first end, and
Order this display screen (32) in this 3-D view (38), to adjust the position angle and the inclination angle of this selector (54) according to the mode that conforms to operator's touch.
10. display system (30) that is used for the three-dimensional selector (54) in the control chart picture, this display system (30) comprising:
Display screen (32), it is configured to the lip-deep touch of detecting operation person at this display screen (32), and further is configured to show 3-D view (38);
Input block (36), it is configured to receive operator's input; And
Processor (34), it operatively is coupled to this display screen (32) and this input block (36), and this processor (34) is configured to:
Order this display screen (32) in this 3-D view (38), to show three-dimensional selector (54), and
Order this display screen (32) in this 3-D view (38), to move this selector (54) according to the mode that the input with operator's touch and operator conforms to.
CN201110406869.2A 2010-10-28 2011-10-27 The display system of the selector in control image Expired - Fee Related CN102609177B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US12/914785 2010-10-28
US12/914,785 US9001053B2 (en) 2010-10-28 2010-10-28 Display system for controlling a selector symbol within an image

Publications (2)

Publication Number Publication Date
CN102609177A true CN102609177A (en) 2012-07-25
CN102609177B CN102609177B (en) 2017-03-15

Family

ID=44925344

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110406869.2A Expired - Fee Related CN102609177B (en) 2010-10-28 2011-10-27 The display system of the selector in control image

Country Status (5)

Country Link
US (1) US9001053B2 (en)
EP (1) EP2447822A3 (en)
JP (1) JP6073546B2 (en)
KR (1) KR101894907B1 (en)
CN (1) CN102609177B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103577039A (en) * 2012-07-27 2014-02-12 泰勒斯公司 Method for displaying the geographical situation of an aircraf
CN106574846A (en) * 2014-09-03 2017-04-19 马耳他大学 A human machine interface device for aircraft
CN107480791A (en) * 2016-06-06 2017-12-15 波音公司 Three-dimensional aircraft inspection system for passenger's freight space layout
CN108072995A (en) * 2016-11-11 2018-05-25 株式会社日本显示器 Display device

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102011112618A1 (en) * 2011-09-08 2013-03-14 Eads Deutschland Gmbh Interaction with a three-dimensional virtual scenario
DE102011112620B3 (en) * 2011-09-08 2013-02-21 Eads Deutschland Gmbh Angled display for the three-dimensional representation of a scenario
FR2983176B1 (en) 2011-11-29 2013-12-27 Airbus Operations Sas INTERACTIVE DIALOGUE DEVICE BETWEEN AN OPERATOR OF AN AIRCRAFT AND A GUIDE SYSTEM FOR SAID AIRCRAFT.
EP2696274A2 (en) * 2012-08-07 2014-02-12 Samsung Electronics Co., Ltd Portable apparatus with a GUI and method of using the same
FR3001066B1 (en) 2013-01-11 2015-02-27 Airbus Operations Sas SYSTEM FOR GUIDING ACTION ASSISTANCE TO BE CARRIED OUT BY AN OPERATOR ON AN AIRCRAFT.
US9280904B2 (en) * 2013-03-15 2016-03-08 Airbus Operations (S.A.S.) Methods, systems and computer readable media for arming aircraft runway approach guidance modes
JP5736528B2 (en) * 2013-03-29 2015-06-17 楽天株式会社 TERMINAL DEVICE, TERMINAL DEVICE CONTROL METHOD, PROGRAM, AND INFORMATION STORAGE MEDIUM
US9567099B2 (en) * 2013-04-11 2017-02-14 Airbus Operations (S.A.S.) Aircraft flight management devices, systems, computer readable media and related methods
AT514811B1 (en) 2013-10-30 2015-04-15 Ge Jenbacher Gmbh & Co Og Method for operating an internal combustion engine connected to an electric generator, in particular a synchronous generator
US9799225B2 (en) * 2015-05-08 2017-10-24 The Boeing Company Method and apparatus for building a taxiing route
US20170010690A1 (en) * 2015-07-07 2017-01-12 Widevantage Inc. Terminal and method of operating terminal
US11275498B2 (en) 2016-08-31 2022-03-15 Sony Corporation Information processing system, information processing method, and program
US10690554B2 (en) 2017-10-17 2020-06-23 Sikorsky Aircraft Corporation Composite airspeed indicator display for compound aircrafts
USD888069S1 (en) * 2018-02-08 2020-06-23 Sikorsky Aircraft Corporation Flight display screen or portion thereof with graphical user interface including a composite indicator
USD881206S1 (en) * 2018-02-08 2020-04-14 Sikorsky Aircraft Corporation Flight display screen or portion thereof with graphical user interface including a composite indicator
US11481025B2 (en) 2018-11-21 2022-10-25 Sony Group Corporation Display control apparatus, display apparatus, and display control method

Family Cites Families (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4521870A (en) 1981-04-09 1985-06-04 Ampex Corporation Audio/video system having touch responsive function display screen
US4821031A (en) 1988-01-20 1989-04-11 International Computers Limited Image display apparatus
US5038142A (en) 1989-03-14 1991-08-06 International Business Machines Corporation Touch sensing display screen apparatus
US5146212A (en) * 1990-01-04 1992-09-08 Apple Computer, Inc. Manipulatable orientation for a translatable graphic object
JP2558984B2 (en) * 1991-03-12 1996-11-27 松下電器産業株式会社 3D information conversation system
JPH07225647A (en) * 1994-02-09 1995-08-22 Mitsubishi Electric Corp Input device
JPH0981320A (en) 1995-09-20 1997-03-28 Matsushita Electric Ind Co Ltd Pen input type selection input device and method therefor
US5880733A (en) * 1996-04-30 1999-03-09 Microsoft Corporation Display system and method for displaying windows of an operating system to provide a three-dimensional workspace for a computer system
US7472047B2 (en) 1997-05-12 2008-12-30 Immersion Corporation System and method for constraining a graphical hand from penetrating simulated graphical objects
US6259491B1 (en) 1998-02-06 2001-07-10 Motorola, Inc. Double sided laminated liquid crystal display touchscreen and method of making same for use in a wireless communication device
US6297811B1 (en) 1999-06-02 2001-10-02 Elo Touchsystems, Inc. Projective capacitive touchscreen
US6567070B1 (en) * 1999-08-10 2003-05-20 Intel Corporation Selection of objects in a graphical user interface
US6492979B1 (en) 1999-09-07 2002-12-10 Elo Touchsystems, Inc. Dual sensor touchscreen utilizing projective-capacitive and force touch sensors
US6917668B2 (en) * 2000-11-13 2005-07-12 Digitome Corporation Ray tracing kernel calibration
EP1405286B8 (en) 2001-07-06 2005-11-09 L-3 Communications Avionics Systems, Inc. System and method for producing flight pathway
US20040027394A1 (en) 2002-08-12 2004-02-12 Ford Global Technologies, Inc. Virtual reality method and apparatus with improved navigation
US8434027B2 (en) 2003-12-15 2013-04-30 Quantum Matrix Holdings, Llc System and method for multi-dimensional organization, management, and manipulation of remote data
US7340678B2 (en) 2004-02-12 2008-03-04 Fuji Xerox Co., Ltd. Systems and methods for creating an interactive 3D visualization of indexed media
EP1759379A2 (en) 2004-06-01 2007-03-07 Michael A. Vesely Horizontal perspective display
CN101308442B (en) * 2004-10-12 2012-04-04 日本电信电话株式会社 3d pointing method and 3d pointing device
US8274534B2 (en) 2005-01-31 2012-09-25 Roland Wescott Montague Methods for combination tools that zoom, pan, rotate, draw, or manipulate during a drag
JP4331134B2 (en) 2005-03-25 2009-09-16 株式会社東芝 Stereoscopic image display device
US7707516B2 (en) 2006-05-26 2010-04-27 Google Inc. Embedded navigation interface
WO2009000280A1 (en) * 2007-06-28 2008-12-31 Cherif Atia Algreatly 3d input method and system for the hand-held devices
US20080062173A1 (en) 2006-09-13 2008-03-13 Eric Tashiro Method and apparatus for selecting absolute location on three-dimensional image on navigation display
JP5105920B2 (en) 2007-03-20 2012-12-26 株式会社東芝 Stereoscopic image display device
CN100576161C (en) * 2008-06-06 2009-12-30 中国科学院软件研究所 A kind of cake-shape menu selection methodbased based on pen obliquity information
WO2010022386A2 (en) * 2008-08-22 2010-02-25 Google Inc. Navigation in a three dimensional environment on a mobile device
JP5472565B2 (en) * 2008-09-03 2014-04-16 日本電気株式会社 Information processing apparatus, pointer designation method, and program
US8519997B2 (en) * 2008-09-23 2013-08-27 Honeywell International Inc. Apparatus and method for display and functionality of a vehicle display system cursor control device
TWI328714B (en) 2008-10-09 2010-08-11 Au Optronics Corp Switchable two and three dimensional display
JP4793422B2 (en) * 2008-10-10 2011-10-12 ソニー株式会社 Information processing apparatus, information processing method, information processing system, and information processing program
KR20100050103A (en) * 2008-11-05 2010-05-13 엘지전자 주식회사 Method of controlling 3 dimension individual object on map and mobile terminal using the same
US8294766B2 (en) 2009-01-28 2012-10-23 Apple Inc. Generating a three-dimensional model using a portable electronic device recording
WO2010108499A2 (en) * 2009-03-22 2010-09-30 Algreatly Cherif Atia 3d navigation method and system

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103577039A (en) * 2012-07-27 2014-02-12 泰勒斯公司 Method for displaying the geographical situation of an aircraf
CN103577039B (en) * 2012-07-27 2018-01-02 泰勒斯公司 For the method in the geographical position for showing airborne vehicle
CN106574846A (en) * 2014-09-03 2017-04-19 马耳他大学 A human machine interface device for aircraft
CN107480791A (en) * 2016-06-06 2017-12-15 波音公司 Three-dimensional aircraft inspection system for passenger's freight space layout
CN107480791B (en) * 2016-06-06 2023-06-13 波音公司 Three-dimensional aircraft inspection system for passenger cabin map
CN108072995A (en) * 2016-11-11 2018-05-25 株式会社日本显示器 Display device

Also Published As

Publication number Publication date
US9001053B2 (en) 2015-04-07
KR20120047817A (en) 2012-05-14
JP2012104107A (en) 2012-05-31
EP2447822A2 (en) 2012-05-02
JP6073546B2 (en) 2017-02-01
KR101894907B1 (en) 2018-09-04
EP2447822A3 (en) 2017-03-29
US20120105318A1 (en) 2012-05-03
CN102609177B (en) 2017-03-15

Similar Documents

Publication Publication Date Title
CN102609177A (en) Display system for controlling a selector symbol within an image
JP6955557B2 (en) Game screen display control methods, devices, storage media and electronic devices
US20230095331A1 (en) Virtual reality system and method
US10417826B2 (en) Information input method in 3D immersive environment
CN101443729B (en) Joy-stick like graphical user interface to adjust 3D cross sectional plane in 3D volume
US11086403B2 (en) Systems and methods for multi-user shared virtual and augmented reality-based haptics
KR101735442B1 (en) Apparatus and method for manipulating the orientation of an object on a display device
CN107924268B (en) Object selection system and method
CN103472930A (en) Three-dimensional control mouse and use method thereof
CN108496151A (en) Method and apparatus for manipulating movable fixture
CA2691320C (en) Display of a three-dimensional virtual space generated by an electronic simulation system
US10802676B2 (en) Method and apparatus for setting parameter
US20210397202A1 (en) Touch control of unmanned aerial vehicles
GB2605302A (en) Virtual reality system and method
CN111857364B (en) Interaction device, virtual content processing method and device and terminal equipment
Grosjean et al. 3D Arrow: A virtual pointer for immersive sculpting
GB2605300A (en) Virtual reality system and method
GB2605298A (en) Virtual reality system and method
GB2605301A (en) Virtual reality system and method
GB2605299A (en) Virtual reality system and method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20170315

Termination date: 20191027