CN106598390B - Display method, electronic equipment and display device - Google Patents

Display method, electronic equipment and display device Download PDF

Info

Publication number
CN106598390B
CN106598390B CN201611139100.8A CN201611139100A CN106598390B CN 106598390 B CN106598390 B CN 106598390B CN 201611139100 A CN201611139100 A CN 201611139100A CN 106598390 B CN106598390 B CN 106598390B
Authority
CN
China
Prior art keywords
display area
display
sub
user
main
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201611139100.8A
Other languages
Chinese (zh)
Other versions
CN106598390A (en
Inventor
姚涔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lenovo Beijing Ltd
Original Assignee
Lenovo Beijing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lenovo Beijing Ltd filed Critical Lenovo Beijing Ltd
Priority to CN201611139100.8A priority Critical patent/CN106598390B/en
Publication of CN106598390A publication Critical patent/CN106598390A/en
Priority to US15/839,114 priority patent/US20180164952A1/en
Application granted granted Critical
Publication of CN106598390B publication Critical patent/CN106598390B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04812Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0486Drag-and-drop
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/012Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048Indexing scheme relating to G06F3/048
    • G06F2203/04803Split screen, i.e. subdividing the display area or the window area into separate subareas

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application provides a display method, electronic equipment and a display device, wherein the display method comprises the following steps: determining a main display area in a space based on the position information of the user; dividing the main display area into a plurality of sub display areas; and detecting a trigger operation of a user, and displaying the target window in at least one sub-display area in the plurality of sub-display areas. According to the display method, the electronic equipment and the display device, the main display area is determined in the space, and the main display area is divided, so that a user can comfortably watch and operate the window displayed in the space, and the user experience is good.

Description

Display method, electronic equipment and display device
Technical Field
The present invention relates to the field of information display technologies, and in particular, to a display method, an electronic device, and a display apparatus.
Background
Currently, displaying virtual windows in space is enabled by means of virtual display devices, such as AR head-mounted glasses. However, when displaying a virtual window in a space, what position of the space the virtual window is displayed at is a problem that how the virtual window is displayed in the space enables a user to view and operate the window displayed in the space more comfortably.
Disclosure of Invention
In view of the above, the present invention provides a display method, an electronic device, and a display apparatus, which are used to determine a display position and a display manner of a virtual window in a space, so that a user can comfortably view and operate the virtual window displayed in the space, and the technical solution is as follows:
a display method, the display method comprising:
determining a main display area in a space based on the position information of the user;
dividing the main display area into a plurality of sub-display areas;
and detecting a trigger operation of a user, and displaying a target window in at least one sub-display area in the plurality of sub-display areas.
Wherein the determining a main display area in space based on the location information of the user comprises:
acquiring the environmental information;
determining a main display area in the space based on the location information of the user and the environment information.
Wherein the dividing the main display area into a plurality of sub-display areas comprises:
the main display area is divided into a plurality of sub display areas based on the size of a display screen of the electronic device.
Preferably, the display method further comprises:
and for the window displayed in the space, displaying the window with a first display effect in the main display area, and displaying the window with a second display effect different from the first display effect in other display areas except the main display area.
Preferably, the display method further comprises:
when the dragging operation on the target window is detected, judging whether the dragging operation meets a preset condition or not;
and when the dragging operation meets the preset condition, displaying the boundary of the sub-display area according to a preset display mode.
Wherein the detecting a trigger operation of a user, and displaying a target window in at least one of the sub-display areas, includes:
maximally displaying the target window in the sub-display area based on the detected trigger operation; and/or displaying the target window in a set area on the first side of the sub-display area; and/or, the target window is displayed on the boundary of the sub-display area extending to the sub-display area along a preset direction.
The triggering operation comprises a touch operation of moving the operation point of the target window and the boundary of the sub display area.
Preferably, the display method further comprises:
and based on preset operation, placing a plurality of windows displayed in the main display area in at least one sub-display area for displaying, wherein any one window is displayed in the range of one sub-display area.
An electronic device, comprising: the system comprises an acquisition unit, a sensor and a processor;
the acquisition unit is used for acquiring the position information of the user;
the sensor is used for detecting the triggering operation of a user;
the processor is used for determining a main display area in a space based on the position information of the user acquired by the acquisition unit and dividing the main display area into a plurality of sub-display areas; and when the sensor detects the trigger operation of the user, displaying a target window in at least one sub-display area of the plurality of sub-display areas.
The acquisition unit is also used for acquiring the environment information;
the processor is configured to determine a primary display area in the space based on the location information and the environment information of the user.
The processor is specifically configured to divide the main display area into a plurality of sub display areas based on a size of a display screen of the electronic device.
Preferably, the processor is further configured to display, for a window displayed in the space, a first display effect in the main display area, and display a second display effect different from the first display effect in a display area other than the main display area.
Preferably, the processor is further configured to determine whether a dragging operation of the target window meets a preset condition when the sensor detects the dragging operation of the target window; and when the dragging operation meets the preset condition, displaying the boundary of the sub-display area according to a preset display mode.
The processor is specifically configured to maximally display the target window in the sub-display area based on the detected trigger operation; and/or displaying the target window in a set area on the first side of the sub-display area; and/or, the target window is displayed on the boundary of the sub-display area extending to the sub-display area along a preset direction.
The triggering operation comprises a touch operation of moving the operation point of the target window and the boundary of the sub display area.
The processor is further configured to place the plurality of windows displayed in the main display area in at least one sub-display area for display based on a preset operation, wherein any one of the windows is displayed within a range of one of the sub-display areas.
A display device, the display device comprising: the device comprises a main area determining module, an area dividing module, a detecting module and a display module;
the main area determining module is used for determining a main display area in the space based on the position information of the user;
the area dividing module is used for dividing the main display area into a plurality of sub display areas;
the detection module is used for detecting the triggering operation of the user;
the display module is configured to display a target window in at least one of the plurality of sub-display areas when the trigger operation of the user is detected.
The technical scheme has the following beneficial effects:
the display method, the electronic device and the display device provided by the invention can determine the main display area in the space based on the position information of the user, divide the main display area into a plurality of sub display areas, and display the target window in at least one of the sub display areas when the trigger operation of the user is detected. According to the display method, the electronic equipment and the display device, the main display area is determined in the space, and the main display area is divided, so that a user can comfortably watch and operate the window displayed in the space, and the user experience is good.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a schematic flow chart of a display method according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a main display area in the display method according to the embodiment of the invention;
fig. 3 is a schematic diagram illustrating a plurality of sub-display areas divided based on the size of a display screen of an electronic device in a display method according to an embodiment of the present invention;
fig. 4 is a schematic diagram illustrating that a target window is displayed in a sub-display area for a user-based trigger operation in the display method according to the embodiment of the present invention;
fig. 5 is a schematic diagram illustrating that a plurality of windows in the main display area are displayed in a plurality of sub display areas in the main display area in the display method according to the embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a display device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
An embodiment of the present invention provides a display method, please refer to fig. 1, which shows a schematic flow chart of the display method, and the display method may include:
step S101: based on the location information of the user, a main display area in the space is determined.
Step S102: the main display area is divided into a plurality of sub display areas.
Step S103: and detecting a trigger operation of a user, and displaying the target window in at least one sub-display area in the plurality of sub-display areas.
The display method provided by the embodiment of the invention can determine the main display area in the space based on the position information of the user, can divide the main display area into a plurality of sub display areas, and can display the target window in at least one of the sub display areas when the trigger operation of the user is detected. According to the display method provided by the invention, the main display area is determined in the space, and the main display area is divided, so that a user can comfortably watch and operate the window displayed in the space, and the user experience is better.
In the above embodiment, determining the main display area in the space based on the position information of the user may include: acquiring the environmental information; a main display area in a space is determined based on the location information and the environment information of the user.
Illustratively, the electronic device is placed on a desk, and the collected environment information can be information of the desk and information of a display screen of the electronic device. The main display area in the space may be a display area determined by a first preset angle (e.g. 60 degrees) to the left and right with respect to the position of the user, and a second preset angle (e.g. 45 degrees) to the upper and lower with respect to the plane of the table, in combination with a comfortable distance (e.g. 45cm) for fine reading and operation, and a placement position of the electronic device and a placement height of the electronic device on the table. Referring to FIG. 2, a schematic diagram of the main display area is shown.
For example, a virtual interface is displayed in the space, and the user views the virtual interface in the space, at this time, the main display area may be determined based on the position information of the user and the information of the virtual interface, wherein the information of the virtual interface may include the display position of the virtual interface and the size information of the virtual interface. The main display area in the space may be a display area determined by first preset angles (e.g., 60 degrees) to the left and right with respect to the position of the user, and second preset angles (e.g., 45 degrees) to the up and down with respect to a plane perpendicular to the plane of the virtual display interface, while combining a comfortable distance (e.g., 45cm) for fine reading and manipulation, a display position of the virtual interface, and a size of the virtual interface.
After the main display area is determined, the main display area is divided into a plurality of sub display areas. In order to enable the window displayed on the display screen of the electronic device to be better displayed in the sub-display area, in a preferred implementation, the main display area may be divided into a plurality of sub-display areas based on the size of the display screen of the electronic device. Referring to fig. 3, a schematic diagram of dividing a plurality of sub-display regions based on the size of the display screen of the electronic device is shown.
It can be understood that, when dividing the sub-display regions, it may not be guaranteed that the size of each sub-display region is the same as the size of the display screen of the electronic device, and therefore, when dividing, in order to make the window have a better display effect, a region division rule may be set in advance based on the shape and size of the main display region, so that a part of the sub-display regions are the same as the size of the display screen of the electronic device, and the other part of the sub-display regions are larger than the size of the display screen of the electronic device.
In the present invention, in order to enable a user to know the range of the main display area, the boundary of the main display area may be displayed in a preset highlighting manner. For example, the boundary of the main display area may be highlighted in a certain color continuously at the boundary of the main display area, or when the user drags the window, the boundary of the main display area may be highlighted in a certain color, or when the user drags the window on the display screen of the electronic device into the space for display, the boundary of the main display area may be highlighted in a certain color.
For a window displayed in a space, the window is displayed with a first display effect in a main display area, and is displayed with a second display effect different from the first display effect in other display areas except the main display area.
For example, when a certain operation is performed on a window, for example, a user drags the window into a space, the user drags the window to move in the space, and the like, if there is only one window in the space, there may be a case where a part of the window is within the main display area and another part of the window is outside the main display area, at this time, in order to make the user more intuitively know the position of the window in the space, the window portions inside and outside the main display area may be displayed according to different display effects, for example, the window portion inside the main display area is clearly displayed, and the window portion outside the main display area presents a certain transparency, or the window boundary of the window portion inside the main display area is displayed according to one color and the window boundary of the window portion outside the main display area is displayed according to another color. If a plurality of windows are arranged in the space, a situation that a part of the windows are completely in the main display area and another part of the windows are completely outside the main display area may exist, at this time, the windows in the main display area and the windows outside the main display area are displayed according to different display effects, for example, the windows in the main display area are clearly displayed, the windows outside the main display area present a certain transparency, or a situation that a part of the windows are completely in the main display area, a part of the windows are completely outside the main display area, and a part of the windows occupy both the main display area and the main display area, at this time, the windows completely in the main display area are clearly displayed, the windows completely outside the main display area present a certain transparency, and the windows in the main display area are partially clearly displayed for the windows occupying both the main display area and the main display area, the portion of the window outside the main display area exhibits a certain transparency.
In order to enable a user to know the division condition of the sub display area in the main display area, the display method provided by the embodiment of the invention may further include: and displaying the boundary of the sub-display area according to a preset display mode.
It should be noted that the boundaries of the sub-display regions may be displayed together when the main display region is displayed, or may not be displayed first, but may be displayed when some operation is detected, in one possible implementation manner, the boundaries of the sub-display regions may be displayed according to a preset display manner (for example, a thick bar of a certain color) when a drag operation on the target window is detected, in another possible implementation manner, whether the drag operation satisfies a preset condition may be determined when the drag operation on the target window is detected, and the boundaries of the sub-display regions may be displayed according to the preset display manner when the drag operation satisfies the preset condition, where the preset condition may be that the drag operation crosses the window.
When the target window is displayed in a certain sub-display area in the main display area, in order to realize quick operation on the window, the method provided by the embodiment of the invention can display the target window in at least one sub-display area in the plurality of sub-display areas by detecting the trigger operation of a user.
Specifically, based on the detected trigger operation, the target window is maximally displayed in the sub-display area; and/or displaying the target window in a set area on the first side of the sub-display area; and/or, the target window is displayed on the boundary of the sub-display area extending to the sub-display area along the preset direction. The triggering operation may include a touch operation of the operation point of the moving target window and the boundary of the sub display area.
The following describes a process of displaying the target window in the sub-display area based on the user's trigger operation (assuming that the target window is displayed in a sub-display area):
referring to fig. 4(a), if the user drags the target window to move to the top of the sub display area, when the operation point of the moving target window touches the top boundary of the sub display area, the target window is maximally displayed in the sub display area.
Referring to fig. 4(B), if the user drags the target window to move to the right side of the sub-display area B, when the operating point of the moving target window touches the right boundary of the sub-display area B, the target window is displayed in a set area on the right side of the sub-display area B (e.g., the right half area of the sub-display area B).
Referring to fig. 4(c), if the user drags the target window to move to the left side of the sub display area, when the operation point of the moving target window touches the left boundary of the sub display area B, the target window is displayed in a set area on the left side of the sub display area B (e.g., a left half area of the sub display area B).
Referring to fig. 4(d), if the user drags the target window to move to the bottom of the sub-display area B, when the operating point of the moving target window touches the bottom boundary of the sub-display area B, the target window is extended to the top of the sub-display area B to the top boundary, and the bottom of the sub-display area B is extended to the bottom boundary for display.
According to the display method provided by the embodiment of the invention, the main display area is divided into the plurality of sub-display areas, so that when the plurality of windows are displayed in the space, the plurality of windows can be quickly managed based on the plurality of sub-display areas, and the windows which are randomly placed in the space are quickly placed in the divided sub-display areas in order.
That is, the display method provided in the embodiment of the present invention may further include: based on preset operation, a plurality of windows displayed in the main display area are placed in at least one sub display area to be displayed, wherein any one window is displayed in the range of one sub display area, namely, the window displayed in one sub display area cannot exceed the range of the sub display area. Referring to fig. 5, a schematic diagram of displaying a plurality of windows in the main display area in a plurality of sub-display areas in the main display area is shown. According to the display method provided by the embodiment of the invention, a user can quickly arrange a plurality of windows in a space through a simple quick arrangement operation.
In a possible implementation manner, for each window, the sub-display area for setting the window may be determined based on the distance between the window and each sub-display area, specifically, the distance between the center of the window and the center of each sub-display area may be calculated, and the sub-display area closest to the window may be determined as the sub-display area for setting the window. It should be noted that, in some cases, multiple windows may be disposed in the same sub-display area, and in this case, the windows may be sequentially stacked in the sub-display area.
On the basis of the display method provided by the above embodiment of the present invention, the following description is made by using a specific example:
the method comprises the steps that a user wears AR glasses, after the AR glasses are connected with a PC, the AR glasses are used for collecting position information of the user, information of a table where the PC is placed and information of a PC display screen are collected, the collected position information of the user, the collected information of the table where the PC is placed and the information of the PC display screen are sent to the PC, or the PC directly collects the information through a camera, after the position information of the user, the information of the table where the PC is placed and the information of the PC display screen are obtained, a main display area in a space is determined based on the information to guide the user to display a window in the main display area, and after the main display area is determined, the window displayed in the space is a window displayed on the PC display screen, so that the window has a good display effect, the main display area is divided into a plurality of sub display areas based on the size of the PC display screen, therefore, the main display area can orderly display a plurality of windows, and disorder is avoided. The AR glasses may process the content of the multiple windows displayed by the primary display area for presentation to the user. For the window displayed in the sub display area, some shortcut operations may be set to reduce the user's usage burden, for example, the user drags the window to move to the top of the sub display area, and when the operation point of the moving target window touches the top boundary of the sub display area, the target window is maximally displayed in the sub display area.
In addition, in order to enable the user to know the range of the main display area, the boundary of the main display area is highlighted, the boundary of the main display area can be highlighted continuously in a certain color, and the highlight can also be displayed when the user performs certain operations on the window, for example, the user drags the window to move in the space, or the user drags the window on the PC display screen to the space. The windows displayed in the space are displayed according to different display effects inside and outside the main display area so as to distinguish the windows displayed inside and outside the main display area. The multiple windows which are displayed in space in a disordered way can be managed quickly, so that the multiple windows are orderly arranged in at least one sub-display area in the main display area to be displayed.
An embodiment of the present invention further provides an electronic device, please refer to fig. 6, which shows a schematic structural diagram of the electronic device, and the electronic device may include: an acquisition unit 601, a sensor 602, and a processor 603. Wherein:
the collecting unit 601 is configured to collect location information of a user.
And a sensor 602 for detecting a trigger operation of a user.
The processor 603 is configured to determine a main display area in a space based on the position information of the user acquired by the acquisition unit, and divide the main display area into a plurality of sub display areas; and when the sensor detects the trigger operation of the user, displaying the target window in at least one sub-display area in the plurality of sub-display areas.
The electronic device provided by the embodiment of the invention can determine the main display area in the space based on the position information of the user, can divide the main display area into a plurality of sub display areas, and can display the target window in at least one of the sub display areas when the trigger operation of the user is detected. According to the electronic equipment provided by the embodiment of the invention, the main display area is determined in the space, and the main display area is divided, so that a user can comfortably watch and operate the window displayed in the space, and the user experience is better.
In the electronic device provided in the above embodiment, the collecting unit is further configured to collect the environmental information.
A processor for determining a main display area in a space based on the location information and the environment information of the user.
In the electronic device provided in the above embodiment, the processor is specifically configured to divide the main display area into a plurality of sub display areas based on a size of a display screen of the electronic device.
In the electronic device provided in the above embodiment, the processor is further configured to display, for a window displayed in the space, a first display effect in the main display area, and display a second display effect different from the first display effect in the other display areas except the main display area.
Preferably, in the electronic device provided in the above embodiment, the processor is further configured to determine whether a dragging operation of the target window meets a preset condition when the sensor detects the dragging operation of the target window; and when the dragging operation meets the preset condition, displaying the boundary of the sub-display area according to a preset display mode.
Preferably, in the electronic device provided in the foregoing embodiment, the processor is specifically configured to maximally display the target window in the sub-display area based on the detected trigger operation; and/or displaying the target window in a set area on the first side of the sub-display area; and/or, the target window is displayed on the boundary of the sub-display area extending to the sub-display area along the preset direction.
The triggering operation comprises a touch operation of the operation point of the moving target window and the boundary of the sub display area.
Preferably, in the electronic device provided in the foregoing embodiment, the processor is further configured to, based on a preset operation, place a plurality of windows displayed in the main display area in at least one sub-display area for display, where any one of the windows is displayed within a range of one of the sub-display areas.
An embodiment of the present invention further provides a display device, please refer to fig. 7, which shows a schematic structural diagram of the display device, and the display device includes: a main area determination module 701, an area division module 702, a detection module 703 and a display module 704. Wherein:
a main area determining module 701, configured to determine a main display area in a space based on location information of a user;
a region dividing module 702, configured to divide the main display region into a plurality of sub display regions;
a detecting module 703, configured to detect a trigger operation of a user;
a display module 704, configured to, when a trigger operation of a user is detected, display a target window in at least one sub-display area of the multiple sub-display areas.
The display device provided by the embodiment of the invention can determine the main display area in the space based on the position information of the user, can divide the main display area into a plurality of sub display areas, and can display the target window in at least one of the sub display areas when the trigger operation of the user is detected. According to the display device provided by the embodiment of the invention, the main display area is determined in the space, and the main display area is divided, so that a user can comfortably watch and operate the window displayed in the space, and the user experience is better.
In the display device provided in the above embodiment, the main area determination module includes: an acquisition submodule and a determination submodule.
And the acquisition submodule is used for acquiring the environment information.
And the determining submodule is used for determining the main display area in the space based on the position information of the user and the environment information acquired by the acquiring submodule.
In the display apparatus provided in the above embodiment, the area dividing module is specifically configured to divide the main display area into a plurality of sub display areas based on a size of a display screen of the electronic device.
The display device provided in the above embodiment may further include: and a window display module.
And the window display module is used for displaying the window displayed in the space in a first display effect in the main display area and displaying the window in a second display effect different from the first display effect in other display areas except the main display area.
The display device provided in the above embodiment may further include: the device comprises a judging module and a sub-display area boundary display module.
And the judging module is used for judging whether the dragging operation meets the preset condition or not when the dragging operation on the target window is detected.
And the sub-display area boundary display module is used for displaying the boundary of the sub-display area according to a preset display mode when the dragging operation meets the preset condition.
In the display apparatus provided in the foregoing embodiment, the display module is specifically configured to maximally display the target window in the sub-display area based on the detected trigger operation; and/or displaying the target window in a set area on the first side of the sub-display area; and/or, the target window is displayed on the boundary of the sub-display area extending to the sub-display area along the preset direction.
The triggering operation comprises a touch operation of the operation point of the moving target window and the boundary of the sub display area.
The display device provided in the above embodiment may further include: and a window arrangement module.
And the window sorting module is used for placing a plurality of windows displayed in the main display area in at least one sub-display area for displaying based on preset operation, wherein any one window is displayed in the range of one sub-display area.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
In the several embodiments provided in the present application, it should be understood that the disclosed method, apparatus, and device may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment. In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (15)

1. A display method, comprising:
determining a main display area in a space based on the position information of the user;
dividing the main display area into a plurality of sub-display areas;
detecting a trigger operation of a user, and displaying a target window in at least one sub-display area in the plurality of sub-display areas;
the determining a main display area in a space based on the user's location information includes:
acquiring the environmental information;
determining a main display area in the space based on the location information of the user and the environment information;
the environment information comprises information of a desk and information of a display screen of the electronic equipment, and the main display area is a display area determined by taking the position of a user as a reference and taking a plane where the desk is located as a reference; or the like, or, alternatively,
the environment information includes information of a virtual interface, and the main display area is a display area determined with reference to a position of a user and with reference to a plane perpendicular to a plane in which the virtual interface is located.
2. The method according to claim 1, wherein the dividing the main display area into a plurality of sub display areas comprises:
the main display area is divided into a plurality of sub display areas based on the size of a display screen of the electronic device.
3. The display method according to claim 1, further comprising:
and for the window displayed in the space, displaying the window with a first display effect in the main display area, and displaying the window with a second display effect different from the first display effect in other display areas except the main display area.
4. The display method according to claim 1, further comprising:
when the dragging operation on the target window is detected, judging whether the dragging operation meets a preset condition or not;
and when the dragging operation meets the preset condition, displaying the boundary of the sub-display area according to a preset display mode.
5. The display method according to claim 1, wherein the detecting a trigger operation of a user, and displaying a target window in at least one of the sub-display regions comprises:
maximally displaying the target window in the sub-display area based on the detected trigger operation; and/or displaying the target window in a set area on the first side of the sub-display area; and/or, the target window is displayed on the boundary of the sub-display area extending to the sub-display area along a preset direction.
6. The display method according to claim 1 or 5, wherein the trigger operation includes a touch operation of moving an operation point of the target window and a boundary of the sub-display area.
7. The display method according to claim 1, further comprising:
and based on preset operation, placing a plurality of windows displayed in the main display area in at least one sub-display area for displaying, wherein any one window is displayed in the range of one sub-display area.
8. An electronic device, comprising: the system comprises an acquisition unit, a sensor and a processor;
the acquisition unit is used for acquiring the position information of the user;
the sensor is used for detecting the triggering operation of a user;
the processor is used for determining a main display area in a space based on the position information of the user acquired by the acquisition unit and dividing the main display area into a plurality of sub-display areas; when the sensor detects the trigger operation of the user, displaying a target window in at least one sub-display area of the plurality of sub-display areas;
the acquisition unit is also used for acquiring the environment information;
the processor to determine a primary display area in the space based on the location information and the environmental information of the user;
the environment information comprises information of a desk and information of a display screen of the electronic equipment, and the main display area is a display area determined by taking the position of a user as a reference and taking a plane where the desk is located as a reference; or the like, or, alternatively,
the environment information includes information of a virtual interface, and the main display area is a display area determined with reference to a position of a user and with reference to a plane perpendicular to a plane in which the virtual interface is located.
9. The electronic device of claim 8, wherein the processor is specifically configured to divide the main display area into a plurality of sub-display areas based on a size of a display screen of the electronic device.
10. The electronic device of claim 8, wherein the processor is further configured to display a window displayed in the space with a first display effect in the main display area and with a second display effect different from the first display effect in the other display areas except the main display area.
11. The electronic device according to claim 8, wherein the processor is further configured to determine whether a dragging operation of the target window is satisfied when the sensor detects the dragging operation; and when the dragging operation meets the preset condition, displaying the boundary of the sub-display area according to a preset display mode.
12. The electronic device according to claim 8, wherein the processor is specifically configured to maximally display the target window in the sub-display area based on the detected trigger operation; and/or displaying the target window in a set area on the first side of the sub-display area; and/or, the target window is displayed on the boundary of the sub-display area extending to the sub-display area along a preset direction.
13. The electronic device according to claim 8 or 12, wherein the trigger operation comprises a touch operation of moving an operation point of the target window and a boundary of the sub-display area.
14. The electronic device of claim 8, wherein the processor is further configured to, based on a preset operation, place a plurality of windows displayed in the main display area in at least one sub-display area for display, where any one of the windows is displayed within a range of one of the sub-display areas.
15. A display device, characterized in that the display device comprises: the device comprises a main area determining module, an area dividing module, a detecting module and a display module;
the main area determining module is used for determining a main display area in the space based on the position information and the environment information of the user;
the area dividing module is used for dividing the main display area into a plurality of sub display areas;
the detection module is used for detecting the triggering operation of the user;
the display module is used for displaying a target window in at least one sub-display area of the plurality of sub-display areas when the trigger operation of the user is detected;
the environment information comprises information of a desk and information of a display screen of the electronic equipment, and the main display area is a display area determined by taking the position of a user as a reference and taking a plane where the desk is located as a reference; or the like, or, alternatively,
the environment information includes information of a virtual interface, and the main display area is a display area determined with reference to a position of a user and with reference to a plane perpendicular to a plane in which the virtual interface is located.
CN201611139100.8A 2016-12-12 2016-12-12 Display method, electronic equipment and display device Active CN106598390B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201611139100.8A CN106598390B (en) 2016-12-12 2016-12-12 Display method, electronic equipment and display device
US15/839,114 US20180164952A1 (en) 2016-12-12 2017-12-12 Virtual interface display method, electronic device, and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611139100.8A CN106598390B (en) 2016-12-12 2016-12-12 Display method, electronic equipment and display device

Publications (2)

Publication Number Publication Date
CN106598390A CN106598390A (en) 2017-04-26
CN106598390B true CN106598390B (en) 2021-01-15

Family

ID=58599305

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611139100.8A Active CN106598390B (en) 2016-12-12 2016-12-12 Display method, electronic equipment and display device

Country Status (1)

Country Link
CN (1) CN106598390B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107992194B (en) * 2017-11-24 2020-05-08 曾良军 Display method and device and terminal equipment
WO2019001060A1 (en) * 2017-06-26 2019-01-03 曾良军 Application display method and device, three-dimensional space display interface operation method and device, display method and device, application content display method and device, and terminal device
CN108924538B (en) * 2018-05-30 2021-02-26 太若科技(北京)有限公司 Screen expanding method of AR device
CN109254660B (en) * 2018-08-31 2020-11-17 歌尔光学科技有限公司 Content display method, device and equipment
CN111158620B (en) 2019-12-26 2020-11-24 成都星时代宇航科技有限公司 Picture display method and device and terminal
CN112181335B (en) * 2020-09-25 2023-08-15 北京博睿维讯科技有限公司 Multi-signal comprehensive management and control method, intelligent terminal and storage medium

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105637549A (en) * 2013-08-12 2016-06-01 艾尔维提塞有限责任公司 Augmented reality device

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11068149B2 (en) * 2010-06-09 2021-07-20 Microsoft Technology Licensing, Llc Indirect user interaction with desktop using touch-sensitive control surface
JP5724543B2 (en) * 2011-03-31 2015-05-27 ソニー株式会社 Terminal device, object control method, and program
KR101252169B1 (en) * 2011-05-27 2013-04-05 엘지전자 주식회사 Mobile terminal and operation control method thereof
US8933912B2 (en) * 2012-04-02 2015-01-13 Microsoft Corporation Touch sensitive user interface with three dimensional input sensor
US10108018B2 (en) * 2012-11-13 2018-10-23 Sony Corporation Image display apparatus for displaying an image captured by a mobile apparatus
US9619911B2 (en) * 2012-11-13 2017-04-11 Qualcomm Incorporated Modifying virtual object display properties

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105637549A (en) * 2013-08-12 2016-06-01 艾尔维提塞有限责任公司 Augmented reality device

Also Published As

Publication number Publication date
CN106598390A (en) 2017-04-26

Similar Documents

Publication Publication Date Title
CN106598390B (en) Display method, electronic equipment and display device
US10379733B2 (en) Causing display of a three dimensional graphical user interface with dynamic selectability of items
CN107077197B (en) 3D visualization map
JP5788513B2 (en) Method and system for adjusting display content
US10627990B2 (en) Map information display device, map information display method, and map information display program
CN106527915B (en) A kind of information processing method and electronic equipment
KR101163346B1 (en) method and device for controlling touch-screen, and recording medium for the same, and user terminal comprising the same
US8704782B2 (en) Electronic device, method for viewing desktop thereof, and computer-readable medium
KR20160094442A (en) Clicked object magnifying method and apparatus based on floating touch
EP2869174A1 (en) Method and device for text input and display of intelligent terminal
CN107533394B (en) Touch screen device, operation method thereof and handheld device
AU2014219558A1 (en) Method for controlling display of multiple objects depending on input related to operation of mobile terminal, and mobile terminal therefor
KR20140068938A (en) Multi-cell selection using touch input
US9129150B2 (en) Electronic apparatus and display control method
CN109643560B (en) Apparatus and method for displaying video and comments
CN107239222B (en) Touch screen control method and terminal device
KR102274944B1 (en) Apparatus and method for identifying an object
TWI416376B (en) Information processing apparatus, information processing apparatus control method, computer program product, and information memory medium
US20180164952A1 (en) Virtual interface display method, electronic device, and apparatus
KR101169560B1 (en) method and device for controlling touch-screen, and recording medium for the same, and user terminal comprising the same
US10037132B2 (en) Enlargement and reduction of data with a stylus
EP2602699A1 (en) Information processing device, method for controlling information processing device, program, and information storage medium
US20150355819A1 (en) Information processing apparatus, input method, and recording medium
WO2015164518A1 (en) Depth-based mode switching for touchless gestural interfaces
US20160253055A1 (en) Document Presentation Method and User Terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant