CN106843467B - Screen expansion system based on position and expansion method thereof - Google Patents
Screen expansion system based on position and expansion method thereof Download PDFInfo
- Publication number
- CN106843467B CN106843467B CN201611224414.8A CN201611224414A CN106843467B CN 106843467 B CN106843467 B CN 106843467B CN 201611224414 A CN201611224414 A CN 201611224414A CN 106843467 B CN106843467 B CN 106843467B
- Authority
- CN
- China
- Prior art keywords
- screen
- virtual screen
- virtual
- equipment
- sensor data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
Abstract
The invention discloses a screen expansion system based on position and an expansion method thereof, wherein the expansion system comprises: a virtual screen display unit for starting a virtual screen in a device; the acquisition unit is used for acquiring sensor data of equipment; and the processing unit calls the sensor data and correspondingly starts the service options displayed on the virtual screen. The invention can correspondingly start the virtual screen according to the position change data of the equipment, and has the characteristics of low cost, customizable application scene and the like.
Description
Technical Field
The invention relates to the field of control, in particular to a screen expansion system based on a position and an expansion method thereof.
Background
With the development of wearable devices, more and more consumers use wearable devices, but the wearable devices often require characteristics of beauty, strong wearability and the like, so that the adoption of a larger-size display screen is limited, and in this way, some user experience requiring large-size display is sacrificed.
In order to achieve the effect of a small-size large screen, as shown in fig. 1, in the existing patent, magnifier software is arranged in wearable equipment to realize a magnifier function, so as to realize local magnification of characters or pictures; the projection can be carried out on the back of the hand, the wrist or even the lower arm of the user, and the virtual touch operation can be carried out.
But increase projection hardware on original system, increase the cost, and built-in magnifying glass is because use experience is very poor on little screens such as wrist-watch, and the screen itself is just little, removes the magnifying glass and just becomes a problem, can not promote by a large scale.
Disclosure of Invention
The invention aims to solve the technical problem of providing a screen expansion system based on position and an expansion method thereof. The requirement that a user accesses large-size pictures or characters on the wearable device is met, and user experience is improved.
In order to achieve the purpose, the technical scheme of the invention is as follows:
a location-based screen expansion system, comprising:
a virtual screen display unit for starting a virtual screen in a device;
the acquisition unit is used for acquiring sensor data of equipment;
and the processing unit calls the sensor data and correspondingly starts the service options displayed on the virtual screen.
In a preferred embodiment of the invention, the area of the virtual screen is larger than the real screen area of the device.
In a preferred embodiment of the present invention, the system further includes a switching unit, and the switching unit is configured to switch the virtual screen display unit to be in an operating state or a non-operating state.
In a preferred embodiment of the present invention, the system further comprises a time detection unit, and the virtual screen display unit starts the virtual screen if the apparatus is maintained at the specific position for more than 2 s.
In a preferred embodiment of the present invention, the specific position is that the real screen is horizontally inclined at an angle of 0 to 45 degrees with respect to the ground.
In a preferred embodiment of the present invention, the virtual screen includes a plurality of service options, each service option is located at a different position, and the mobile device can view the corresponding service option.
In a preferred embodiment of the present invention, the system further comprises an anti-shake unit, and the anti-shake unit cuts off data transmission between the acquisition unit and the processing unit when the acquisition unit detects that the displacement distance for moving the device is less than 2 mm.
In a preferred embodiment of the invention, moving the device vertically up and down turns on or off the service option after moving to the service option.
A location-based screen expansion method includes the following steps:
opening a switch of the virtual screen;
and acquiring sensor data of the current equipment, and calling service options correspondingly displayed on the virtual screen according to the acquired sensor data.
In a preferred embodiment of the present invention, the method further includes a detection step after the sensor data of the current device is collected, and if the sensor data meets the position condition set by the device, a virtual screen is displayed; and if the position condition set by the equipment is not met, the virtual screen is not displayed.
Through the technical scheme, the invention has the beneficial effects that:
the invention can correspondingly start the virtual screen according to the position change data of the equipment, and has the characteristics of low cost, customizable application scene and the like.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic diagram of the operation of the prior art.
FIG. 2 is a control flow chart of the present invention.
Fig. 3 is an angle diagram of embodiment 1 of the present invention.
Fig. 4 is a virtual screen of embodiment 1 of the present invention.
Fig. 5 is a schematic diagram of the operation of the virtual screen according to embodiment 1 of the present invention.
Fig. 6 is a schematic diagram of the operation of the virtual screen according to embodiment 2 of the present invention.
Detailed Description
In order to make the technical means, the creation characteristics, the achievement purposes and the effects of the invention easy to understand, the invention is further explained below by combining the specific drawings.
A location-based screen expansion system, comprising:
a virtual screen display unit for starting a virtual screen in a device;
specifically, the virtual screen is a virtual device in which a screen with a large display size is virtually created in the system through software and maintained in real time, and the virtual screen has a system memory space.
The acquisition unit is used for acquiring sensor data of equipment;
and the processing unit calls the sensor data and correspondingly starts the service options displayed on the virtual screen.
Further, the area of the virtual screen is larger than the real screen area of the device. Generally, screens of wearable devices are small, a part of contents on a virtual screen are output to a screen display unit of the wearable device in a memory mapping mode by calculating position information, and then the display of the virtual screen is achieved.
The system also comprises a switching unit, wherein the switching unit is used for switching the virtual screen display unit to be in a working state or a non-working state; and the device is maintained at a specific position for more than 2s, and the virtual screen display unit starts a virtual screen. The specific position is that the horizontal included angle between the real screen and the ground is 0-45 degrees.
Additionally, the virtual screen includes a plurality of service options, each service option is located at a different location, and the device can be moved to view the corresponding service option.
In order to ensure the accuracy of the whole position information in the using process, the system also comprises an anti-shaking unit, and when the acquisition unit detects that the displacement distance for moving the equipment is less than 2mm, the anti-shaking unit cuts off the data transmission of the acquisition unit and the processing unit.
After the mobile terminal moves to the service option, the mobile terminal vertically moves up and down the equipment to open or close the service option; how to use specifically, can according to the program setting, for the convenience of starting corresponding service option, the selection is switched corresponding service from top to bottom vertically in this embodiment, and is more convenient, convenient.
Referring to fig. 2, a location-based screen expansion method includes the steps of:
opening a switch of the virtual screen;
and acquiring sensor data of the current equipment, and calling service options correspondingly displayed on the virtual screen according to the acquired sensor data.
Further, the method comprises a detection step after the sensor data of the current equipment are collected, and if the sensor data meet the position condition set by the equipment, a virtual screen is displayed; and if the position condition set by the equipment is not met, the virtual screen is not displayed.
Example 1:
the device in the embodiment is described by using a watch, and the position-based screen expansion method comprises the following steps:
step one, configuring related options on a watch setting page.
Set up the page at the wrist-watch and can add and open virtual screen display function, if the user closes this function, then can not gather positional information, compatible traditional mode shows, when this function is opened, then can gather the sensor data of user's wrist-watch, whether start virtual screen according to data judgement, specific flow chart is shown in fig. 2:
and step two, judging whether to start virtual screen display or not through an included angle between the surface of the watch and the ground plane.
As shown in the figure, when the virtual screen function is opened, and the horizontal included angle between the surface of the watch and the ground is in the interval of 0-45 degrees (as shown in figure 3), and the watch is judged to be viewed by the user when the position is kept for 2s or more, the virtual screen is opened, and the position information is used as initial information.
And step three, virtualizing a virtual screen in the watch system after starting.
As shown in fig. 4 below, for example, a virtual screen with a size of 800 × 600 is applied to a system to store screen pixel data in a buffer with a size of 800 × 600 bytes, and the contents of an application management page are written into the buffer.
And step four, mapping the content of the virtual screen to a real screen of the watch based on the position information, and performing shake elimination processing.
The watch, at the initial position as recorded in the step of fig. 2, projects the content of the upper left-most corner of the virtual screen onto the watch screen as the initial state. The mapping relation is as follows: 200 × 150, the content of 200 × 120 pixels is grabbed from the leftmost upper corner of the virtual screen and filled into the display buffer of the watch real screen.
To eliminate jitter, we mask the slight position variation of the sensor, and assuming that our resolution is 300 pixels/inch, we first use 10 pixels as the minimum motion unit, 300 pixels/inch dpi ≈ 0.003333 pixels per inch, 1 inch ≈ 2.54 cm,
the 10 pixels are 10 × 0.003333 × 2.54 ≈ 0.0846582 cm ≈ 0.85mm, and on the basis, we multiply a motion coefficient, tentatively 2, that is, 0.85mm × 2 ≈ 1.7mm, when the spatial position is dithered within 1.7mm, we ignore the position change, but when the spatial position is larger than 1.7mm, we move 10 pixels every 1.7mm, and when the spatial position is moved, we move according to 1-2 pixels slowly, and the smoothness is improved.
Meanwhile, the position distance of the virtual screen on the space can be calculated:
1,(800/10)*1.7＝136mm
2,(600/10)*1.7＝102mm
step five, selecting the needed app through position movement
As shown in fig. 5 below, but when the app is located at the center of the watch surface, the app is operated by shaking the surface twice up and down in the direction perpendicular to the ground, and when the gesture is performed first down, then up, then down, and then up (↓), the desired app can be opened, and when the gesture is performed first up, then down, then up, and then down (↓.
The application management page of the watch is refreshed and maintained in the system by using the virtual screen with the fixed pixel size, a user checks the content in the virtual screen by moving the watch screen, and after an icon of a target application is found, the application is continuously shaken twice in the vertical direction to open the application, so that the purpose of operating the screen by the position and the action is achieved, the operation actions of manually turning the page, clicking the open application and the like are omitted, and the user experience is improved.
Example 2:
as shown in fig. 6, when we read a large amount of text, we can map the text onto the virtual screen, so that the text size can be displayed in a larger pixel of the virtual screen (here, the larger display is compared with the real screen of the wearable device), and the text with a fixed number of words is output to the virtual screen, and the corresponding single word occupies more pixels. When the display content of the virtual screen corresponds to the actual wearable device, only a part of the content of the virtual screen is intercepted, and compared with the method of projecting all characters on a real screen, the corresponding character size is increased.
And the text information on the virtual screen is read step by moving the surface of the watch, so that the trouble of page turning and small screen is reduced.
The basic flow and the technology are the same as the first scene, and the different places are that (↓) next page when the gesture is first down, then up, then down and then up, and (↓) previous page when the gesture is first up, then down, then up and then down. Gestures and self-definition at the setup interface.
The invention realizes screen expansion by the existing mature technology and a software mode, and has the characteristics of low cost, customizable application scene and the like.
The foregoing shows and describes the general principles and broad features of the present invention and advantages thereof. It will be understood by those skilled in the art that the present invention is not limited to the embodiments described above, which are described in the specification and illustrated only to illustrate the principle of the present invention, but that various changes and modifications may be made therein without departing from the spirit and scope of the present invention, which fall within the scope of the invention as claimed. The scope of the invention is defined by the appended claims and equivalents thereof.
Claims (6)
1. A location-based screen expansion system, comprising:
a virtual screen display unit for starting a virtual screen in a device; the virtual screen is a screen with a larger display size virtually generated in the system and maintained in real time, and the virtual screen has virtual equipment of a system memory space;
the acquisition unit is used for acquiring sensor data of equipment;
the switching unit is used for switching the virtual screen display unit to be in a working state or a non-working state;
the processing unit calls the sensor data and correspondingly starts the service options displayed on the virtual screen;
when the spatial position is larger than 1.7mm, calculating the position distance of the virtual screen on the space;
the system also comprises a time detection unit, and if the equipment is maintained at a specific position for more than 2s, the virtual screen display unit starts a virtual screen;
the specific position is that the horizontal included angle between the real screen and the ground is 0-45 degrees;
based on the position information, the content of the virtual screen is mapped to the real screen of the equipment, the shake elimination processing is carried out, meanwhile, the position distance of the virtual screen on the space is calculated, and the mapping relation is as follows, for example, the pixels of the real screen of the equipment are as follows: 200 × 150, grabbing 200 × 120 pixels from the leftmost upper corner of the virtual screen and filling the pixels into a display buffer of the watch real screen;
the application management page of the device is refreshed and maintained in the system by using a virtual screen with a fixed pixel size, a user checks the content in the virtual screen through the position of the mobile device screen, and after finding the icon of the target application, the user continuously shakes twice in the vertical direction to open the application, so that the screen is operated through the position and the action.
2. A location-based screen extension system according to claim 1, wherein the area of said virtual screen is larger than the real screen area of said device.
3. The system of claim 1 or 2, wherein the virtual screen comprises a plurality of service options, each service option is located at a different position, and the mobile device can view the corresponding service option.
4. A position based screen expansion system according to claim 3, characterized in that the system further comprises an anti-shake unit, the anti-shake unit cuts off the data transmission of the acquisition unit and the processing unit when the acquisition unit detects that the displacement distance for moving the device is less than 2 mm.
5. The system of claim 4, wherein moving the device vertically up and down turns the service option on or off after moving to the service option.
6. A method for extending a screen based on position is characterized by comprising the following steps:
a user sets a virtual screen display starting function;
acquiring sensor data of current equipment, and calling service options correspondingly displayed on a virtual screen according to the acquired sensor data;
the method comprises the following steps of collecting sensor data of current equipment, and displaying a virtual screen if the sensor data meet the position condition set by the equipment; if the position condition set by the equipment is not met, the virtual screen is not displayed;
the virtual screen is opened specifically by moving up and down through gestures.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611224414.8A CN106843467B (en) | 2016-12-27 | 2016-12-27 | Screen expansion system based on position and expansion method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611224414.8A CN106843467B (en) | 2016-12-27 | 2016-12-27 | Screen expansion system based on position and expansion method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106843467A CN106843467A (en) | 2017-06-13 |
| CN106843467B true CN106843467B (en) | 2020-12-08 |
Family
ID=59135860
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611224414.8A Active CN106843467B (en) | 2016-12-27 | 2016-12-27 | Screen expansion system based on position and expansion method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106843467B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110851227B (en) * | 2019-11-13 | 2021-10-22 | 联想(北京)有限公司 | Display control method and electronic equipment |
| CN112716117B (en) * | 2020-12-28 | 2023-07-14 | 维沃移动通信有限公司 | Intelligent bracelet and control method thereof |
| CN115942022A (en) * | 2021-08-27 | 2023-04-07 | 中移(苏州)软件技术有限公司 | Information preview method, related equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102163076A (en) * | 2010-02-12 | 2011-08-24 | 韩国电子通信研究院 | Apparatus for providing self-morphable haptic and visual information and method thereof |
| CN104156064A (en) * | 2014-07-18 | 2014-11-19 | 小米科技有限责任公司 | Interactive target control method and device |
| CN104364727A (en) * | 2012-04-13 | 2015-02-18 | 诺基亚公司 | Variable valve device |
| CN104965588A (en) * | 2015-06-10 | 2015-10-07 | 福州瑞芯微电子有限公司 | Expandable smart bracelet or smart watch based on NFC |
| CN105320452A (en) * | 2014-07-18 | 2016-02-10 | 马克西姆综合产品公司 | Wearable device for using human body as input mechanism |
| CN106033257A (en) * | 2015-03-18 | 2016-10-19 | 联想(北京)有限公司 | Control method and device |
-
2016
- 2016-12-27 CN CN201611224414.8A patent/CN106843467B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102163076A (en) * | 2010-02-12 | 2011-08-24 | 韩国电子通信研究院 | Apparatus for providing self-morphable haptic and visual information and method thereof |
| CN104364727A (en) * | 2012-04-13 | 2015-02-18 | 诺基亚公司 | Variable valve device |
| CN104156064A (en) * | 2014-07-18 | 2014-11-19 | 小米科技有限责任公司 | Interactive target control method and device |
| CN105320452A (en) * | 2014-07-18 | 2016-02-10 | 马克西姆综合产品公司 | Wearable device for using human body as input mechanism |
| CN106033257A (en) * | 2015-03-18 | 2016-10-19 | 联想(北京)有限公司 | Control method and device |
| CN104965588A (en) * | 2015-06-10 | 2015-10-07 | 福州瑞芯微电子有限公司 | Expandable smart bracelet or smart watch based on NFC |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106843467A (en) | 2017-06-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10332240B2 (en) | Method, device and computer readable medium for creating motion blur effect | |
| US8860672B2 (en) | User interface with z-axis interaction | |
| JP5014706B2 (en) | Method for controlling the location of a pointer displayed by a pointing device on a display surface | |
| WO2020038168A1 (en) | Content sharing method and device, terminal, and storage medium | |
| TWI459283B (en) | Adjustable and progressive mobile device street view | |
| WO2015025460A1 (en) | Using swipe gestures to change displayed applications | |
| JP6048898B2 (en) | Information display device, information display method, and information display program | |
| CN113805745B (en) | Control method of suspension window and electronic equipment | |
| US10521094B2 (en) | Device, method and computer readable medium that change a displayed image based on change in time information in response to slide operation of the displayed time | |
| CN106843467B (en) | Screen expansion system based on position and expansion method thereof | |
| CN110347317B (en) | Window switching method and device, storage medium and interactive intelligent panel | |
| JP2004227393A (en) | Icon drawing system, icon drawing method and electronic device | |
| EP2741205B1 (en) | Display system, display controller, program and method | |
| CN111701238A (en) | Virtual picture volume display method, device, equipment and storage medium | |
| JP2012533102A (en) | Selective distribution of changing image updates to client devices | |
| JP2015158748A (en) | Control apparatus, information processing apparatus, control method, information processing method, information processing system and wearable device | |
| CN111324250A (en) | Three-dimensional image adjusting method, device and equipment and readable storage medium | |
| JP2015114436A (en) | Image transmission device, image presentation system, control method, and program | |
| CN113129417A (en) | Image rendering method in panoramic application and terminal equipment | |
| CN116149765A (en) | Method for determining refresh mode of ink screen, electronic device and storage medium | |
| WO2021244651A1 (en) | Information display method and device, and terminal and storage medium | |
| JP5800386B2 (en) | Map display device, map display method, and program | |
| WO2018068364A1 (en) | Method and device for displaying page, graphical user interface, and mobile terminal | |
| Rooney et al. | HiReD: a high-resolution multi-window visualisation environment for cluster-driven displays | |
| US20120322464A1 (en) | Terminal with virtual space interface and method of controlling virtual space interface |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |