CN108170506B - Method and device for controlling app and control system - Google Patents
Method and device for controlling app and control system Download PDFInfo
- Publication number
- CN108170506B CN108170506B CN201711201457.9A CN201711201457A CN108170506B CN 108170506 B CN108170506 B CN 108170506B CN 201711201457 A CN201711201457 A CN 201711201457A CN 108170506 B CN108170506 B CN 108170506B
- Authority
- CN
- China
- Prior art keywords
- virtual
- control panel
- application interface
- control
- virtual application
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45504—Abstract machines for programme code execution, e.g. Java virtual machine [JVM], interpreters, emulators
Abstract
The present invention relates to the field of control, and in particular, to a control method, a control device, and a control system for an app. The control method of the app comprises the following steps: establishing a virtual control panel and a virtual application interface in a virtual space; establishing a corresponding relation between a virtual control panel and a virtual application interface; receiving an input instruction of a control panel; and controlling the apps corresponding to the virtual application interfaces according to the input instructions and the corresponding relations. According to the control method, the control device and the control system of the app, the virtual control panel and the virtual application interface are respectively established, the corresponding relation between the virtual control panel and the virtual application interface is established, and then after the input instruction of the control panel is received, the control and operation of the app corresponding to the virtual application interface can be realized according to the input instruction and the corresponding relation, a user does not need to move up and down, and only needs to click the corresponding position, so that the control of the app can be realized, the control method, the control device and the control system are simple and convenient, and the interaction efficiency is greatly improved.
Description
Technical Field
The present invention relates to the field of control, and in particular, to a control method, a control device, and a control system.
Background
As VR technology continues to enter people's lives, VR users are in an ever-rising state, both in the gaming and educational domains, and accordingly VR devices are also continually updated.
Currently, there are roughly three types of VR heads present on the world: external head shows equipment, the first equipment that shows of integral type and the first equipment that shows of mobile terminal formula. The user experience is the best and belongs to the external head display equipment. The VR head display can be in a completely closed environment, a user can obtain complete immersion experience and watch various video resources, and in practical application, the user needs to interact with the content in the VR head display, such as searching the video resources, and at the moment, the user can complete corresponding operation by means of a remote control handle matched with the VR head display.
Taking input as an example, when a user needs to search and input keywords, the hidden virtual keyboard can be called out through input actions, after the virtual keyboard appears in a VR head display, a remote control handle in a hand of the user is provided with physical keys and laser rays, the user selects letters through up-down and left-right movement of the physical keys, and click confirmation is completed through the laser rays. The operation is complex and the interaction efficiency is low.
Disclosure of Invention
The present invention is directed to a method, a device and a system for controlling an app, so as to solve the above problems.
In an embodiment of the present invention, there is provided a control method of an app, the control method including: establishing a virtual control panel and a virtual application interface in a virtual space; establishing a corresponding relation between the virtual control panel and the virtual application interface; receiving an input instruction of a control panel; and controlling the app corresponding to the virtual application interface according to the input instruction and the corresponding relation.
Preferably, the virtual application interface is a virtual keyboard.
Preferably, the establishing of the corresponding relationship between the virtual control board and the virtual application interface is: the virtual control panel and the virtual application interface are overlapped.
Preferably, the virtual control board and the virtual application interface are coincided to each other, and the method comprises the following steps: the virtual event interface is square or round, and the virtual control panel is also square or round correspondingly.
Preferably, the virtual control panel and the virtual interface being coincident comprises: acquiring a first plane size of a touch area of a control panel; acquiring a second plane size corresponding to the virtual control panel according to the first plane size; the size of the virtual interface is the same as the second plane size.
There is also provided in another embodiment of the present invention a control apparatus of an app, including: the device comprises a first establishing module, a second establishing module, a receiving module and a control module; the first establishing module is used for establishing a virtual control panel and a virtual application interface in a virtual space; the second establishing module is used for corresponding relation between the virtual control panel and the virtual application interface; the receiving module is used for receiving an input instruction of the control panel; the control module is used for controlling the apps corresponding to the virtual application interfaces according to the input instructions and the corresponding relations.
Preferably, the second building block comprises a repeating unit; the coincidence unit is used for making the virtual control panel coincide with the virtual application interface.
In an embodiment of the present invention, there is also provided a control system for an app, including: a control panel and a VR head display device; the control panel is displayed in the VR head display equipment to form a virtual control panel; a plurality of apps are configured in the VR head display equipment, a virtual application interface is formed, and a corresponding relation is established between the virtual control panel and the virtual application interface; the control panel receives an input instruction; and controlling the app corresponding to the virtual application interface according to the input instruction and the corresponding relation.
According to the control method, the control device and the control system of the app in the embodiment of the invention, the virtual control panel and the virtual application interface are respectively established in the VR environment, and the corresponding relation between the virtual control panel and the virtual application interface is established, so that after the input instruction of the control panel is received, the control and operation of the app corresponding to the virtual application interface can be realized according to the input instruction and the corresponding relation, a user does not need to move up and down, and can realize the control of the app only by clicking the corresponding position, so that the control method, the control device and the control system are simple and convenient, and the interaction efficiency is greatly improved.
Drawings
Fig. 1 is a flowchart illustrating a control method of an app according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a control method of another app according to an embodiment of the present invention;
fig. 3 shows a block diagram of a control device of an app according to an embodiment of the present invention;
fig. 4 shows a block diagram of a control device of another app provided by an embodiment of the present invention;
fig. 5 shows a schematic structural diagram of a control system of an app according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail below with reference to specific embodiments and with reference to the attached drawings.
In an embodiment of the present invention, there is provided a control method of an app, as shown in fig. 1, the control method including: step S001: establishing a virtual control panel and a virtual application interface in a virtual space; s002: establishing a corresponding relation between a virtual control panel and a virtual application interface; s003: receiving an input instruction of a control panel; and S004, controlling the apps corresponding to the virtual application interface according to the input instruction and the corresponding relation.
Specifically, in the virtual space, a virtual control board and a virtual application interface are established, such as an HTC five head display in the prior art and a wireless controller adapted thereto, which can be understood as a control board in the present invention, in which a virtual control board can be formed. Multiple applications may be running within the HTC vive, which may be games, video, input methods, etc. Accordingly, various applications may form a virtual application interface within the head display. The invention establishes the corresponding relation between the virtual control panel and the virtual application interface formed in the head display, namely, each click action of the virtual control panel can be realized, and the virtual application interface can respond to the click action. After a user inputs an instruction on the control panel, the instruction can be clicked or operated by other gestures, the control panel can analyze the input instruction, the instruction is transmitted to the head display equipment and displayed and embodied on the virtual control panel, the action of the virtual control panel is synchronous with the input of the control panel, the corresponding relation between the virtual control panel and the virtual application interface exists, the control of the control panel on the virtual application interface is further realized, and the control of the control panel on the app in the head display equipment is finished.
According to the app control method provided by the embodiment of the invention, the virtual control panel and the virtual application interface are respectively established in the VR environment, and the corresponding relation between the virtual control panel and the virtual application interface is established, so that after the input instruction of the control panel is received, the control and operation of the app corresponding to the virtual application interface can be realized according to the input instruction and the corresponding relation, a user does not need to move up and down, and only needs to click the corresponding position, so that the control of the app can be realized, the method is simple and convenient, and the interaction efficiency is greatly improved.
In practical applications, the virtual application interface is a virtual keyboard.
Specifically, when a user needs to search in a virtual space according to keywords, a virtual control panel needs to be established in a VR environment, a virtual keyboard of an input interface can also be established, a corresponding relation is established between the virtual keyboard and the virtual control panel, and after the control panel receives an external input instruction, corresponding input operations are displayed on the corresponding virtual control panel.
By adopting the control method of the app in the embodiment of the invention, an implementation way for quickly inputting the search keyword in the virtual space is provided, and the input efficiency is greatly improved.
On the basis of the above embodiment, the virtual control panel and the virtual application interface may be overlapped, and the correspondence between the virtual control panel and the virtual application interface mentioned in the above embodiment may be proportional scaling or stretching scaling, and the purpose of establishing the correspondence is to enable each pixel point of the virtual application interface to be embodied on the virtual control panel, which is convenient for control. In the embodiment, the virtual application interface and the virtual control panel are overlapped, so that the virtual application interface can be operated without conversion when the virtual control panel is operated, and the operation is convenient and quick.
In the practical application process, the step of superposing the virtual event interface and the virtual control panel comprises the following steps: the virtual event interface is circular, and the virtual control panel is also circular. Preferably, the coinciding the virtual event interface with the virtual dashboard comprises: the virtual event interface is square, and the virtual control panel is also square.
Specifically, the virtual event interface may be square or circular, and accordingly, the virtual control board may also be square or circular, or may be in other shapes, and the correspondence between the two is preferably the same shape.
In practical application, the actual shape of the control panel may be circular or square, so the virtual control panel is circular or square, and the preferred shape of the virtual event interface is circular or square in order to operate the virtual event interface by using the virtual control panel. The circular control panel corresponds to the circular virtual control panel, and the circular control panel accords with human engineering, is convenient for a user to operate in the actual use process, and is simple and convenient. The event interface is usually square, and then shows as square in the VR head display, and in order to facilitate the operation of the square virtual event interface, the virtual control panel is also square, so that the actual shape of the control panel can be designed as square. The virtual control panel and the virtual event interface in the same shape can be controlled in an equal scaling mode, and if the virtual control panel and the virtual event interface in different shapes are adopted, the control and the coincidence can be carried out in stretching modes and the like.
In an embodiment of the present invention, there is also provided a control method of an app, as shown in fig. 2, the control method including:
s01: establishing a virtual control panel and a virtual application interface in a virtual space;
s02, acquiring a first plane size of a touch area of the control board;
s03, acquiring a second plane size corresponding to the virtual control board according to the first plane size;
s04, the size of the virtual interface is the same as that of the second plane;
s05, receiving an input instruction of the control board;
and S06, controlling the apps corresponding to the virtual interface according to the input instruction.
Specifically, in the method for controlling an app provided in the embodiment of the present invention, in step S02, a first plane size of a touch-enabled area of a control board is obtained, specifically, the touch-enabled board may be full-screen touch or non-full-screen touch, and in the case of non-full-screen touch, the size of the touch-enabled area of the control board needs to be determined, and the length and the width or each side length thereof needs to be determined; the size of the touch-controllable area of the touch pad determines the size of the second plane of the virtual control board, and the size of the second plane is the same as the size of the virtual control interface, the size of the virtual control interface actually displayed can be adjusted, the size of the virtual control interface is adjusted according to the size of the second plane of the virtual control board, so that the size of the virtual interface is the same as the size of the second plane, and after the step S05 is executed to receive the input instruction of the control board, the virtual interface can be controlled according to the input instruction. And displaying the virtual touch area on the control panel which is originally partially outside the virtual space, so that the control on the virtual interface is completed in the virtual space, and the control on the app corresponding to the virtual interface is further realized.
According to the control method of the app provided by the embodiment of the invention, the size of the touch area of the control panel is accurately determined, so that the size of the touch area of the virtual control panel is obtained, and the size of the virtual interface is the same as that of the touch area, so that modeling of the virtual interface and the touch area of the virtual control panel in a three-dimensional space is completed, and the operation of the app corresponding to the virtual interface is realized by means of the touch area of the virtual control panel and the virtual interface in the virtual space.
In an embodiment of the present invention, there is also provided a control apparatus for an app, as shown in fig. 3, the control apparatus including: the system comprises a first establishing module 1, a second establishing module 2, a receiving module 3 and a control module 4, wherein the first establishing module 1 is used for establishing a virtual control board and a virtual application interface in a virtual space; the second establishing module 2 is used for establishing a corresponding relation between the virtual control panel and the virtual interface; the receiving module 3 is used for receiving an input instruction of the control panel; the control module 4 is used for controlling the apps corresponding to the virtual application interfaces according to the input instructions and the corresponding relations.
Further, as shown in fig. 4, on the basis of the above-mentioned embodiment, the second establishing module 2 includes a coincidence unit 21, and the coincidence unit 21 is used for coincidence of the virtual control board and the virtual application interface.
The control device for app provided in the embodiment of the present invention may be configured to execute the control method provided in the embodiment of the present invention, and has corresponding functional modules, so as to solve the same technical problem and achieve the same technical effect, which is not described herein again.
There is also provided in an embodiment of the present invention a control system of an app, including: a control panel 1 and a VR head display device 2; the control panel 1 is displayed in the VR head display device 2 to form a virtual control panel, a plurality of apps are configured in the VR head display device 2 to form a virtual application interface, a corresponding relation is established between the virtual application interface and the virtual control panel, the control panel 1 receives an input instruction, and the apps corresponding to the virtual interface are controlled according to the input instruction and the corresponding relation.
In the embodiment of the invention, the control panel 1 is displayed in the external head display device 2 to form a virtual control panel, a plurality of applications are arranged in the external head display device 2, the application operation interface in the external head display device 2 is a virtual control interface, and the virtual control interfaces are coincided with the virtual control panel.
Because the virtual images of the interface to be operated and the control panel 1 are respectively established in the VR environment, and the interface of the virtual event and the virtual control panel are overlapped, the control of the interface of the virtual event overlapped with the virtual control panel is realized while the control panel is operated, the control of the application operation interface in the external head display equipment 2 corresponding to the virtual event interface is further realized, a user can realize the control of the application interface without detaching the head display, and the operation is simple and convenient.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (5)
1. A method for controlling an app, comprising:
establishing a virtual control board and a virtual application interface in a VR virtual space of VR head display equipment, wherein the virtual control board is formed by displaying a control board in the VR virtual space of the VR head display equipment;
establishing a corresponding relation between the virtual control panel and the virtual application interface;
receiving an input instruction of the control panel;
controlling the app in the VR head display device corresponding to the virtual application interface according to the input instruction and the corresponding relation,
wherein, the establishing of the corresponding relationship between the virtual control panel and the virtual application interface is:
the virtual control panel and the virtual application interface coincide,
wherein the virtual control panel and the virtual application interface are overlapped, and the method comprises the following steps:
acquiring a first plane size of a touch area of a control panel;
acquiring a second plane size corresponding to the virtual control panel according to the first plane size;
the size of the virtual application interface is the same as the second plane size.
2. The method of claim 1, wherein the virtual application interface is a virtual keyboard.
3. The method of claim 1, wherein the virtual control panel and the virtual application interface being coincident comprises:
the virtual application interface is square or round, and the virtual control panel is also square or round correspondingly.
4. A control apparatus of an app, comprising:
the device comprises a first establishing module, a second establishing module, a receiving module and a control module;
the first establishing module is used for establishing a virtual control board and a virtual application interface in a VR virtual space of the VR head display equipment, wherein the virtual control board is formed by displaying the control board in the VR virtual space of the VR head display equipment;
the second establishing module is used for establishing the corresponding relation between the virtual control panel and the virtual application interface;
the receiving module is used for receiving an input instruction of the control panel;
the control module is used for controlling the apps in the VR head display equipment corresponding to the virtual application interface according to the input instruction and the corresponding relation,
wherein the second establishing module comprises a coincidence unit;
the coincidence unit is used for coincidence of the virtual control panel and the virtual application interface,
the superposition unit is used for acquiring a first plane size of a touch area of the control panel;
acquiring a second plane size corresponding to the virtual control panel according to the first plane size;
the size of the virtual application interface is the same as the second plane size.
5. A control system for an app, comprising: a control panel and a VR head display device;
the control panel is displayed in a VR virtual space of the VR head display equipment to form a virtual control panel; a plurality of apps are configured in the VR head display device, a virtual application interface is formed in the VR virtual space, a corresponding relation is established between the virtual control panel and the virtual application interface, and the virtual control panel and the virtual application interface are overlapped; the control panel receives an input instruction; controlling the app in the VR head display device corresponding to the virtual application interface according to the input instruction and the corresponding relation,
wherein, the virtual control panel and the virtual application interface are overlapped, including:
acquiring a first plane size of a touch area of a control panel;
acquiring a second plane size corresponding to the virtual control panel according to the first plane size;
the size of the virtual application interface is the same as the second plane size.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711201457.9A CN108170506B (en) | 2017-11-27 | 2017-11-27 | Method and device for controlling app and control system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711201457.9A CN108170506B (en) | 2017-11-27 | 2017-11-27 | Method and device for controlling app and control system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108170506A CN108170506A (en) | 2018-06-15 |
| CN108170506B true CN108170506B (en) | 2021-09-17 |
Family
ID=62527655
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711201457.9A Active CN108170506B (en) | 2017-11-27 | 2017-11-27 | Method and device for controlling app and control system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108170506B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102047190A (en) * | 2008-04-16 | 2011-05-04 | Keba股份公司 | Method for operating an electrically controllable technical device and corresponding control device |
| CN103500057A (en) * | 2013-10-08 | 2014-01-08 | 百度在线网络技术（北京）有限公司 | Mobile terminal and control method and device thereof |
| CN105955453A (en) * | 2016-04-15 | 2016-09-21 | 北京小鸟看看科技有限公司 | Information input method in 3D immersion environment |
| CN106527938A (en) * | 2016-10-26 | 2017-03-22 | 北京小米移动软件有限公司 | Method and device for operating application program |
| CN106600333A (en) * | 2016-12-20 | 2017-04-26 | 北京平塔科技有限公司 | Virtual reality advertisement position content exposure monitoring method and device |
| CN106896920A (en) * | 2017-03-01 | 2017-06-27 | 网易（杭州）网络有限公司 | Virtual reality system, virtual reality device, virtual reality control device and method |
| JP2017157187A (en) * | 2016-02-18 | 2017-09-07 | イマージョン コーポレーションＩｍｍｅｒｓｉｏｎ Ｃｏｒｐｏｒａｔｉｏｎ | Wearable haptic effects with permissions settings |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102819315B (en) * | 2012-07-23 | 2016-04-13 | 中兴通讯股份有限公司 | A kind of 3D man-machine interaction method and system |
| WO2015140106A1 (en) * | 2014-03-17 | 2015-09-24 | IT-Universitetet i København | Computer-implemented gaze interaction method and apparatus |
| CN103984252A (en) * | 2014-05-09 | 2014-08-13 | 上海电机学院 | Helmet type remote control terminal used for robot |
| CN105700763A (en) * | 2014-11-25 | 2016-06-22 | 中兴通讯股份有限公司 | Terminal interface window moving method and terminal interface window moving device |
| US20170287215A1 (en) * | 2016-03-29 | 2017-10-05 | Google Inc. | Pass-through camera user interface elements for virtual reality |
| CN106708255A (en) * | 2016-10-31 | 2017-05-24 | 宇龙计算机通信科技(深圳)有限公司 | Interaction control method and system for virtual interface |
| CN106774823A (en) * | 2016-11-11 | 2017-05-31 | 奇酷互联网络科技（深圳）有限公司 | Virtual reality device and its input method |
-
2017
- 2017-11-27 CN CN201711201457.9A patent/CN108170506B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102047190A (en) * | 2008-04-16 | 2011-05-04 | Keba股份公司 | Method for operating an electrically controllable technical device and corresponding control device |
| CN103500057A (en) * | 2013-10-08 | 2014-01-08 | 百度在线网络技术（北京）有限公司 | Mobile terminal and control method and device thereof |
| JP2017157187A (en) * | 2016-02-18 | 2017-09-07 | イマージョン コーポレーションＩｍｍｅｒｓｉｏｎ Ｃｏｒｐｏｒａｔｉｏｎ | Wearable haptic effects with permissions settings |
| CN105955453A (en) * | 2016-04-15 | 2016-09-21 | 北京小鸟看看科技有限公司 | Information input method in 3D immersion environment |
| CN106527938A (en) * | 2016-10-26 | 2017-03-22 | 北京小米移动软件有限公司 | Method and device for operating application program |
| CN106600333A (en) * | 2016-12-20 | 2017-04-26 | 北京平塔科技有限公司 | Virtual reality advertisement position content exposure monitoring method and device |
| CN106896920A (en) * | 2017-03-01 | 2017-06-27 | 网易（杭州）网络有限公司 | Virtual reality system, virtual reality device, virtual reality control device and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108170506A (en) | 2018-06-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10664011B2 (en) | Wearable apparatus and method for controlling VR apparatus | |
| CN102789313A (en) | User interaction system and method | |
| CN105208675B (en) | A kind of wireless connection method and smartwatch based on smartwatch | |
| CN106454322A (en) | VR Image processing system and method thereof | |
| CN106896920B (en) | Virtual reality system, virtual reality equipment, virtual reality control device and method | |
| CN106168881B (en) | The method for promoting blank screen gesture response speed | |
| CN104076916A (en) | Information processing method and electronic device | |
| CN102779000A (en) | User interaction system and method | |
| CN102789312A (en) | User interaction system and method | |
| CN103927119A (en) | Method and system for switching to account interface | |
| WO2017012378A1 (en) | System for operating computer, wearable device and method for operating computer thereof | |
| CN103176667A (en) | Projection screen touch terminal device based on Android system | |
| CN102637127A (en) | Method for controlling mouse modules and electronic device | |
| CN103207741A (en) | Multi-user touch control method and system of computer virtual object | |
| CN109451141A (en) | A kind of method of controlling operation thereof and associated terminal | |
| CN106657609A (en) | Virtual reality device and control device and method thereof | |
| CN105262880A (en) | Mobile phone control demonstration system applied to WiFi network | |
| CN108355352A (en) | Dummy object control method and device, electronic equipment, storage medium | |
| CN110069101A (en) | A kind of wearable calculating equipment and a kind of man-machine interaction method | |
| CN108170506B (en) | Method and device for controlling app and control system | |
| CN105959754A (en) | Method, device and system for controlling intelligent TV set remotely via terminal | |
| CN106445281B (en) | A kind of method and system of adjustment intelligent terminal operation key position | |
| CN110457227B (en) | System and method for assisting developers or students in VR application development | |
| CN110427138A (en) | Translation information processing method, device, electronic equipment and storage medium | |
| CN103336587B (en) | The far-end suspension touch control equipment of a kind of nine axle inertial orientation input units and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |