CN111340962A - Control method, electronic device, and storage medium - Google Patents
Control method, electronic device, and storage medium Download PDFInfo
- Publication number
- CN111340962A CN111340962A CN202010111057.4A CN202010111057A CN111340962A CN 111340962 A CN111340962 A CN 111340962A CN 202010111057 A CN202010111057 A CN 202010111057A CN 111340962 A CN111340962 A CN 111340962A
- Authority
- CN
- China
- Prior art keywords
- display screen
- input
- area
- user
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
Abstract
The invention provides a control method, electronic equipment and a storage medium, wherein the electronic equipment comprises a first display screen and a second display screen, and the method comprises the following steps: receiving a first input of a user to a second display screen under the condition that the first display screen outputs display content in a Virtual Reality (VR) mode; in response to the first input, display content of the first display screen is updated. The control method provided by the invention plays an auxiliary role of the auxiliary screen, improves the utilization rate of the auxiliary screen, and simultaneously improves the VR experience of a user.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a control method, an electronic device, and a storage medium.
Background
With the increasingly vigorous development of VR (Virtual Reality) technology, VR devices are more and more favored by people. There are three main types of VR devices seen today, the first being achieved by purely optical lenses, usually placing the lenses in a carton and the electronics behind the lenses. The second is for intelligent electronic device, place electronic device on VR equipment, watch the screen through taking VR equipment to realize. The last one is for PC (Personal Computer), and the display of VR effect is mainly realized by connecting PC.
In the VR equipment that sees at present, the VR effect is realized with other equipment cooperations to the majority utilizing electronic equipment, when using electronic equipment to carry out VR and experiencing, when the content of user's needs adjustment display screen, need carry out a plurality of steps, it is inconvenient to have brought very big operation for the user.
Disclosure of Invention
Embodiments of the present invention provide a control method, an electronic device, and a storage medium, which can solve the problem in the prior art that an operation process is complicated when performing VR experience, which brings inconvenience to a user and further affects VR experience of the user.
In order to solve the above problem, the embodiment of the present invention is implemented as follows:
in a first aspect, an embodiment of the present invention provides a control method, which is applied to an electronic device, where the electronic device includes a first display screen and a second display screen, and the method includes:
receiving a first input of a user to a second display screen under the condition that the first display screen outputs display contents in a Virtual Reality (VR) mode;
in response to the first input, display content of the first display screen is updated.
In a second aspect, an embodiment of the present invention provides an electronic device, where the electronic device includes a first display screen and a second display screen, and the electronic device further includes:
the first receiving module is used for receiving first input of a user to the second display screen under the condition that the first display screen outputs display content in a Virtual Reality (VR) mode;
and the updating module is used for responding to the first input and updating the display content of the first display screen.
In a third aspect, an embodiment of the present invention further provides an electronic device, which includes a processor, a memory, and a computer program stored in the memory and executable on the processor, where the computer program, when executed by the processor, implements the steps of the control method described above.
In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the control method described above.
According to the technical scheme, the auxiliary characteristic of the second display screen is utilized in the VR mode, the video content displayed in the first display screen is updated according to the input of the user to the second display screen, the operation steps of the user in the VR experience can be reduced, the utilization rate of the auxiliary screen is improved, and the VR experience of the user is improved.
Drawings
FIG. 1 is a flow chart of a control method provided by an embodiment of the invention;
FIG. 2 is a schematic diagram of a first display screen outputting video content according to an embodiment of the present invention;
FIG. 3 is a schematic view of a second display screen displaying a video operation interface according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of an embodiment of the present invention showing a second area and a first mapped location on a first display screen;
fig. 5 is a schematic diagram illustrating that the content shot by the camera is displayed on the first display screen according to the embodiment of the invention;
FIG. 6 is a schematic diagram of an electronic device according to an embodiment of the invention;
fig. 7 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
An embodiment of the present invention provides a control method, which is applied to an electronic device, where the electronic device includes a first display screen and a second display screen, and as shown in fig. 1, the method includes:
The electronic device of the embodiment of the invention can comprise two display screens, wherein the electronic device can be matched with the VR device to enable the first display screen to output display contents in the VR mode, the electronic device can also control the first display screen to output the display contents in the VR mode through the VR application program, and the electronic device can also control the first display screen to output the display contents in the VR mode through the VR function.
Wherein, make the condition of first display screen output display content at the VR mode to electronic equipment and VR equipment cooperation, after electronic equipment and VR equipment cooperation, can carry out VR mode switch automatically or through manual regulation, output display content by first display screen under the VR mode.
The electronic equipment can be controlled to output the display content in the VR mode after the VR application program is started aiming at the condition that the electronic equipment controls the first display screen to output the display content in the VR mode through the VR application program.
The method comprises the steps that the electronic equipment controls a first display screen to output display content in a VR mode through a VR function, and after the electronic equipment starts the VR function, the first display screen is controlled to output the display content in the VR mode.
The display content output by the first display screen in the VR mode may be: video content played through the application program, game content currently running, panoramic scene video, a virtual automobile exhibition hall played through the application program and the like. Illustratively, as shown in fig. 2, a schematic diagram of video content output in VR mode for a first display screen is shown.
In the case where the first display screen outputs the display content in the VR mode, a first input to the second display screen may be received, where the first input includes, but is not limited to, a touch input, and optionally, the first input may be performed by a first user currently viewing the first display screen, or may be performed by other users.
And 102, responding to the first input, and updating the display content of the first display screen.
After receiving the first input to the second display screen, the display content in the first display screen can be updated according to the first input. When the display content is updated, the corresponding update can be performed according to the type of the display content corresponding to the first display screen. For example, if the display content of the first display screen is video content, the update may be performed according to fast forward, fast backward, play next, quit, resolution adjustment, volume adjustment, and may also include other operations according to the actual situation, which is not described herein again. Or if the display content of the first display screen is game content, the display content can be updated according to forward and backward movement of the target character in the game.
Above-mentioned process utilizes the auxiliary characteristic of second display screen under the VR mode, realizes the renewal to the video content that shows in the first display screen according to the user to the input of second display screen, can reduce the operation step of user when VR is experienced, when improving vice screen rate of utilization, improves user's VR and experiences.
Optionally, in an embodiment of the present invention, before receiving the first input of the user to the second display screen, the method further includes:
and receiving a third input of the user to the second display screen, and controlling the second display screen to be in a bright screen display state in response to the third input. After the electronic equipment receives a third input to the second display screen, the electronic equipment controls the second display screen to be in a bright screen display state according to the third input. The second display screen is not always displayed in a bright screen mode, but is switched to a bright screen mode when an operation requirement exists. Switching the second display screen from the off-screen state or the lock-screen state to the on-screen state may be triggered by a touch event of a user, for example, controlling the second display screen to be in the on-screen display state according to a touch operation of the user on the second display screen or an operation of a side key of the second display screen. After the second display screen is in the bright screen display state, the corresponding operation control may be displayed, and when the display content in the first display screen is the video content, the video operation interface in the second display screen may be as shown in fig. 3.
Above-mentioned process controls the screen state of second display screen through operating the second display screen, can save the consumption, shows the operation controlling part that corresponds with the content on the first display screen under the condition that the second display screen is in the bright screen, can exert the assistant characteristic of second display screen, improves vice screen rate of utilization, according to the operation of user to the second display screen, improves user's VR and experiences.
In an embodiment of the present invention, before receiving the first input to the second display screen, the method further includes:
receiving a second input of the user to the first area of the second display screen;
in response to a second input, determining a second area on the first display screen, wherein the second area is an area of the first display screen mapped by the first area, and the second area comprises a virtual control with the same function as the control in the first area;
receiving a sliding input of a user in a first area;
in response to the slide input, a first track corresponding to the slide input is displayed in the second area.
A second input by the user to a first region of the second display screen may also be received prior to receiving the first input to the second display screen, where the first region may be a region including at least one control within the second display screen. After receiving a second input of the user to the first area of the second display screen, a second area corresponding to the first area may be determined on the first display screen according to the second input, where the second area is an area where the first area is mapped onto the first display screen, as shown in fig. 3 and fig. 4, the first area (video operation interface) on the second display screen is mapped onto the first display screen to form the second area, where the second area may be filled with a preset transparency to distinguish from the display content in the first display screen, which may not affect the viewing of the display content in the first display screen by the first user, and optionally, the preset transparency may be default, and may also be set by the user.
The second area comprises virtual controls with the same functions as the controls in the first area, the virtual controls and the controls in the first area can form a one-to-one mapping relation, and the preset transparencies of the virtual controls and the second area can be different, so that the first user can conveniently watch the virtual controls. As shown in fig. 4, in order to determine a second region on the first display screen, and fill a schematic diagram of a preset transparency in the second region, a corresponding virtual control may be displayed in the second region, where the transparency of the virtual control may be different from that of the virtual control corresponding to the inside of the second region, so that the virtual control is prominently displayed in the second region.
After displaying the second area on the first display screen and displaying the first mapping position in the second area, a slide input in the first area may be received, and in response to the slide input, a first trajectory corresponding to the slide input is displayed in the second area.
In a case where a slide input performed within the first region is received, a slide trajectory of the slide input may be mapped onto the first display screen, and a first trajectory corresponding to the slide input may be displayed in a second region of the first display screen. And according to the first mapping position and the position of the virtual control, the distance between the finger and the control on the second display screen is known. The first mapping position may be highlighted, for example, by using a highlight flashing line, or displayed in a highlighted color. By displaying the first track on the first display screen, the first user can know the motion of the finger on the second display screen in real time conveniently, and the first user can perform operation on the control on the second display screen conveniently and accurately.
The first area of the second display screen is mapped to the first display screen to form a second area, the virtual control and the first mapping position of the finger of the first user on the first display screen are displayed in the second area, the first user can know the distance between the finger and the control on the second display screen conveniently, and a basis is provided for the first user to accurately operate the second display screen.
Optionally, in response to the first input, updating the display content of the first display screen includes:
determining a target virtual control corresponding to the end point of the first track as a target control in the first area;
responding to a first input of a target control in the first area, and determining a first control function corresponding to the target control;
and updating the display content in the first display screen according to the first control function.
After a first track corresponding to the sliding input is displayed in a second area of the first display screen, a target virtual control can be determined according to an end point of the first track, a control corresponding to the target virtual control on a first area of the second display screen serves as the target control, first input of a first user to the target control in the first area is received, a first control function corresponding to the target control is determined according to the first input executed by the first user, and then display content in the first display screen is updated according to the determined first control function.
Optionally, according to different display contents in the first display screen, the corresponding controls in the second display screen are also different, and correspondingly, the control functions corresponding to the controls are also different. If the display content in the first display screen is video content, the first control function corresponding to the target control in the second display screen may be any one of the following functions: controlling the video content to fast forward or fast backward, playing the next video content, selecting the video content, exiting the currently played video content, adjusting the resolution, adjusting the volume and the like.
If the target virtual control corresponding to the end point of the first track is the volume increase control, determining that the function corresponding to the volume increase control is increasing the volume of the current video according to the first input executed by the user on the volume increase control, and increasing the volume of the video played in the first display screen according to the determined volume increase function to update the volume corresponding to the display content. When the volume is updated, the preset value can be increased according to the volume control volume which is clicked once by a user to increase the volume control. According to the process, a target control can be determined on the second display screen by a first user watching the first display screen according to the virtual control mapped to the first display screen and the motion track of the finger, and then the display content of the electronic equipment in operation is updated, so that the user can determine the corresponding control in the second display screen on the basis of not watching the second display screen, the user does not need to move the electronic equipment, the operation of the user is reduced, and the VR experience of the user is improved.
Optionally, in an embodiment of the present invention, in response to the first input, updating the display content of the first display screen includes:
determining a second control function corresponding to the first input according to a pre-established corresponding relation between the input operation and the control function; and updating the display content in the first display screen according to the second control function.
Optionally, the electronic device may count the control functions included in the various display contents for different types of display contents on the first display screen, and then establish a correspondence between the control functions included in the display contents and the input operation for each type of display contents, and may also display the established correspondence. When the corresponding relation is displayed, the corresponding relation can be displayed on the second display screen, and the corresponding relation can also be displayed on the first display screen in a prompt window mode. By displaying the established corresponding relation, the user does not need to memorize, and the use experience of the user is ensured.
Optionally, the pre-established correspondence between the input operation and the control function may be a default, or may be set by a user, and may be determined specifically according to an actual situation.
When the display content is output by the first display screen, the electronic equipment identifies the category to which the display content belongs, then displays the first corresponding relation associated with the current category, when a user needs to execute operation to update the display content of the first display screen, the electronic equipment can execute first input according to the displayed first corresponding relation, searches the second control function in the first corresponding relation according to the first input, and updates the display content in the first display screen according to the second control function. Where the first input includes, but is not limited to, a single click, a double click, a swipe, etc.
Taking the display content in the first display screen as the video content as an example for brief explanation, when the user performs the left-sliding operation on the second display screen, it is determined that the function corresponding to the left-sliding operation is fast-forwarding according to the pre-established correspondence, and the display content in the first display screen is updated according to the video content played in the first display screen which is fast-forwarded according to the determined function. Wherein the fast forward can be stopped when the user's left slide stops.
The user in this embodiment may be a first user or a second user, after the corresponding relationship is displayed on the second display screen, the first user may ask for help from the second user, and the second user executes the first input according to the corresponding relationship, so that the second user executes the operation to update the display content in the first display screen, and the VR experience of the first user can be improved. After the corresponding relationship is displayed on the first display screen, the first user may search for a first input corresponding to the second control function, and then execute the first input to update the display content in the first display screen.
In the process, the corresponding relation between the control function contained in the display content and the input operation is respectively established and displayed aiming at the display content of each category, after the user executes the first input according to the corresponding relation, the display content in the first display screen is updated according to the second control function corresponding to the first input, the display content of the first display screen is controlled by the second display screen by utilizing the corresponding relation, the user does not need to operate under the condition of watching the second display screen, and the operation experience of the user in the VR mode is improved.
Optionally, in an embodiment of the present invention, the updating the display content of the first display screen in response to the first input, where the first input is a first gesture, includes:
determining a third control function corresponding to the first gesture according to a pre-established corresponding relation between the gesture and the control function; and updating the display content in the first display screen according to the third control function.
The electronic device can count the control functions contained in various display contents respectively according to the display contents of different categories on the first display screen, then establish the corresponding relation between the control functions contained in the display contents and the gestures according to the display contents, and can display the established corresponding relation. When the corresponding relation is displayed, the corresponding relation can be displayed on the second display screen, and the corresponding relation can also be displayed on the first display screen in a prompt window mode. By displaying the established corresponding relation, the user does not need to memorize, and the use experience of the user is ensured.
When the display content is output by the first display screen, the electronic equipment identifies the category to which the display content belongs, then displays the second corresponding relation associated with the current category, and when the user needs to execute operation and update the display content of the first display screen, the first gesture can be executed according to the displayed second corresponding relation. The first gesture may be a gesture executed above a preset distance from the second display screen, and the camera of the second display screen may perform gesture collection in an open state.
And the electronic equipment searches for a third control function in the second corresponding relation according to the first gesture, and updates the display content in the first display screen according to the third control function. The first gesture here can be clicking, sliding, any finger up and down operation, etc., and the clicking, double clicking, different sliding tracks, different actions of different fingers can all correspond to different control functions.
The user in this embodiment may be a first user or a second user, after the corresponding relationship is displayed on the second display screen, the first user may ask the second user for help, and the second user executes the first gesture according to the corresponding relationship, so that the second user executes an operation to update the display content in the first display screen, and the VR experience of the first user can be improved. After the corresponding relationship is displayed on the first display screen, the first user may search for a first gesture corresponding to the third control function, and then execute the first gesture to update the display content in the first display screen.
According to the process, the corresponding relation between the control function contained in the display content and the gesture is established and displayed aiming at the display content of each category, after the user executes the first gesture according to the corresponding relation, the display content in the first display screen is updated according to the third control function corresponding to the first gesture, the display content of the first display screen can be controlled through gesture operation by utilizing the corresponding relation, the display content of the first display screen is not required to be updated through the operation of the second display screen by the user, and the operation experience of the user in the VR mode is improved.
Optionally, in an embodiment of the present invention, an infrared sensor may be disposed in the camera on the second display screen, and configured to monitor whether people exist around the electronic device, and if it is monitored that people exist around the electronic device, the camera may be controlled to be turned on, and the camera may also be turned on by the user in a conventional manner. The camera on the second display screen is opened in an automatic or manual mode, so that the user can use experience while information collection is facilitated, and the use basis is guaranteed to be provided for information use in the subsequent process.
After the camera on the second display screen is started, the first image information collected by the camera can be displayed on the second display screen in a split screen mode with the content on the second display screen, and the first image information can also be displayed in a suspended window mode. The content collected by the camera can be mapped to the first display screen to be displayed, so that the first user can conveniently acquire the information collected by the camera, the first image information collected by the camera can be displayed on the first display screen through the suspension window, and as shown in fig. 5, the first image information collected by the camera is displayed on the upper right corner of the first display screen. The first image information collected by the camera is displayed on the first display screen, so that the first user can sense the surrounding environment conveniently.
Optionally, when the first face is acquired through the camera on the second display screen and displayed on the first display screen through the floating window, it may be further verified whether the user corresponding to the first face is an authorized user, where the verification may be automatically verified by the electronic device, for example, whether the first face exists in the authorized face is detected, and the verification may also be verified by the first user. And if the verification is passed, determining that the user corresponding to the first face is an authorized second user, and receiving an operation performed on the electronic device by the second user. When an unauthorized user performs an operation on the electronic device, the electronic device does not respond to the operation.
By setting the authorized user, when the first user has family or friends, the personnel at the side can be required to perform operation to update the display content of the first display screen, so that the first user can request the other side to help the other side to control the electronic equipment.
It should be noted that, when the first user wears the VR device to perform VR experience, the whole vision is in a closed state due to the wearing of the device and the requirements of the VR experience. At this time, a second user at the side can dynamically interact with the user through the second display screen. If the second user can increase and weaken the VR effect according to the reaction of the user to the video, interaction with an experiencer is achieved, and then the VR experience effect is improved.
According to the control method provided by the embodiment of the invention, the auxiliary characteristic of the second display screen is utilized in the VR mode, the video content displayed in the first display screen is updated according to the input of the user to the second display screen, the operation steps of the user in the VR experience can be reduced, the utilization rate of the auxiliary screen is improved, and the VR experience of the user is improved.
By mapping the first area of the second display screen to the first display screen, the first user can conveniently control the electronic equipment through the operation control to update the display content in the first display screen; through defining preset operation or gesture and control function's corresponding relation, according to user's first input or first gesture update display content, can further promote user's VR experience, gather the perception that the user can be convenient for authorize the user to electronic equipment through the camera, the first user of being convenient for simultaneously is to the perception of surrounding environment.
An embodiment of the present invention provides an electronic device, where the electronic device includes a first display screen and a second display screen, and as shown in fig. 6, the electronic device further includes:
a first receiving module 10, configured to receive a first input of a user to a second display screen when the first display screen outputs display content in a virtual reality VR mode;
and the updating module 20 is used for responding to the first input and updating the display content of the first display screen.
Optionally, the electronic device further includes:
the second receiving module is used for receiving a second input of the user to the first area of the second display screen before the first receiving module receives the first input of the user to the second display screen;
the determining module is used for responding to a second input and determining a second area on the first display screen, wherein the second area is an area of the first area mapped on the first display screen and comprises a virtual control with the same function as the control in the first area;
the third receiving module is used for receiving sliding input of a user in the first area;
and the display module is used for responding to the sliding input and displaying the first track corresponding to the sliding input in the second area.
Optionally, the update module includes:
the first determining submodule is used for determining a target virtual control corresponding to the end point of the first track as a target control in the first area;
the second determining submodule is used for responding to the first input of the target control in the first area and determining a first control function corresponding to the target control;
and the first updating submodule is used for updating the display content in the first display screen according to the first control function.
Optionally, the update module includes:
the third determining submodule is used for determining a second control function corresponding to the first input according to the corresponding relation between the input operation and the control function established in advance;
and the second updating submodule is used for updating the display content in the first display screen according to the second control function.
Optionally, the first input is a first gesture, and the updating module includes:
the fourth determining submodule is used for determining a third control function corresponding to the first gesture according to the corresponding relation between the pre-established gesture and the control function;
and the third updating submodule is used for updating the display content in the first display screen according to the third control function.
According to the electronic equipment provided by the embodiment of the invention, under the VR mode, the auxiliary characteristic of the second display screen is utilized, the video content displayed in the first display screen is updated according to the input of the user to the second display screen, the operation steps of the user in the VR experience can be reduced, the utilization rate of the auxiliary screen is improved, and the VR experience of the user is improved.
By mapping the first area of the second display screen to the first display screen, the first user can conveniently control the electronic equipment through the operation control to update the display content in the first display screen; by defining the corresponding relation between the preset operation or the gesture and the control function and updating the display content according to the first input or the first gesture of the user, the VR experience of the user can be further improved.
Fig. 7 is a schematic diagram of a hardware structure of an electronic device 700 for implementing various embodiments of the present invention, where the electronic device 700 includes but is not limited to: a radio frequency unit 701, a network module 702, an audio output unit 703, an input unit 704, a sensor 705, a display unit 706, a user input unit 707, an interface unit 708, a memory 709, a processor 710, a power supply 711, and the like. The electronic device 700 also includes a first display screen and a second display screen.
Those skilled in the art will appreciate that the electronic device configuration shown in fig. 7 does not constitute a limitation of the electronic device, and that the electronic device may include more or fewer components than shown, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.
The user input unit 707 is configured to receive a first input to the second display screen from a user when the first display screen outputs display content in the virtual reality VR mode; the processor 710 is configured to control the display unit 706 to update the display content of the first display screen in response to the first input.
Optionally, before receiving the first input of the user to the second display screen, the user input unit 707 is further configured to: receiving a second input of the user to the first area of the second display screen; processor 710 is further configured to: in response to a second input, determining a second area on the first display screen, wherein the second area is an area of the first display screen mapped by the first area, and the second area comprises a virtual control with the same function as the control in the first area; the user input unit 707 is also used to: receiving a sliding input of a user in a first area; processor 710 is further configured to: in response to the slide input, the display unit 706 is controlled to display the first trajectory corresponding to the slide input in the second area.
Optionally, when the display content of the first display screen is updated in response to the first input, the processor 710 is further configured to: determining a target virtual control corresponding to the end point of the first track as a target control in the first area; responding to a first input of a target control in the first area, and determining a first control function corresponding to the target control; according to the first control function, the display unit 706 is controlled to update the display content within the first display screen.
Optionally, when the display content of the first display screen is updated in response to the first input, the processor 710 is further configured to: determining a second control function corresponding to the first input according to a pre-established corresponding relation between the input operation and the control function; according to the second control function, the display unit 706 is controlled to update the display content within the first display screen.
Optionally, the first input is a first gesture, and when the display content of the first display screen is updated in response to the first input, the processor 710 is further configured to: determining a third control function corresponding to the first gesture according to a pre-established corresponding relation between the gesture and the control function; according to the third control function, the display unit 706 is controlled to update the display content within the first display screen.
Therefore, the auxiliary characteristic of the second display screen is utilized in the VR mode, the video content displayed in the first display screen is updated according to the input of the user to the second display screen, the operation steps of the user in the VR experience can be reduced, the utilization rate of the auxiliary screen is improved, and the VR experience of the user is improved.
By mapping the first area of the second display screen to the first display screen, the first user can conveniently control the electronic equipment through the operation control to update the display content in the first display screen; by defining the corresponding relation between the preset operation or the gesture and the control function and updating the display content according to the first input or the first gesture of the user, the VR experience of the user can be further improved.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 701 may be used for receiving and sending signals during a message transmission and reception process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 710; in addition, the uplink data is transmitted to the base station. In general, radio frequency unit 701 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 701 may also communicate with a network and other devices through a wireless communication system.
The electronic device provides wireless broadband internet access to the user via the network module 702, such as assisting the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.
The audio output unit 703 may convert audio data received by the radio frequency unit 701 or the network module 702 or stored in the memory 709 into an audio signal and output as sound. Also, the audio output unit 703 may also provide audio output related to a specific function performed by the electronic apparatus 700 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 703 includes a speaker, a buzzer, a receiver, and the like.
The input unit 704 is used to receive audio or video signals. The input Unit 704 may include a Graphics Processing Unit (GPU) 7041 and a microphone 7042, and the Graphics processor 7041 processes image data of a still picture or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 706. The image frames processed by the graphic processor 7041 may be stored in the memory 709 (or other storage medium) or transmitted via the radio unit 701 or the network module 702. The microphone 7042 may receive sounds and may be capable of processing such sounds into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 701 in case of a phone call mode.
The electronic device 700 also includes at least one sensor 705, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 7061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 7061 and/or a backlight when the electronic device 700 is moved to the ear. As one type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of an electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 705 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.
The display unit 706 is used to display information input by the user or information provided to the user. The Display unit 706 may include a Display panel 7061, and the Display panel 7061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 707 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device. Specifically, the user input unit 707 includes a touch panel 7071 and other input devices 7072. The touch panel 7071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 7071 (e.g., operations by a user on or near the touch panel 7071 using a finger, a stylus, or any other suitable object or attachment). The touch panel 7071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 710, receives a command from the processor 710, and executes the command. In addition, the touch panel 7071 can be implemented by various types such as resistive, capacitive, infrared, and surface acoustic wave. The user input unit 707 may include other input devices 7072 in addition to the touch panel 7071. In particular, the other input devices 7072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described herein again.
Further, the touch panel 7071 may be overlaid on the display panel 7061, and when the touch panel 7071 detects a touch operation on or near the touch panel 7071, the touch operation is transmitted to the processor 710 to determine the type of the touch event, and then the processor 710 provides a corresponding visual output on the display panel 7061 according to the type of the touch event. Although the touch panel 7071 and the display panel 7061 are shown in fig. 7 as two separate components to implement the input and output functions of the electronic device, in some embodiments, the touch panel 7071 and the display panel 7061 may be integrated to implement the input and output functions of the electronic device, which is not limited herein.
The interface unit 708 is an interface for connecting an external device to the electronic apparatus 700. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 708 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic apparatus 700 or may be used to transmit data between the electronic apparatus 700 and the external device.
The memory 709 may be used to store software programs as well as various data. The memory 709 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 709 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 710 is a control center of the electronic device, connects various parts of the whole electronic device by using various interfaces and lines, performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 709 and calling data stored in the memory 709, thereby monitoring the whole electronic device. Processor 710 may include one or more processing units; preferably, the processor 710 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 710.
The electronic device 700 may also include a power supply 711 (e.g., a battery) for providing power to the various components, and preferably, the power supply 711 may be logically coupled to the processor 710 via a power management system, such that functions of managing charging, discharging, and power consumption may be performed via the power management system.
In addition, the electronic device 700 includes some functional modules that are not shown, and are not described in detail herein.
Preferably, an embodiment of the present invention further provides an electronic device, which includes a processor 710, a memory 709, and a computer program stored in the memory 709 and capable of running on the processor 710, where the computer program is executed by the processor 710 to implement the processes of the control method embodiment, and can achieve the same technical effects, and details are not repeated here to avoid repetition.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the control method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (12)
1. A control method is applied to an electronic device, the electronic device comprises a first display screen and a second display screen, and the method is characterized by comprising the following steps:
receiving a first input of a user to the second display screen under the condition that the first display screen outputs display content in a Virtual Reality (VR) mode;
updating display content of the first display screen in response to the first input.
2. The method of claim 1, wherein prior to receiving the first input from the user to the second display screen, further comprising:
receiving a second input of a user to the first area of the second display screen;
in response to the second input, determining a second area on the first display screen, wherein the second area is an area of the first display screen mapped by the first area, and the second area comprises a virtual control with the same function as the control in the first area;
receiving a sliding input of a user in the first area;
in response to the sliding input, displaying a first track corresponding to the sliding input in the second area.
3. The method of claim 2, wherein updating the display content of the first display screen in response to the first input comprises:
determining a target virtual control corresponding to the end point of the first track as a target control in the first area;
responding to a first input of the target control in the first area, and determining a first control function corresponding to the target control;
and updating the display content in the first display screen according to the first control function.
4. The method of claim 1, wherein updating the display content of the first display screen in response to the first input comprises:
determining a second control function corresponding to the first input according to a pre-established corresponding relation between input operation and control function;
and updating the display content in the first display screen according to the second control function.
5. The method of claim 1, wherein the first input is a first gesture, and wherein updating the display content of the first display screen in response to the first input comprises:
determining a third control function corresponding to the first gesture according to a pre-established corresponding relation between the gesture and the control function;
and updating the display content in the first display screen according to the third control function.
6. An electronic device comprising a first display screen and a second display screen, the electronic device comprising:
the first receiving module is used for receiving a first input of a user to the second display screen under the condition that the first display screen outputs display contents in a Virtual Reality (VR) mode;
and the updating module is used for responding to the first input and updating the display content of the first display screen.
7. The electronic device of claim 6, further comprising:
the second receiving module is used for receiving a second input of the user to the first area of the second display screen before the first receiving module receives the first input of the user to the second display screen;
a determining module, configured to determine, in response to the second input, a second area on the first display screen, where the second area is an area of the first display screen mapped to the first area, and the second area includes a virtual control having a same function as a control in the first area;
the third receiving module is used for receiving sliding input of a user in the first area;
and the display module is used for responding to the sliding input and displaying the first track corresponding to the sliding input in the second area.
8. The electronic device of claim 7, wherein the update module comprises:
the first determining submodule is used for determining a target virtual control corresponding to the end point of the first track as a target control in the first area;
the second determining submodule is used for responding to the first input of the target control in the first area and determining a first control function corresponding to the target control;
and the first updating submodule is used for updating the display content in the first display screen according to the first control function.
9. The electronic device of claim 6, wherein the update module comprises:
the third determining submodule is used for determining a second control function corresponding to the first input according to the corresponding relation between the input operation and the control function established in advance;
and the second updating submodule is used for updating the display content in the first display screen according to the second control function.
10. The electronic device of claim 6, wherein the first input is a first gesture, and wherein the update module comprises:
the fourth determining submodule is used for determining a third control function corresponding to the first gesture according to the corresponding relation between the pre-established gesture and the control function;
and the third updating submodule is used for updating the display content in the first display screen according to the third control function.
11. An electronic device, comprising a processor, a memory and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the control method according to any one of claims 1 to 5.
12. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, carries out the steps of the control method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010111057.4A CN111340962B (en) | 2020-02-24 | 2020-02-24 | Control method, electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010111057.4A CN111340962B (en) | 2020-02-24 | 2020-02-24 | Control method, electronic device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111340962A true CN111340962A (en) | 2020-06-26 |
| CN111340962B CN111340962B (en) | 2023-08-15 |
Family
ID=71181751
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010111057.4A Active CN111340962B (en) | 2020-02-24 | 2020-02-24 | Control method, electronic device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111340962B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105867609A (en) * | 2015-12-28 | 2016-08-17 | 乐视移动智能信息技术（北京）有限公司 | Method and device for watching video based on virtual reality helmet |
| CN106095235A (en) * | 2016-06-07 | 2016-11-09 | 腾讯科技（深圳）有限公司 | Control method based on virtual reality and device |
| CN106708412A (en) * | 2017-01-17 | 2017-05-24 | 亿航智能设备（广州）有限公司 | Method and device for controlling intelligent terminals |
| US20170230640A1 (en) * | 2016-02-05 | 2017-08-10 | Samsung Electronics Co., Ltd. | Portable image device with external display |
| CN107209568A (en) * | 2015-01-21 | 2017-09-26 | 谷歌公司 | Phone control and presence in virtual reality |
| CN107635057A (en) * | 2017-07-31 | 2018-01-26 | 努比亚技术有限公司 | A kind of virtual reality terminal control method, terminal and computer-readable recording medium |
| US20180088663A1 (en) * | 2016-09-29 | 2018-03-29 | Alibaba Group Holding Limited | Method and system for gesture-based interactions |
| CN109144176A (en) * | 2018-07-20 | 2019-01-04 | 努比亚技术有限公司 | Display screen interactive display method, terminal and storage medium in virtual reality |
| CN109144378A (en) * | 2017-06-19 | 2019-01-04 | 中兴通讯股份有限公司 | Data interactive method, device, helmet and control equipment |
| CN110069190A (en) * | 2018-01-24 | 2019-07-30 | 苹果公司 | Equipment, method and the graphic user interface of system-level behavior for 3D model |
| CN110325953A (en) * | 2017-02-23 | 2019-10-11 | 三星电子株式会社 | Screen control method and equipment for virtual reality service |
-
2020
- 2020-02-24 CN CN202010111057.4A patent/CN111340962B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107209568A (en) * | 2015-01-21 | 2017-09-26 | 谷歌公司 | Phone control and presence in virtual reality |
| CN105867609A (en) * | 2015-12-28 | 2016-08-17 | 乐视移动智能信息技术（北京）有限公司 | Method and device for watching video based on virtual reality helmet |
| US20170230640A1 (en) * | 2016-02-05 | 2017-08-10 | Samsung Electronics Co., Ltd. | Portable image device with external display |
| CN106095235A (en) * | 2016-06-07 | 2016-11-09 | 腾讯科技（深圳）有限公司 | Control method based on virtual reality and device |
| US20180088663A1 (en) * | 2016-09-29 | 2018-03-29 | Alibaba Group Holding Limited | Method and system for gesture-based interactions |
| CN106708412A (en) * | 2017-01-17 | 2017-05-24 | 亿航智能设备（广州）有限公司 | Method and device for controlling intelligent terminals |
| CN110325953A (en) * | 2017-02-23 | 2019-10-11 | 三星电子株式会社 | Screen control method and equipment for virtual reality service |
| CN109144378A (en) * | 2017-06-19 | 2019-01-04 | 中兴通讯股份有限公司 | Data interactive method, device, helmet and control equipment |
| CN107635057A (en) * | 2017-07-31 | 2018-01-26 | 努比亚技术有限公司 | A kind of virtual reality terminal control method, terminal and computer-readable recording medium |
| CN110069190A (en) * | 2018-01-24 | 2019-07-30 | 苹果公司 | Equipment, method and the graphic user interface of system-level behavior for 3D model |
| CN109144176A (en) * | 2018-07-20 | 2019-01-04 | 努比亚技术有限公司 | Display screen interactive display method, terminal and storage medium in virtual reality |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111340962B (en) | 2023-08-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107943551B (en) | Screen display method and mobile terminal | |
| CN108182019B (en) | Suspension control display processing method and mobile terminal | |
| CN109407921B (en) | Application processing method and terminal device | |
| CN108628515B (en) | Multimedia content operation method and mobile terminal | |
| CN110174993B (en) | Display control method, terminal equipment and computer readable storage medium | |
| CN109710349B (en) | Screen capturing method and mobile terminal | |
| CN110970003A (en) | Screen brightness adjusting method and device, electronic equipment and storage medium | |
| CN110209313B (en) | Icon moving method and terminal equipment | |
| CN111026484A (en) | Application sharing method, first electronic device and computer-readable storage medium | |
| CN108900695B (en) | Display processing method, terminal equipment and computer readable storage medium | |
| CN107843993B (en) | Control method for visual angle of display screen, mobile terminal and computer storage medium | |
| CN109558046B (en) | Information display method and terminal equipment | |
| CN109407949B (en) | Display control method and terminal | |
| CN111045344A (en) | Control method of household equipment and electronic equipment | |
| CN108958593B (en) | Method for determining communication object and mobile terminal | |
| WO2021129732A1 (en) | Display processing method and electronic device | |
| CN110825295B (en) | Application program control method and electronic equipment | |
| CN110221795B (en) | Screen recording method and terminal | |
| JP7229365B2 (en) | Authority management method and terminal equipment | |
| CN110764675A (en) | Control method and electronic equipment | |
| CN110866465A (en) | Control method of electronic equipment and electronic equipment | |
| CN110795402B (en) | Method and device for displaying file list and electronic equipment | |
| CN111367483A (en) | Interaction control method and electronic equipment | |
| CN109189514B (en) | Terminal device control method and terminal device | |
| CN111261128B (en) | Screen brightness adjusting method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |