WO2019014856A1

WO2019014856A1 - 3d stereoscopic display and interaction method and intelligent mobile terminal

Info

Publication number: WO2019014856A1
Application number: PCT/CN2017/093397
Authority: WO
Inventors: 朱小军
Original assignee: 朱小军
Priority date: 2017-07-18
Filing date: 2017-07-18
Publication date: 2019-01-24

Abstract

Disclosed are a 3D stereoscopic display and interaction method and an intelligent mobile terminal. The 3D stereoscopic display and interaction method is applied to a 3D display body, wherein the 3D display body comprises multiple display surfaces. The method comprises the following steps: S1: receiving a control signal input by a user; and S2: the 3D display body completing preset display according to the control signal. The control signal comprises a touch control signal, a non-touch control signal, a wireless control signal, a voice control signal and the like. The method can be used to display a human–machine interface in a 3D stereoscopic manner and to present multiple display interfaces at the same time; the user is able to perform non-touch operations and to realize operations such as rotation, zooming in and out, embedding, display by category and the like; different 3D display bodies can be used to meet personalization needs of users.

Description

Invention name: A 3D stereoscopic display interaction method and intelligent mobile terminal

[0001] The present invention relates to the field of human-computer interaction, and more particularly to a 3D stereoscopic display interaction method and an intelligent mobile terminal.

Background technique

[0002] In the field of traditional human-computer interaction, a two-dimensional display interface is used, and information is displayed in a two-dimensional interface, and the display content is single, and the display interface can only display one item. For example, each screen of a smartphone can only display a limited number of icons, and cannot display two screens or more at the same time. The user needs to slide left and right to switch the display interface; different functions of the application APP need to click different function icons or slide left and right to enter. It is not possible to display more than two screens at the same time. For example, the chat interface and the friend circle interface of WeChat can only display one. In addition, the display form is "background + icon", which is relatively simple. In order to pursue personalization, the user can only modify the background image, and the icon is also required to use the icon of the application APP, which cannot meet the personalized needs of the user.

[0003] The existing human-computer interaction operation has a single path, and generally can only be operated by a finger, and some functions can be realized by voice control. For example, a button device requires a user to input an operation command by a button; for a touch screen device, the user needs to manually touch the screen to generate an operation instruction. In some cases, if the user performs other operations, it is inconvenient to directly operate the screen by hand, which is inconvenient for the user to use the terminal.

technical problem

The technical problem to be solved by the present invention is to provide a 3D stereoscopic display interaction method and an intelligent mobile terminal according to the defects of the prior art that the display content is single, the form is single, and the operation path is single.

Problem solution

Technical solution

The technical solution adopted by the present invention to solve the technical problem is: constructing a 3D stereoscopic display interaction method, which is applied to a 3D display body, the 3D display body includes a plurality of display surfaces, and the method includes the following steps: 0006] S1: receiving a control signal input by a user;

[0007] S2: The 3D display body completes preset display according to the control signal.

[0008] Preferably, in the 3D stereoscopic display interaction method of the present invention, the control signal is a rotation signal, and the Step S2 includes: S21: the 3D display body is rotated according to a rotation direction specified by the rotation signal [0009] or

[0010] The control signal is a scaling signal, and the step S2 includes: S22: The 3D display body performs zoom display according to the zoom signal.

[0011] Preferably, in the 3D stereoscopic display interaction method of the present invention, the control signal is a snoring display signal, and the step S2 includes: S23: displaying the display object indicated by the snoring lower display signal Corresponding lower level 3D display body;

[0012] or

[0013] The control signal is to slap or close the APP signal, then the step S2 includes: S24: snoring or closing the snoring or closing the APP corresponding to the APP signal;

[0014] or

[0015] The control signal is a return to the preset level display signal, and the step S2 includes: S25: The 3D display body returns a 3D display body corresponding to the preset level display signal.

[0016] Preferably, in the 3D stereoscopic display interaction method of the present invention, the returning preset level display signal is a returning upper display signal, and the step S2 includes:

[0017] S26: The 3D display body returns an upper 3D display body corresponding to the current 3D display body.

[0018] Preferably, in the 3D stereoscopic display interaction method of the present invention, the APP is displayed in the form of the 3D display body, and each functional area of the APP is displayed on different display surfaces of the 3D display body;

[0019] or

[0020] The control signal is a search signal, and the step S2 includes: S27: classifying the search results, and displaying the classification results on different display surfaces of the 3D display body.

[0021] Preferably, the 3D stereoscopic display interaction method of the present invention, the control signal is at least one of a touch control signal, a non-touch control signal, a wireless control signal, and a voice control signal, where

[0022] the touch control signal is generated by a touch screen or a touch panel receiving a user's touch action;

[0023] the non-touch signal is generated by the image sensing module acquiring the action information of the user;

[0024] the wireless control signal is generated by an external controller;

[0025] The voice control signal is generated according to the received user voice. [0026] Preferably, the 3D stereoscopic display interaction method of the present invention, the external controller is a smart wearable device

[0027] The image sensing module is a camera, and the camera generates the non-touch control signal by capturing a gesture, an eye or a facial motion of a user.

[0028] Preferably, in the 3D stereoscopic display interaction method of the present invention, the non-touch signal is generated by the image sensing module to obtain the motion information of the user, and includes:

[0029] setting a plurality of screen hot zones on the display screen, and generating a wireless control signal for operating the screen hot zone when the eyes look at the hot zone of the screen exceeds a preset threshold time;

[0030] comparing the image sensing module to acquire an image adjacent frame to acquire the non-touch signal.

Preferably, the display object of the display surface includes: text, image, video, hyperlink, APP icon;

[0032] The 3D display body is a pseudoscopic 3D display body, and the APP icon is an integral part of the pseudo object 3D display body.

[0033] In addition, the present invention also provides an intelligent mobile terminal, where the smart mobile terminal includes a display and a memory.

Processor, where

[0034] the display is configured to display a 3D display body;

[0035] the memory is configured to store a program signal;

[0036] The processor is configured to execute the foregoing 3D stereoscopic display interaction method according to the program signal stored in the memory.

Advantageous effects of the invention

Beneficial effect

[0037] A 3D stereoscopic display interaction method and an intelligent mobile terminal embodying the present invention have the following beneficial effects: The 3D stereoscopic display interaction method is applied to a 3D display body, and the 3D display body includes a plurality of display surfaces, and the method includes the following steps: S1: Receive a control signal input by the user; S2: The 3D display body completes the preset display according to the control signal. The control signals include touch control signals, non-touch control signals, wireless control signals, voice control signals, and the like. By implementing the invention, the human-computer interaction interface is displayed in a 3D stereoscopic manner, and multiple display interfaces can be displayed simultaneously; the user can perform non-touch operations to realize operations such as rotation, scaling, nesting, and classification display, and the like. The 3D display body satisfies the individual needs of the user. Brief description of the drawing

DRAWINGS

The present invention will be further described with reference to the accompanying drawings and embodiments in which:

1 is a schematic flow chart of a 3D stereoscopic display interaction method according to the present invention;

2 is a schematic structural view of a 3D display body of the present invention as a cube; [0040] FIG.

3 is a schematic structural view of a 3D display body of the present invention as a sphere;

[0042] FIG. 4 to FIG. 10 are schematic diagrams showing the flow of different control signals of the present invention;

11 is a schematic structural view of a hot zone setting of a display screen of the present invention.

BEST MODE FOR CARRYING OUT THE INVENTION

[0044] In order to more clearly understand the technical features, objects and effects of the present invention, the embodiments of the present invention are described in detail with reference to the accompanying drawings.

1 is a schematic flow chart of a 3D stereoscopic display interaction method according to the present invention.

[0046] Specifically, the 3D stereoscopic display interaction method is applied to a 3D display body, and the 3D display body is controlled to perform various displays according to the control signal. The 3D stereoscopic display interaction method can be applied to the smart terminal, and the 3D display body is displayed on the display of the smart terminal, and the smart terminal is provided with a device for receiving the control signal. The smart terminal includes but is not limited to: a smart phone, a smart watch, a tablet computer, etc., and the programming language used by the smart terminal includes but is not limited to: Android, C language, C++, Objective-C, Linux, etc., as long as the 3D provided by the present invention can be completed. The stereo display interaction method can be used.

[0047] The 3D stereoscopic display interaction method comprises the following steps:

[0048] S1: receiving a control signal input by a user.

[0049] Specifically, the control signal includes, but is not limited to, a touch control signal, a non-touch control signal, a wireless control signal, a voice control signal, and the like, where

[0050] The touch control signal is generated by the touch screen or the touch panel receiving a user's touch action. The touchpad can be set on the body of the smart terminal, or disposed outside the smart terminal, and connected to the smart terminal by wire or wirelessly.

[0051] The non-touch signal is generated by the image sensing module acquiring the motion information of the user. As shown in FIG. 11, FIG. 11 is a schematic structural view of a hot zone setting of the display screen of the present invention. Setting a plurality of screen hot zones on the display screen, this embodiment In the screen, the screen is divided into nine screen hot zones: the screen hot zone 1-9, when the eyes look at the hot zone of the screen exceeds the preset threshold time, a wireless control signal for operating the hot zone of the screen is generated, for example, the user stares If the screen hot zone 5 is seen for more than two seconds, a wireless control signal corresponding to the hot zone 5 of the screen is generated; if the preset threshold is not reached, indicating that the user is viewing the screen normally, no wireless control signal is generated to prevent false triggering. .

[0052] Preferably, the image sensing module is a camera, and the camera generates a non-touch control signal by capturing a gesture, an eye or a facial motion of the user. For example, the comparable image sensing module acquires adjacent frames of the image to determine the type of motion of the user, and generates a corresponding control signal according to the type of motion to obtain a non-touch signal; such as blinking, turning the eyeball, smiling, shaking the head, nodding, closing the lips, etc. . It can be understood that the correspondence between the action type and the control signal needs to be stored in the memory of the smart terminal in advance.

[0053] The wireless control signal is generated by an external controller; the external controller is a smart wearable device, such as a smart ring, a smart watch, or the like. The external controller connects to the smart terminal through wireless means such as Bluetooth or WIFI.

[0054] The voice control signal is generated according to the received user voice, and the smart terminal is provided with a microphone for receiving the user voice.

[0055] S2: The 3D display body completes the preset display according to the control signal.

[0056] The 3D display body includes a plurality of display surfaces, wherein the plurality of display surfaces are at least one, such as a sphere, that is, a continuous curved surface; the two surfaces may be a combination of a curved surface and a flat surface; A combination of two surfaces of different curvatures. The 3D display body may be a tetrahedron, a hexahedron, a polyhedron, a sphere, a hemisphere, etc.; preferably, the 3D display body is a pseudoscopic 3D display body, such as a stereo cartoon image, an animal, a plant, a car, a home appliance, a furniture, etc. The 3D display body is a three-dimensional object, which can complete the preset display according to the input control signal.

[0057] Each display surface of the 3D display body can display various display objects, including but not limited to: text, image, video, hyperlink, APP icon, etc., which cannot be exhaustively enumerated here, can be existing The display object displayed on the plane can be displayed on the display surface of the 3D display. Preferably, when the 3D display body is a pseudoscopic 3D display body, the APP icon can be used as an integral part of the pseudoscopic 3D display body. For example, if the 3D display body is a car, one of the wheels of the car can be set as an icon of the Alipay APP, and the other wheel is an icon of the WeChat APP. To meet the user's personalization and security requirements, the wheel does not Display the original icon style of Alipay APP or WeChat APP, so that when the smart terminal is used by others, it cannot be easily Find the location of the APP, and also meet the user's personalized needs, making the interactive interface more realistic.

[0058] Alternatively, the display screen of the smart terminal may include two or more 3D display bodies at the same time.

[0059] Description will now be made of the two 3D display bodies in FIGS. 2 and 3.

2 is a schematic structural view of a 3D display body of the present invention in a cubic shape.

[0061] Specifically, the smart terminal in FIG. 2 includes a touch display screen, and the 3D display body is a cube. As can be seen from FIG. 2, the cube has six display surfaces, and each display surface can display different contents, and can The same display shows three display surfaces, which can display more content at the same time. The cube can be rotated in different directions depending on the control signal.

[0062] Alternatively, the display screen of the smart terminal may include two or more cubes at the same time.

3 is a schematic structural view of a 3D display body of the present invention as a sphere.

[0064] Specifically, the smart terminal in FIG. 3 includes a touch display screen, and the 3D display body is a sphere. As can be seen from FIG. 3, the sphere is a complete display surface, and the sphere is controlled to rotate in any direction by a control signal.

[0065] Alternatively, the display screen of the smart terminal may include two or more spheres at the same time.

4 to FIG. 10 are schematic diagrams showing the flow of different control signals of the present invention.

[0067] As shown in FIG. 4, the control signal is a rotation signal, then

[0068] Step S1 includes: S11: receiving a rotation signal input by a user; preferably, the rotation signal is a continuous rotation signal, and the 3D display body continuously rotates according to a rotation direction and a rotation rate obtained by the continuous rotation signal until the display content ends or receives To stop the rotation signal.

[0069] Step S2 includes: S21: The 3D display body rotates according to a rotation direction specified by the rotation signal. The 3D display body of the present application can perform rotation in any direction, and the amplitude and rate of rotation are determined according to the rotation signal. For example, the rotation signal is obtained by the user sliding the touch screen, and the direction, speed, length, etc. of the sliding operation can be detected to obtain 3D. Displays the direction of rotation, the rate of rotation, and the extent of rotation. Preferably, the rotation rate and the rotation amplitude of the rotation signal can be preset.

[0070] As shown in FIG. 5, the control signal is a scaling signal, then

[0071] Step S1 includes: S12: receiving a zoom signal input by a user; the zoom signal includes a zoom-out signal and a zoom-in signal, wherein the zoom-out signal is used to reduce the display of the 3D display body; and the zoom-in signal is used to display the 3D display body in an enlarged manner. For example, a zoom signal may be generated by detecting a change in the distance between two contacts of the touch screen, and if the distance between the two contacts becomes smaller, a reduction signal is generated; if the distance between the two contacts becomes larger, an amplified signal is generated. [0072] Step S2 includes: S22: The 3D display body performs zoom display according to the zoom signal. When the amplified signal is received, the 3D display body is displayed in an enlarged manner; when the reduced signal is received, the 3D display body is displayed in a reduced size. The scale of the enlargement or reduction display is determined based on the zoom signal, for example, by detecting the distance at which the two contacts change, the ratio of enlargement or reduction is determined.

[0073] As shown in FIG. 6, the control signal is a lower display signal,

[0074] Step S1 includes: S13: receiving a snoring lower level display signal input by the user; in the function setting 吋, usually including a multi-level menu display, the lower level menu needs to be viewed, and the lower level display signal can be input.

[0075] Step S2 includes: S23: displaying a lower-level 3D display body corresponding to the display object indicated by the lower-level display signal; and correspondingly selecting a correspondence relationship between the lower-level display signal and the lower-level menu.

[0076] As shown in FIG. 7, the control signal is snoring or closing the APP signal, Bay 1J

[0077] Step S1 includes: S14: receiving a snoring or closing APP signal input by the user; clicking or closing the APP signal may be generated by a click of the touch screen, or generated by a wireless signal. The close APP signal can also be generated by a button or touch key set by the smart terminal.

[0078] Step S2 includes: S24: Doping or closing the snoring or closing the APP corresponding to the APP signal.

[0079] Preferably, the APP is displayed in the form of a 3D display body, that is, each APP is a 3D display body, and the 3D display bodies corresponding to each A PP may be the same or different, thereby satisfying the user and the software provider's personality. Demand. Further, for the 3D display body APP, each functional area is displayed on different display surfaces of the 3D display body, and the user switches the display surface by rotating the 3D display body to realize function switching; preferably, the preset display surface can be set, each time playing幵APP吋, the default display surface is displayed, and the preset display surface can be one or more. For example, APP is WeChat, WeChat includes: chat, contacts, friends circle, other functions, WeChat for cube, then the different faces of the cube are set to: chat, contacts, friends circle, other functions, users can rotate the cube Switch function. Further, setting the WeChat friend circle and the chat interface to the preset display surface, each time the WeChat is played, the friend circle and the chat interface are displayed simultaneously.

[0080] As shown in FIG. 8, the control signal is returned to the preset level display signal, then

[0081] Step S1 includes: S15: Receive a return preset level display signal input by the user.

[0082] Step S2 includes: S25: The 3D display body returns a 3D display body corresponding to the preset level display signal. It is necessary to preset to return the correspondence between the preset level display signal and the display level, for example, it can be set to return to the previous level. , return to two levels, return to three levels, or return to the initial level.

[0083] As shown in FIG. 9, when the preset level display signal is returned to return to the upper display signal,

[0084] Step S1 includes: S16: receiving a returning superior display signal input by the user;

[0085] Step S2 includes: S26: The 3D display body returns the upper 3D display body corresponding to the current 3D display body.

[0086] As shown in FIG. 10, the control signal is a search signal, then

[0087] Step S1 includes: S17: receiving a search signal input by a user; the search signal includes a search object, and after completing the search, obtaining a search result.

[0088] Step S2 includes: S27: classifying the search results, and displaying the classification results on different display surfaces of the 3D display body. For example, searching for a celebrity's data, the search results include: text, pictures, videos, etc., the 3D display body of this is a cube, then the search results are displayed in the form of a cube, and according to the classification of the search results, the difference in the cube The display surface displays text, pictures, and videos, respectively, so that users can read them. Further, in general, the search result content is too large to be displayed on one display surface. In this case, the search result can be displayed on a screen by rotating the 3D display body, and the search result is preloaded on the display surface to be displayed, and the rotation is continuously rotated. Achieve continuous reading of search content. Or, continuously display the search results by switching the display content on a single display surface.

[0089] Further, for convenience of viewing, a certain display of the 3D display body may be converted into a two-dimensional plane display, preferably, displayed on the entire screen. For example, after watching a video, if the user wants to watch in full screen, the video display surface of the 3D display body can be expanded to cover the entire screen display.

[0090]

[0091] In addition, the present invention further provides an intelligent mobile terminal, where the smart mobile terminal includes a display, a memory, and a processor, where

[0092] a display for displaying a 3D display body;

[0093] a memory, configured to store a program signal;

[0094] The processor is configured to execute the foregoing 3D stereoscopic display interaction method according to the program signal stored in the memory.

[0095] By implementing the invention, the human-computer interaction interface is displayed in a 3D stereoscopic manner, and multiple display interfaces can be displayed simultaneously; the user can perform non-touch operations to implement operations such as rotation, scaling, nesting, and classification display.

Different 3D display bodies meet the individual needs of users.

The above embodiments are only for explaining the technical idea and features of the present invention, and the purpose thereof is to make the technology familiar with the technology. A person skilled in the art can understand the contents of the present invention and implement it accordingly, and does not limit the scope of protection of the present invention. Equivalent changes and modifications made within the scope of the claims of the present invention should fall within the scope of the appended claims.

Claims

Claim

A 3D stereoscopic display interaction method, which is applied to a 3D display body, the 3D display body includes a plurality of display surfaces, and the method includes the following steps:

S1: receiving a control signal input by a user;

S2: The 3D display body completes the preset display according to the control signal.

The 3D stereoscopic display interaction method according to claim 1, wherein the control signal is a rotation signal, and the step S2 comprises: S21: the 3D display body rotates according to a rotation direction specified by the rotation signal ;

Or

The control signal is a scaling signal, and the step S2 includes: S22: The 3D display body performs zoom display according to the zoom signal.

The 3D stereoscopic display interaction method according to claim 1, wherein the control signal is a snoring display signal, and the step S2 comprises: S23: displaying the display object indicated by the snoring lower display signal Corresponding lower level 3D display body;

Or

If the control signal is snoring or closing the APP signal, the step S2 includes: S24: snaking or closing the snoring or closing the APP corresponding to the APP signal;

Or

The step S2 includes: returning to the preset level display signal, the step S2 includes: S25: the 3D display body returns a 3D display body corresponding to the preset level display signal.

The 3D stereoscopic display interaction method according to claim 3, wherein the returning the preset level display signal is returning the upper display signal, and the step S2 comprises:

S26: The 3D display body returns an upper 3D display body corresponding to the current 3D display body.

The 3D stereoscopic display interaction method according to claim 3, wherein the APP is displayed in the form of the 3D display body, and each functional area of the APP is displayed on a different display surface of the 3D display body;

Or

The control signal is a search signal, and the step S2 includes: S27: entering the search result The line classification displays the classification results on different display surfaces of the 3D display body.

The 3D stereoscopic display interaction method according to claim 1, wherein the control signal is at least one of a touch control signal, a non-touch control signal, a wireless control signal, and a voice control signal, where

The touch control signal is generated by the touch screen or the touch panel receiving the user's touch action; the non-touch signal is generated by the image sensing module acquiring the user's motion information; and the wireless control signal is generated by an external controller;

The voice control signal is generated based on the received user voice.

The 3D stereoscopic display interaction method according to claim 6, wherein the external controller is a smart wearable device;

The image sensing module is a camera that generates the non-touch control signal by capturing a user's gesture, eye or facial motion.

The 3D stereoscopic display interaction method according to claim 6, wherein the non-touch signal is generated by the image sensing module to acquire motion information of the user, including:

Setting a plurality of screen hot zones on the display screen, when the eyes look at the hot zone of the screen exceeds a preset threshold time, generating a wireless control signal for operating the hot zone of the screen; comparing the image sensing module Obtaining an image adjacent frame, acquiring the non-touch signal.

The 3D stereoscopic display interaction method according to claim 1, wherein the display object of the display surface comprises: a text, an image, a video, a hyperlink, an APP icon; and the 3D display body is a pseudoscopic 3D display body. The APP icon is an integral part of the pseudo 3D display body.

An intelligent mobile terminal, comprising: a display, a memory, and a processor, wherein

The display is configured to display a 3D display body;

The memory is configured to store a program signal;

The processor is configured to perform the 3D stereoscopic display interaction method according to any one of claims 1 to 9 according to the program signal stored in the memory.