WO2019014856A1 - Procédé d'affichage et d'interaction stéréoscopique 3d et terminal mobile intelligent - Google Patents

Procédé d'affichage et d'interaction stéréoscopique 3d et terminal mobile intelligent Download PDF

Info

Publication number
WO2019014856A1
WO2019014856A1 PCT/CN2017/093397 CN2017093397W WO2019014856A1 WO 2019014856 A1 WO2019014856 A1 WO 2019014856A1 CN 2017093397 W CN2017093397 W CN 2017093397W WO 2019014856 A1 WO2019014856 A1 WO 2019014856A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
signal
control signal
display body
interaction method
Prior art date
Application number
PCT/CN2017/093397
Other languages
English (en)
Chinese (zh)
Inventor
朱小军
Original Assignee
朱小军
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 朱小军 filed Critical 朱小军
Priority to PCT/CN2017/093397 priority Critical patent/WO2019014856A1/fr
Publication of WO2019014856A1 publication Critical patent/WO2019014856A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]

Definitions

  • the present invention relates to the field of human-computer interaction, and more particularly to a 3D stereoscopic display interaction method and an intelligent mobile terminal.
  • a two-dimensional display interface In the field of traditional human-computer interaction, a two-dimensional display interface is used, and information is displayed in a two-dimensional interface, and the display content is single, and the display interface can only display one item.
  • each screen of a smartphone can only display a limited number of icons, and cannot display two screens or more at the same time.
  • the user needs to slide left and right to switch the display interface; different functions of the application APP need to click different function icons or slide left and right to enter. It is not possible to display more than two screens at the same time.
  • the chat interface and the friend circle interface of WeChat can only display one.
  • the display form is "background + icon", which is relatively simple. In order to pursue personalization, the user can only modify the background image, and the icon is also required to use the icon of the application APP, which cannot meet the personalized needs of the user.
  • the existing human-computer interaction operation has a single path, and generally can only be operated by a finger, and some functions can be realized by voice control.
  • a button device requires a user to input an operation command by a button; for a touch screen device, the user needs to manually touch the screen to generate an operation instruction.
  • the technical problem to be solved by the present invention is to provide a 3D stereoscopic display interaction method and an intelligent mobile terminal according to the defects of the prior art that the display content is single, the form is single, and the operation path is single.
  • the technical solution adopted by the present invention to solve the technical problem is: constructing a 3D stereoscopic display interaction method, which is applied to a 3D display body, the 3D display body includes a plurality of display surfaces, and the method includes the following steps: 0006] S1: receiving a control signal input by a user;
  • S2 The 3D display body completes preset display according to the control signal.
  • the control signal is a rotation signal
  • the Step S2 includes: S21: the 3D display body is rotated according to a rotation direction specified by the rotation signal [0009] or
  • the control signal is a scaling signal
  • the step S2 includes: S22: The 3D display body performs zoom display according to the zoom signal.
  • the control signal is a snoring display signal
  • the step S2 includes: S23: displaying the display object indicated by the snoring lower display signal Corresponding lower level 3D display body;
  • the control signal is to slap or close the APP signal, then the step S2 includes: S24: snoring or closing the snoring or closing the APP corresponding to the APP signal;
  • the control signal is a return to the preset level display signal
  • the step S2 includes: S25: The 3D display body returns a 3D display body corresponding to the preset level display signal.
  • the returning preset level display signal is a returning upper display signal
  • the step S2 includes:
  • S26 The 3D display body returns an upper 3D display body corresponding to the current 3D display body.
  • the APP is displayed in the form of the 3D display body, and each functional area of the APP is displayed on different display surfaces of the 3D display body;
  • the control signal is a search signal
  • the step S2 includes: S27: classifying the search results, and displaying the classification results on different display surfaces of the 3D display body.
  • the control signal is at least one of a touch control signal, a non-touch control signal, a wireless control signal, and a voice control signal, where
  • the touch control signal is generated by a touch screen or a touch panel receiving a user's touch action
  • the non-touch signal is generated by the image sensing module acquiring the action information of the user
  • the wireless control signal is generated by an external controller
  • the voice control signal is generated according to the received user voice.
  • the external controller is a smart wearable device
  • the image sensing module is a camera, and the camera generates the non-touch control signal by capturing a gesture, an eye or a facial motion of a user.
  • the non-touch signal is generated by the image sensing module to obtain the motion information of the user, and includes:
  • the display object of the display surface includes: text, image, video, hyperlink, APP icon;
  • the 3D display body is a pseudoscopic 3D display body, and the APP icon is an integral part of the pseudo object 3D display body.
  • the present invention also provides an intelligent mobile terminal, where the smart mobile terminal includes a display and a memory.
  • the display is configured to display a 3D display body
  • the memory is configured to store a program signal
  • the processor is configured to execute the foregoing 3D stereoscopic display interaction method according to the program signal stored in the memory.
  • a 3D stereoscopic display interaction method and an intelligent mobile terminal embodying the present invention have the following beneficial effects:
  • the 3D stereoscopic display interaction method is applied to a 3D display body, and the 3D display body includes a plurality of display surfaces, and the method includes the following steps: S1: Receive a control signal input by the user; S2: The 3D display body completes the preset display according to the control signal.
  • the control signals include touch control signals, non-touch control signals, wireless control signals, voice control signals, and the like.
  • the human-computer interaction interface is displayed in a 3D stereoscopic manner, and multiple display interfaces can be displayed simultaneously; the user can perform non-touch operations to realize operations such as rotation, scaling, nesting, and classification display, and the like.
  • the 3D display body satisfies the individual needs of the user. Brief description of the drawing
  • FIG. 1 is a schematic flow chart of a 3D stereoscopic display interaction method according to the present invention.
  • FIG. 2 is a schematic structural view of a 3D display body of the present invention as a cube; [0040] FIG.
  • 3 is a schematic structural view of a 3D display body of the present invention as a sphere
  • FIG. 4 to FIG. 10 are schematic diagrams showing the flow of different control signals of the present invention.
  • FIG. 11 is a schematic structural view of a hot zone setting of a display screen of the present invention.
  • FIG. 1 is a schematic flow chart of a 3D stereoscopic display interaction method according to the present invention.
  • the 3D stereoscopic display interaction method is applied to a 3D display body, and the 3D display body is controlled to perform various displays according to the control signal.
  • the 3D stereoscopic display interaction method can be applied to the smart terminal, and the 3D display body is displayed on the display of the smart terminal, and the smart terminal is provided with a device for receiving the control signal.
  • the smart terminal includes but is not limited to: a smart phone, a smart watch, a tablet computer, etc.
  • the programming language used by the smart terminal includes but is not limited to: Android, C language, C++, Objective-C, Linux, etc., as long as the 3D provided by the present invention can be completed.
  • the stereo display interaction method can be used.
  • the 3D stereoscopic display interaction method comprises the following steps:
  • S1 receiving a control signal input by a user.
  • control signal includes, but is not limited to, a touch control signal, a non-touch control signal, a wireless control signal, a voice control signal, and the like, where
  • the touch control signal is generated by the touch screen or the touch panel receiving a user's touch action.
  • the touchpad can be set on the body of the smart terminal, or disposed outside the smart terminal, and connected to the smart terminal by wire or wirelessly.
  • FIG. 11 is a schematic structural view of a hot zone setting of the display screen of the present invention. Setting a plurality of screen hot zones on the display screen, this embodiment In the screen, the screen is divided into nine screen hot zones: the screen hot zone 1-9, when the eyes look at the hot zone of the screen exceeds the preset threshold time, a wireless control signal for operating the hot zone of the screen is generated, for example, the user stares If the screen hot zone 5 is seen for more than two seconds, a wireless control signal corresponding to the hot zone 5 of the screen is generated; if the preset threshold is not reached, indicating that the user is viewing the screen normally, no wireless control signal is generated to prevent false triggering. .
  • the image sensing module is a camera, and the camera generates a non-touch control signal by capturing a gesture, an eye or a facial motion of the user.
  • the comparable image sensing module acquires adjacent frames of the image to determine the type of motion of the user, and generates a corresponding control signal according to the type of motion to obtain a non-touch signal; such as blinking, turning the eyeball, smiling, shaking the head, nodding, closing the lips, etc. .
  • a non-touch signal such as blinking, turning the eyeball, smiling, shaking the head, nodding, closing the lips, etc.
  • the wireless control signal is generated by an external controller; the external controller is a smart wearable device, such as a smart ring, a smart watch, or the like.
  • the external controller connects to the smart terminal through wireless means such as Bluetooth or WIFI.
  • the voice control signal is generated according to the received user voice, and the smart terminal is provided with a microphone for receiving the user voice.
  • S2 The 3D display body completes the preset display according to the control signal.
  • the 3D display body includes a plurality of display surfaces, wherein the plurality of display surfaces are at least one, such as a sphere, that is, a continuous curved surface; the two surfaces may be a combination of a curved surface and a flat surface; A combination of two surfaces of different curvatures.
  • the 3D display body may be a tetrahedron, a hexahedron, a polyhedron, a sphere, a hemisphere, etc.; preferably, the 3D display body is a pseudoscopic 3D display body, such as a stereo cartoon image, an animal, a plant, a car, a home appliance, a furniture, etc.
  • the 3D display body is a three-dimensional object, which can complete the preset display according to the input control signal.
  • Each display surface of the 3D display body can display various display objects, including but not limited to: text, image, video, hyperlink, APP icon, etc., which cannot be exhaustively enumerated here, can be existing
  • the display object displayed on the plane can be displayed on the display surface of the 3D display.
  • the APP icon can be used as an integral part of the pseudoscopic 3D display body.
  • the 3D display body is a car
  • one of the wheels of the car can be set as an icon of the Alipay APP
  • the other wheel is an icon of the WeChat APP.
  • the wheel does not Display the original icon style of Alipay APP or WeChat APP, so that when the smart terminal is used by others, it cannot be easily Find the location of the APP, and also meet the user's personalized needs, making the interactive interface more realistic.
  • the display screen of the smart terminal may include two or more 3D display bodies at the same time.
  • FIG. 2 is a schematic structural view of a 3D display body of the present invention in a cubic shape.
  • the smart terminal in FIG. 2 includes a touch display screen, and the 3D display body is a cube.
  • the cube has six display surfaces, and each display surface can display different contents, and can The same display shows three display surfaces, which can display more content at the same time.
  • the cube can be rotated in different directions depending on the control signal.
  • the display screen of the smart terminal may include two or more cubes at the same time.
  • 3 is a schematic structural view of a 3D display body of the present invention as a sphere.
  • the smart terminal in FIG. 3 includes a touch display screen, and the 3D display body is a sphere.
  • the sphere is a complete display surface, and the sphere is controlled to rotate in any direction by a control signal.
  • the display screen of the smart terminal may include two or more spheres at the same time.
  • FIG. 4 to FIG. 10 are schematic diagrams showing the flow of different control signals of the present invention.
  • control signal is a rotation signal
  • Step S1 includes: S11: receiving a rotation signal input by a user; preferably, the rotation signal is a continuous rotation signal, and the 3D display body continuously rotates according to a rotation direction and a rotation rate obtained by the continuous rotation signal until the display content ends or receives To stop the rotation signal.
  • Step S2 includes: S21: The 3D display body rotates according to a rotation direction specified by the rotation signal.
  • the 3D display body of the present application can perform rotation in any direction, and the amplitude and rate of rotation are determined according to the rotation signal.
  • the rotation signal is obtained by the user sliding the touch screen, and the direction, speed, length, etc. of the sliding operation can be detected to obtain 3D. Displays the direction of rotation, the rate of rotation, and the extent of rotation.
  • the rotation rate and the rotation amplitude of the rotation signal can be preset.
  • control signal is a scaling signal
  • Step S1 includes: S12: receiving a zoom signal input by a user; the zoom signal includes a zoom-out signal and a zoom-in signal, wherein the zoom-out signal is used to reduce the display of the 3D display body; and the zoom-in signal is used to display the 3D display body in an enlarged manner.
  • a zoom signal may be generated by detecting a change in the distance between two contacts of the touch screen, and if the distance between the two contacts becomes smaller, a reduction signal is generated; if the distance between the two contacts becomes larger, an amplified signal is generated.
  • Step S2 includes: S22: The 3D display body performs zoom display according to the zoom signal.
  • the 3D display body When the amplified signal is received, the 3D display body is displayed in an enlarged manner; when the reduced signal is received, the 3D display body is displayed in a reduced size.
  • the scale of the enlargement or reduction display is determined based on the zoom signal, for example, by detecting the distance at which the two contacts change, the ratio of enlargement or reduction is determined.
  • control signal is a lower display signal
  • Step S1 includes: S13: receiving a snoring lower level display signal input by the user; in the function setting ⁇ , usually including a multi-level menu display, the lower level menu needs to be viewed, and the lower level display signal can be input.
  • Step S2 includes: S23: displaying a lower-level 3D display body corresponding to the display object indicated by the lower-level display signal; and correspondingly selecting a correspondence relationship between the lower-level display signal and the lower-level menu.
  • control signal is snoring or closing the APP signal, Bay 1J
  • Step S1 includes: S14: receiving a snoring or closing APP signal input by the user; clicking or closing the APP signal may be generated by a click of the touch screen, or generated by a wireless signal.
  • the close APP signal can also be generated by a button or touch key set by the smart terminal.
  • Step S2 includes: S24: Doping or closing the snoring or closing the APP corresponding to the APP signal.
  • the APP is displayed in the form of a 3D display body, that is, each APP is a 3D display body, and the 3D display bodies corresponding to each A PP may be the same or different, thereby satisfying the user and the software provider's personality. Demand.
  • each functional area is displayed on different display surfaces of the 3D display body, and the user switches the display surface by rotating the 3D display body to realize function switching; preferably, the preset display surface can be set, each time playing ⁇ APP ⁇ , the default display surface is displayed, and the preset display surface can be one or more.
  • APP is WeChat
  • WeChat includes: chat, contacts, friends circle, other functions, WeChat for cube
  • the different faces of the cube are set to: chat, contacts, friends circle, other functions
  • users can rotate the cube Switch function.
  • setting the WeChat friend circle and the chat interface to the preset display surface, each time the WeChat is played, the friend circle and the chat interface are displayed simultaneously.
  • control signal is returned to the preset level display signal, then
  • Step S1 includes: S15: Receive a return preset level display signal input by the user.
  • Step S2 includes: S25: The 3D display body returns a 3D display body corresponding to the preset level display signal. It is necessary to preset to return the correspondence between the preset level display signal and the display level, for example, it can be set to return to the previous level. , return to two levels, return to three levels, or return to the initial level.
  • Step S1 includes: S16: receiving a returning superior display signal input by the user;
  • Step S2 includes: S26: The 3D display body returns the upper 3D display body corresponding to the current 3D display body.
  • control signal is a search signal
  • Step S1 includes: S17: receiving a search signal input by a user; the search signal includes a search object, and after completing the search, obtaining a search result.
  • Step S2 includes: S27: classifying the search results, and displaying the classification results on different display surfaces of the 3D display body.
  • the search results include: text, pictures, videos, etc.
  • the 3D display body of this is a cube
  • the search results are displayed in the form of a cube, and according to the classification of the search results, the difference in the cube
  • the display surface displays text, pictures, and videos, respectively, so that users can read them.
  • the search result content is too large to be displayed on one display surface.
  • the search result can be displayed on a screen by rotating the 3D display body, and the search result is preloaded on the display surface to be displayed, and the rotation is continuously rotated. Achieve continuous reading of search content. Or, continuously display the search results by switching the display content on a single display surface.
  • a certain display of the 3D display body may be converted into a two-dimensional plane display, preferably, displayed on the entire screen.
  • the video display surface of the 3D display body can be expanded to cover the entire screen display.
  • the present invention further provides an intelligent mobile terminal, where the smart mobile terminal includes a display, a memory, and a processor, where
  • a memory configured to store a program signal
  • the processor is configured to execute the foregoing 3D stereoscopic display interaction method according to the program signal stored in the memory.
  • the human-computer interaction interface is displayed in a 3D stereoscopic manner, and multiple display interfaces can be displayed simultaneously; the user can perform non-touch operations to implement operations such as rotation, scaling, nesting, and classification display.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention concerne un procédé d'affichage et d'interaction stéréoscopique 3D et un terminal mobile intelligent. Le procédé d'affichage et d'interaction stéréoscopique 3D est appliqué à un corps d'affichage 3D, le corps d'affichage 3D comprenant de multiples surfaces d'affichage. Le procédé comprend les étapes suivantes : S1 : la réception d'un signal de commande entré par un utilisateur ; et S2 : la réalisation, par le corps d'affichage 3D, d'un affichage prédéfini en fonction du signal de commande. Le signal de commande comprend un signal de commande tactile, un signal de commande non tactile, un signal de commande sans fil, un signal de commande vocale et similaire. Le procédé peut être utilisé pour afficher une interface homme-machine d'une manière stéréoscopique 3D et pour présenter de multiples interfaces d'affichage simultanément ; l'utilisateur peut effectuer des opérations non tactiles et réaliser des opérations telles que la rotation, le zoom avant et arrière, l'incorporation, l'affichage par catégorie et similaire ; différents corps d'affichage 3D peuvent être utilisés pour satisfaire les besoins de personnalisation des utilisateurs.
PCT/CN2017/093397 2017-07-18 2017-07-18 Procédé d'affichage et d'interaction stéréoscopique 3d et terminal mobile intelligent WO2019014856A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/093397 WO2019014856A1 (fr) 2017-07-18 2017-07-18 Procédé d'affichage et d'interaction stéréoscopique 3d et terminal mobile intelligent

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/093397 WO2019014856A1 (fr) 2017-07-18 2017-07-18 Procédé d'affichage et d'interaction stéréoscopique 3d et terminal mobile intelligent

Publications (1)

Publication Number Publication Date
WO2019014856A1 true WO2019014856A1 (fr) 2019-01-24

Family

ID=65014897

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/093397 WO2019014856A1 (fr) 2017-07-18 2017-07-18 Procédé d'affichage et d'interaction stéréoscopique 3d et terminal mobile intelligent

Country Status (1)

Country Link
WO (1) WO2019014856A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101957719A (zh) * 2009-07-14 2011-01-26 Lg电子株式会社 移动终端及其显示控制方法
CN102385476A (zh) * 2010-08-31 2012-03-21 Lg电子株式会社 移动终端及其控制方法
CN102646021A (zh) * 2012-03-27 2012-08-22 厦门九纬信息技术有限公司 一种手机实现3d功能菜单的方法
CN106325652A (zh) * 2015-06-19 2017-01-11 深圳创锐思科技有限公司 图形用户界面交互方法及触摸终端

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101957719A (zh) * 2009-07-14 2011-01-26 Lg电子株式会社 移动终端及其显示控制方法
CN102385476A (zh) * 2010-08-31 2012-03-21 Lg电子株式会社 移动终端及其控制方法
CN102646021A (zh) * 2012-03-27 2012-08-22 厦门九纬信息技术有限公司 一种手机实现3d功能菜单的方法
CN106325652A (zh) * 2015-06-19 2017-01-11 深圳创锐思科技有限公司 图形用户界面交互方法及触摸终端

Similar Documents

Publication Publication Date Title
US11153431B2 (en) Mobile terminal and method of operating the same
US10416789B2 (en) Automatic selection of a wireless connectivity protocol for an input device
KR102270766B1 (ko) 크리에이티브 카메라
US9360965B2 (en) Combined touch input and offset non-touch gesture
US11483673B2 (en) Method of wirelessly connecting devices, and device thereof
CN107589884A (zh) 一种3d立体显示交互方法及智能移动终端
US11170580B2 (en) Information processing device, information processing method, and recording medium
US9152226B2 (en) Input method designed for augmented reality goggles
US9880640B2 (en) Multi-dimensional interface
EP2593848B1 (fr) Procédé et système d'interaction avec une interface utilisateur projetée sur une surface
US20160370956A1 (en) Device, method, and graphical user interface for navigating media content
TWI552021B (zh) 使用三維操控命令手勢的運算系統
CN104571849A (zh) 可佩戴装置及其控制方法
KR102610120B1 (ko) Hmd 디바이스 및 그 제어 방법
KR20140133357A (ko) 디스플레이 장치 및 그 ui 화면 제공 방법
KR20150047006A (ko) 데이터 전송 방법, 데이터 수신 방법, 및 디바이스
US10474324B2 (en) Uninterruptable overlay on a display
KR20160078160A (ko) 사용자의 움직임을 검출하여 사용자 입력을 수신하는 방법 및 이를 위한 장치
CN105930071A (zh) 用于管理项目的方法和装置
KR20230168568A (ko) 정보 입력 방법 및 장치, 전자 기기 및 저장 매체
WO2019014856A1 (fr) Procédé d'affichage et d'interaction stéréoscopique 3d et terminal mobile intelligent
JP7289208B2 (ja) プログラム、情報処理装置、および方法
KR20170133755A (ko) 전자 디바이스 및 전자 디바이스를 위한 방법
Zhao et al. Augmenting mobile phone interaction with face-engaged gestures
KR20140102952A (ko) 스크린을 통해 표시되는 컨텐츠를 제어하는 방법 및 이를 위한 디스플레이 장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17918161

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 20.05.2020)

122 Ep: pct application non-entry in european phase

Ref document number: 17918161

Country of ref document: EP

Kind code of ref document: A1