CN107817894A - Display processing method and device - Google Patents

Display processing method and device Download PDF

Info

Publication number
CN107817894A
CN107817894A CN201610821120.7A CN201610821120A CN107817894A CN 107817894 A CN107817894 A CN 107817894A CN 201610821120 A CN201610821120 A CN 201610821120A CN 107817894 A CN107817894 A CN 107817894A
Authority
CN
China
Prior art keywords
content
equipment
terminal
displayed
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610821120.7A
Other languages
Chinese (zh)
Inventor
孙薇
赵冬晓
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201610821120.7A priority Critical patent/CN107817894A/en
Priority to PCT/CN2017/070886 priority patent/WO2018045699A1/en
Publication of CN107817894A publication Critical patent/CN107817894A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention discloses a kind of display processing method, including:When terminal adaptation is in VR virtual reality devices, the terminal judges whether the content to be displayed on its display screen can be identified by the VR equipment;When the content to be displayed can not be identified by the VR equipment, the layout structure of the content to be displayed is reconstructed into the layout structure that the VR equipment can identify by the terminal;The terminal is according to the layout structure after reconstruct in content to be displayed described in the display screen display.Invention additionally discloses a kind of display processing unit.The present invention, which realizes VR equipment, can recognize any type of display content on terminal display screen, user is not missed the contents such as incoming call or short message in the terminal again when using the VR equipment.

Description

Display processing method and device
Technical field
The present invention relates to technical field of virtual reality, more particularly to a kind of display processing method and device.
Background technology
Common VR (virtual reality) equipment, such as VR glasses, generally require with various terminals coordinate and could use, And needed in terminal after the application matched with used VR equipment and startup are installed, it could be interacted with the VR equipment.
, can only be to left and right split screen and (such as oval with the eyeglass same shape of VR glasses due to the VR equipment of similar VR glasses Shape) display layout interface on content be identified, thus, for the display content on terminal display screen, in its layout knot When structure meets that VR equipment identifies condition, user can view the display content in terminal by VR equipment, and in its layout knot When structure is unsatisfactory for VR equipment identification condition, user cannot view the display content in terminal by VR equipment.Such as terminal The 3 D video of upper broadcasting, be that VR glasses can recognize that, now, user by VR glasses with regard to the video can be watched, it is and right In the content such as the incoming call in terminal or short message, shown due to can not be identified by VR glasses, thus in terminal in incoming call or short message etc. Rong Shi, user can't see these contents using VR glasses, may will miss these incoming calls or short message, thus to user with Carry out certain trouble.
Thus, how terminal coordinate VR equipment in use, can be viewed by VR equipment on terminal display screen appoint The display content of one type, it is a technical problem for needing to solve at present.
The above is only used for auxiliary and understands technical scheme, does not represent and recognizes that the above is existing skill Art.
The content of the invention
The present invention provides a kind of display processing method and device, it is intended to solves to coordinate VR equipment in use, passing through in terminal VR equipment checks the technical problem less than certain types of display content on terminal display screen.
To achieve the above object, the present invention provides a kind of display processing method, and the display processing method includes:
When terminal adaptation is in VR virtual reality devices, the terminal judges that the content to be displayed on its display screen whether can It is enough to be identified by the VR equipment;
When the content to be displayed can not be identified by the VR equipment, the terminal is by the layout of the content to be displayed Structural remodeling is the layout structure that the VR equipment can identify;
The terminal is according to the layout structure after reconstruct in content to be displayed described in the display screen display.
Preferably, the display processing method also includes:
In the terminal according to the layout structure after reconstruct described in the display screen display during content to be displayed, when When the terminal detects the touch operation on the display screen, content to be displayed is updated according to the touch operation.
Preferably, when preset VR interaction switches are opened, the terminal determines that it is currently adapted in VR equipment;Institute Stating display processing method also includes:
The terminal detects by the sensor and/or camera that are arranged on and judges whether it currently adapts to VR In equipment, and when it is determined that it is currently adapted in VR equipment, the VR interactions switch is opened.
Preferably, when the terminal adaptation is in VR virtual reality devices, the terminal judges to wait to show on its display screen Showing whether content can be identified by the VR equipment includes:
When the terminal adaptation is in VR equipment, the terminal obtains the layout knot of the content to be displayed on its display screen Structure;
It is identical for the viewing area of the display screen is divided into left and right two in the layout structure of the content to be displayed During the viewing area of size and symmetrical designated shape, determine that the content to be displayed can be identified by the VR equipment;Wherein, It is completely overlapped after content translation in the viewing area of two designated shapes.
Preferably, described when the content to be displayed can not be identified by the VR equipment, the terminal is waited to show by described Show that the layout structure that the layout structure of content is reconstructed into the VR equipment and can identified includes:
When the content to be displayed can not be identified by the VR equipment, the terminal according to the layout structure got with And preset reordering rule, according to specified order rearrangement after each display items included in the layout structure are classified;
Display items after rearrangement are arranged respectively to the viewing area of described two designated shapes with identical layout, with The layout structure that can be identified to the VR equipment.
Preferably, the content to be displayed includes but is not limited to Types Below:
Incoming call, short message, webpage, video, picture, five application page.
To achieve the above object, the present invention also provides a kind of display processing unit, and the display processing unit includes:
Judge module, for when terminal adaptation is in VR virtual reality devices, judging to treat on the terminal display screen Whether display content can be identified by the VR equipment;
Reconstructed module, for when the content to be displayed can not be identified by the VR equipment, by the content to be displayed Layout structure be reconstructed into the layout structure that the VR equipment can identify;
Display module, for showing content to be displayed described in screen display described according to the layout structure after reconstruct.
Preferably, the display processing unit also includes:
Respond module, for the layout structure after according to reconstruct in the content to be displayed phase described in the display screen display Between, when detecting the touch operation on the display screen, content to be displayed is updated according to the touch operation.
Preferably, the display processing unit also includes:
Detection module, for the sensor and/or camera by being arranged in the terminal, detect and judge the end Whether end is currently adapted in VR equipment, and when it is determined that the terminal is currently adapted in VR equipment, opens the VR interactions Switch;
Determining module, for when preset VR interaction switches are opened, determining that the terminal currently adapts to VR equipment In.
Preferably, the judge module includes:
Acquiring unit, for when the terminal adaptation is in VR equipment, obtaining to be shown on the terminal display screen The layout structure of content;
Determining unit, for being to be divided into the viewing area of the display screen in the layout structure of the content to be displayed When the formed objects of left and right two and the viewing area of symmetrical designated shape, determine that the content to be displayed can be set by the VR Standby identification;Wherein, it is completely overlapped after the content translation in the viewing area of two designated shapes.
Preferably, the reconstructed module includes:
Rearrangement units, for when the content to be displayed can not be identified by the VR equipment, according to the layout got Structure and preset reordering rule, according to specified order after each display items included in the layout structure are classified Reset;
Dispensing unit, for the display items after rearrangement to be arranged respectively at into described two designated shapes with identical layout Viewing area, to obtain the layout structure that the VR equipment can identify.
Preferably, the content to be displayed includes but is not limited to Types Below:
Incoming call, short message, webpage, video, picture, five application page.
Display processing method and device proposed by the present invention, when terminal adaptation is in VR equipment, described in real-time judge eventually Whether the content to be displayed on the display screen of end can be identified by the VR equipment, when the content to be displayed can not be set by the VR During standby identification, the layout structure of the content to be displayed is reconstructed into the layout structure that the VR equipment can identify, with institute Terminal is stated according to the layout structure after reconstruct during content to be displayed described in the display screen display, user passes through the VR Equipment can view the content to be displayed, so that the VR equipment can recognize any on the terminal display screen The display content of type, and user will not also be missed in incoming call or short message in the terminal etc. again when using the VR equipment Hold.
Brief description of the drawings
Fig. 1 is the schematic flow sheet of display processing method first embodiment of the present invention;
Fig. 2 is the refinement schematic flow sheet of step S10 in Fig. 1;
Fig. 3 is the refinement schematic flow sheet of step S20 in Fig. 1;
Fig. 4 (a)-(b) is that front and rear layout structure schematic diagram is reconstructed in the present invention;
Fig. 5 is the layout structure schematic diagram of double arrangement after list reconstruct in the present invention;
Fig. 6 is the schematic flow sheet of display processing method second embodiment of the present invention;
Fig. 7 is the high-level schematic functional block diagram of display processing unit first embodiment of the present invention;
Fig. 8 is the high-level schematic functional block diagram of display processing unit second embodiment of the present invention;
Fig. 9 is the high-level schematic functional block diagram of display processing unit 3rd embodiment of the present invention.
The realization, functional characteristics and advantage of the object of the invention will be described further referring to the drawings in conjunction with the embodiments.
Embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
The present invention provides a kind of display processing method, as shown in figure 1, showing that display processing method of the present invention first is implemented The schematic flow sheet of example, the display processing method include:
When S10, terminal adaptation are in VR virtual reality devices, the terminal judges that the content to be displayed on its display screen is It is no to be identified by the VR equipment;
The display processing method can be implemented in terminal, and the VR equipment can be the equipment such as VR glasses, the terminal The equipment for the film source that can be watched for the VR equipment can be played to support, such as mobile phone, tablet personal computer etc..It is described to be shown interior Hold and include but is not limited to Types Below:Incoming call, short message, webpage, video, picture, five application page, can also be terminal display interface The other kinds of display content of upper display, will not enumerate herein.
Further, when preset VR interaction switches are opened, the terminal determines that it is currently adapted in VR equipment. The VR interactions switch is arranged in the terminal, and acquiescence is closed, and is made when the terminal needs to coordinate with the VR equipment Used time, after opening the VR interactions switch, the terminal can be adapted in the VR equipment.User can refer in the terminal VR interactions switch described in manual unlocking is put in positioning, can also be automatically opened up the VR interactions under given conditions by the terminal and be opened Close.As long as the VR interactions switch is in open mode, then the terminal is to think that it is in the field interacted with the VR equipment Scape, and the function with the scene matching is provided.The VR can be interacted switch manually and closed by user when without using the VR equipment Close, hereafter, the terminal recovers normal operation, and provides conventional func.
Further, reference picture 2, above-mentioned steps S10 include:
When S11, the terminal adaptation are in VR equipment, the terminal obtains the layout of the content to be displayed on its display screen Structure;
S12, the content to be displayed layout structure be by the viewing area of the display screen be divided into left and right two During the viewing area of formed objects and symmetrical designated shape, determine that the content to be displayed can be identified by the VR equipment; Wherein, it is completely overlapped after the content translation in the viewing area of two designated shapes.
The terminal will obtain in real time after it is determined that it currently adapts in the VR equipment from the display data of caching The layout structure (i.e. layout set) of content to be displayed on its display screen, wherein, layout structure includes to be shown each aobvious Aspect, such as text, picture, video, button, list, icon etc., and each display items viewing area on the display screen Display location.
Can only preferably be identified due to the VR equipment size of left and right two on the viewing area it is identical and symmetrical, Shape and the content of lens shape identical viewing area in the VR equipment, thus, in the layout knot of the content to be displayed Structure be by the viewing area of the display screen be divided into left and right two formed objects and symmetrical designated shape viewing area and , can when can be completely overlapped after content translation in the viewing area of two designated shapes (layout structure as shown in Fig. 4 (b)) Determine that the content to be displayed can be identified by the VR equipment, otherwise, then can not be identified by the VR equipment.Wherein, it is described Designated shape refers to oval or circular with lens shape identical shape in the VR equipment, common being shaped as.
If the content to be displayed can identify that the terminal exists according to original layout structure by the VR equipment The content to be displayed is directly shown on the display screen, now, user is described with regard to that can watch by the VR equipment Content to be displayed.And when the content to be displayed can not be identified by the VR equipment, user is by the VR equipment can not Watch the content to be displayed.
S20, when the content to be displayed can not be identified by the VR equipment, the terminal is by the content to be displayed Layout structure is reconstructed into the layout structure that the VR equipment can identify;
Further, reference picture 3, above-mentioned steps S20 include:
S21, when the content to be displayed can not be identified by the VR equipment, the terminal is according to the layout knot got Structure and preset reordering rule, according to specified order weight after each display items included in the layout structure are classified Row;
S22, the display items after rearrangement are laid out to the viewing area for being arranged respectively at described two designated shapes with identical, To obtain the layout structure that the VR equipment can identify.
When the content to be displayed can not be identified by the VR equipment, the terminal needs to show the content to be displayed Some layout structures are reconstructed, so that the layout structure obtained after reconstruct disclosure satisfy that the identification requirement of the VR equipment.
Specifically, the terminal is according to the layout structure got, each display items that will be included in the layout structure First classified according to preset reordering rule, such as text, picture, video etc. be divided into display class, by button, list, Icon etc. is divided into operable class etc.;Enter rearrangement according still further to specified ordering rule afterwards, for example, it is aobvious in same ellipse Show in region, each display items for showing class are arranged successively according to the order in former layout structure from top to bottom, from left to right The left side of the oval viewing area is arranged on after row, by each display items of operable class according in former layout structure from upper Order under, from left to right is arranged on the right side of the oval viewing area after being arranged in order, and makes as much as possible all The display items uniform fold oval viewing area, as shown in Figure 4;Finally, by each display items in the oval viewing area Interior layout sets and copies to another oval viewing area, so as to obtain the layout knot that can be identified by the VR equipment Structure.
It should be noted that when reconstructing layout structure, can be only by necessary display class display items, and guide user The operable class display items for carrying out next step operation enter rearrangement, and other non-essential display items are no longer set after reconstitution In layout structure, that is, no longer showing non-essential display items., can be by each height in list when being list for display items Item carries out double arrangement, as shown in Figure 5.
S30, the terminal are according to the layout structure after reconstruct in content to be displayed described in the display screen display.
It is described when needing to show the content to be displayed after obtaining the layout structure after the content to be displayed reconstruct Terminal shows content to be displayed described in screen display according to the layout structure after reconstruct described, due to according to the layout after reconstruct The content that structure is shown can identify by the VR equipment, described wait to show so that user can view by the VR equipment Show content.
Display processing method proposed by the present invention, when terminal adaptation is in VR equipment, terminal described in real-time judge is shown Whether the content to be displayed on screen can be identified by the VR equipment, when the content to be displayed can not be identified by the VR equipment When, the layout structure of the content to be displayed is reconstructed into the layout structure that the VR equipment can identify, with the terminal According to the layout structure after reconstruct during content to be displayed described in the display screen display, user passes through the VR equipment energy Enough view the content to be displayed so that the VR equipment can recognize it is any type of on the terminal display screen Display content, and user will not also miss the contents such as incoming call or the short message in the terminal again when using the VR equipment.
Further, display processing method second embodiment of the present invention is proposed based on above-mentioned first embodiment, in this implementation In example, reference picture 6, the display processing method also includes:
S40, the terminal according to the layout structure after reconstruct it is described display screen display described in the content to be displayed phase Between, when the terminal detects the touch operation on the display screen, content to be displayed is updated according to the touch operation.
During content to be displayed, used described in the display screen display according to the layout structure after reconstruct in the terminal Family can view each display items of the display screen display by the VR equipment, can if included in these display items The display items of operation, such as button, then after user is clicking on the display screen, the i.e. detectable institute of the terminal The touch operation on display screen is stated, afterwards, the terminal is carried out more according to the touch operation to the display content on display screen Newly.
Specifically, when original layout structure is reconstructed, it is necessary to each display in the layout structure after reconstruct Item distributes new tag number respectively, and these tag numbers are unique identifications for each display items, and needs after reconstructing Layout structure in the tag number of display items mapped one by one with the tag number of same display items in original layout structure.
In the terminal according to the layout structure after reconstruct described in the display screen display during content to be displayed, when After user clicks on the display items of some operable class on the display screen of the terminal, the terminal can get the display items The tag number in layout structure after reconstitution, and tag number of the display items in former layout structure is obtained by mapping, enter And trigger response events corresponding to the tag number that mapping obtains so that the terminal refreshes current display content or redirects page Face.
Display processing method proposed by the present invention, VR equipment can be made to recognize in the terminal that can not be identified originally shows Hold, and under conditions of user does not take out the terminal from the VR equipment, touch that can be to user in the terminal Correct response is made, while any display content that the terminal provides is missed without using family, institute is used for user State terminal and carry out operation and bring great convenience.
Further, display processing method 3rd embodiment of the present invention is proposed based on above-mentioned second embodiment, in this implementation In example, the display processing method also includes:
The terminal detects by the sensor and/or camera that are arranged on and judges whether it currently adapts to VR In equipment, and when it is determined that it is currently adapted in VR equipment, the VR interactions switch is opened.
It is understood that when the terminal judges that it is not placed in the VR equipment, then the VR is closed Interaction switch.In the present embodiment, the sensor being arranged in the terminal can be proximity transducer, gravity sensor, pressure One or more of sensor, the camera being arranged in the terminal can be front camera.
Exemplified by being provided with proximity transducer, gravity sensor, front camera in the terminal, when gravity sensor is examined When to measure the terminal be with respect to the horizontal plane endways be disposed vertically, the terminal opens proximity transducer, and when close to sensing Device detects that the distance of the terminal and the VR equipment is 0 and continues specified time and then open front camera, if The image that front camera collects is completely black, then it is assumed that the terminal has been placed in the VR equipment.
Exemplified by being provided with pressure sensor, gravity sensor in the terminal, when pressure sensor detects the end The frame surrounding at end has uniform pressure, and gravity sensor detects that the terminal is with respect to the horizontal plane endways is disposed vertically When, then it is assumed that the terminal has been placed in the VR equipment.
Display processing method proposed by the present invention, sensor and/or camera that can be by terminal by being arranged on, automatically Detect and judge whether it is currently adapted in VR equipment, when it is determined that it is currently adapted in VR equipment, to open the VR Interaction switch, manually open the VR interactions switch when needed without user, simplify user's operation, and it is more automatic Change, be intelligent.
The present invention also provides a kind of display processing unit, as shown in fig. 7, showing that display processing unit first of the present invention is real The high-level schematic functional block diagram of example is applied, the display processing unit includes:
Judge module 100, for when terminal adaptation is in VR virtual reality devices, judging on the terminal display screen Whether content to be displayed can be identified by the VR equipment;
Determining module 200, for when preset VR interaction switches are opened, determining that the terminal currently adapts to VR and set In standby.
The display processing unit is arranged in terminal, and the VR equipment can be the equipment such as VR glasses, and the terminal can The equipment for the film source that the VR equipment supports viewing can be played by thinking, such as mobile phone, tablet personal computer etc..The content to be displayed Including but not limited to Types Below:Incoming call, short message, webpage, video, picture, five application page, can also be in terminal display interface The other kinds of display content of display, will not enumerate herein.
The VR interactions switch is arranged in the terminal, and acquiescence is closed, when the terminal needs to set with the VR During for being used cooperatively, after opening the VR interactions switch, the terminal can be adapted in the VR equipment.User can be described VR interactions switch described in specified location manual unlocking, also can automatically open up the VR under given conditions by the terminal in terminal Interaction switch.As long as the VR interactions switch is in open mode, then the terminal thinks that it is in and VR equipment friendship Mutual scene, and the function with the scene matching is provided.User manually can interact the VR when without using the VR equipment Switch is closed, and hereafter, the terminal recovers normal operation, and provides conventional func.
Further, the judge module 100 includes:
Acquiring unit, for when the terminal adaptation is in VR equipment, obtaining to be shown on the terminal display screen The layout structure of content;
Determining unit, for being to be divided into the viewing area of the display screen in the layout structure of the content to be displayed When the formed objects of left and right two and the viewing area of symmetrical designated shape, determine that the content to be displayed can be set by the VR Standby identification;Wherein, it is completely overlapped after the content translation in the viewing area of two designated shapes.
The determining module 200 of the terminal is after it is determined that the terminal currently adapts in the VR equipment, judge module 100 acquiring unit by the layout structure of the content to be displayed obtained in real time from the display data of caching on its display screen (i.e. Layout is set), wherein, layout structure includes each display items to be shown, such as text, picture, video, button, list, figure Mark etc., and the display location of each display items viewing area on the display screen.
Can only preferably be identified due to the VR equipment size of left and right two on the viewing area it is identical and symmetrical, Shape and the content of lens shape identical viewing area in the VR equipment, thus, in the layout knot of the content to be displayed Structure be by the viewing area of the display screen be divided into left and right two formed objects and symmetrical designated shape viewing area and When can be completely overlapped after content translation in the viewing area of two designated shapes (layout structure as shown in Fig. 4 (b)), institute State determining unit and can determine that the content to be displayed can be identified by the VR equipment, otherwise, then can not be known by the VR equipment Not.Wherein, the designated shape refer to lens shape identical shape in the VR equipment, it is common be shaped as ellipse or It is circular.
If the content to be displayed can identify that the terminal exists according to original layout structure by the VR equipment The content to be displayed is directly shown on the display screen, now, user is described with regard to that can watch by the VR equipment Content to be displayed.And when the content to be displayed can not be identified by the VR equipment, user is by the VR equipment can not Watch the content to be displayed.
Reconstructed module 300, for when the content to be displayed can not be identified by the VR equipment, will it is described it is to be shown in The layout structure of appearance is reconstructed into the layout structure that the VR equipment can identify;
Further, the reconstructed module 300 includes:
Rearrangement units, for when the content to be displayed can not be identified by the VR equipment, according to the layout got Structure and preset reordering rule, according to specified order after each display items included in the layout structure are classified Reset;
Dispensing unit, for the display items after rearrangement to be arranged respectively at into described two designated shapes with identical layout Viewing area, to obtain the layout structure that the VR equipment can identify.
When the content to be displayed can not be identified by the VR equipment, the terminal needs to show the content to be displayed Some layout structures are reconstructed, so that the layout structure obtained after reconstruct disclosure satisfy that the identification requirement of the VR equipment.
Specifically, the reconstructed module 300 of the terminal is according to the layout structure got, as the rearrangement units by described in The each display items included in layout structure are first classified according to preset reordering rule, such as by text, picture, video etc. Display class is divided into, button, list, icon etc. are divided into operable class etc.;Carried out afterwards according still further to specified ordering rule Reset, such as in same oval viewing area, will show each display items of class according in former layout structure from upper Order under, from left to right is arranged on the left side of the oval viewing area after being arranged in order, by each aobvious of operable class Aspect is arranged on the oval viewing area after being arranged in order according to the order in former layout structure from top to bottom, from left to right Right side, and make all display items uniform folds oval viewing area as much as possible, as shown in Figure 4;Finally, by described Layout of each display items in the oval viewing area is set and copies to another oval viewing area by dispensing unit, So as to obtain the layout structure that can be identified by the VR equipment.
It should be noted that when reconstructing layout structure, the rearrangement units only can show class display items by necessary, And guide user to carry out the operable class display items of next step operation and enter rearrangement, and other non-essential display items are no longer set Put in layout structure after reconstitution, that is, no longer showing non-essential display items.It is described heavy when being list for display items Double arrangement can be carried out by each subitem in list by arranging unit, as shown in Figure 5.
Display module 400, for showing content to be displayed described in screen display described according to the layout structure after reconstruct.
It is described when needing to show the content to be displayed after obtaining the layout structure after the content to be displayed reconstruct The display module 400 of terminal according to the layout structure after reconstruct it is described display screen display described in content to be displayed, due to by It can be identified according to the content that the layout structure after reconstruct is shown by the VR equipment, so that user can by the VR equipment View the content to be displayed.
Display processing unit proposed by the present invention, when terminal adaptation is in VR equipment, terminal described in real-time judge is shown Whether the content to be displayed on screen can be identified by the VR equipment, when the content to be displayed can not be identified by the VR equipment When, the layout structure of the content to be displayed is reconstructed into the layout structure that the VR equipment can identify, with the terminal According to the layout structure after reconstruct during content to be displayed described in the display screen display, user passes through the VR equipment energy Enough view the content to be displayed so that the VR equipment can recognize it is any type of on the terminal display screen Display content, and user will not also miss the contents such as incoming call or the short message in the terminal again when using the VR equipment.
Further, propose that display processing unit second of the present invention is implemented based on above-mentioned display processing unit first embodiment Example, in the present embodiment, reference picture 8, the display processing unit also includes:
Respond module 500, for the layout structure after according to reconstruct to be shown interior described in the display screen display During appearance, when detecting the touch operation on the display screen, content to be displayed is updated according to the touch operation.
Wait to show described in the display screen display according to the layout structure after reconstruct in the display module 400 of the terminal During showing content, user can view each display items of the display screen display by the VR equipment, if these Exercisable display items, such as button are included in display items, then after user is clicking on the display screen, the end The respond module 500 at end is that can detect the touch operation on the display screen, afterwards, the respond module 500 of the terminal The display content on display screen is updated according to the touch operation.
Specifically, when original layout structure is reconstructed, it is necessary to each display in the layout structure after reconstruct Item distributes new tag number respectively, and these tag numbers are unique identifications for each display items, and needs after reconstructing Layout structure in the tag number of display items mapped one by one with the tag number of same display items in original layout structure.
Wait to show described in the display screen display according to the layout structure after reconstruct in the display module 400 of the terminal During showing content, after user is clicking on the display items of some operable class on the display screen of the terminal, the sound of the terminal Answer module 500 to get the tag number in the layout structure of the display items after reconstitution, and the display is obtained by mapping Tag number in Xiang Yuan layout structures, and then trigger response events corresponding to the tag number that mapping obtains so that the terminal Display module 400 refresh current display content or jump page.
Display processing unit proposed by the present invention, VR equipment can be made to recognize in the terminal that can not be identified originally shows Hold, and under conditions of user does not take out the terminal from the VR equipment, touch that can be to user in the terminal Correct response is made, while any display content that the terminal provides is missed without using family, institute is used for user State terminal and carry out operation and bring great convenience.
Further, propose that display processing unit the 3rd of the present invention is implemented based on above-mentioned display processing unit second embodiment Example, in the present embodiment, reference picture 9, the display processing unit also includes:
Detection module 600, for the sensor and/or camera by being arranged in the terminal, detect and judge institute State whether terminal is currently adapted in VR equipment, and when it is determined that the terminal is currently adapted in VR equipment, open the VR Interaction switch;
It is understood that when the detection module 600 of the terminal judges that the terminal is not placed on the VR and set When standby middle, then the VR interactions switch is closed.In the present embodiment, the sensor being arranged in the terminal can be close to sensing One or more of device, gravity sensor, pressure sensor, the camera being arranged in the terminal can be preposition shooting Head.
Exemplified by being provided with proximity transducer, gravity sensor, front camera in the terminal, when gravity sensor is examined When to measure the terminal be with respect to the horizontal plane endways be disposed vertically, the detection module 600 of the terminal opens proximity transducer, And when proximity transducer detects the distance of the terminal and the VR equipment for 0 and before continuing specified time and then opening Camera is put, if the image that front camera collects is completely black, the detection module 600 determines that the terminal is put Put in the VR equipment.
Exemplified by being provided with pressure sensor, gravity sensor in the terminal, when pressure sensor detects the end The frame surrounding at end has uniform pressure, and gravity sensor detects that the terminal is with respect to the horizontal plane endways is disposed vertically When, then the detection module 600 determines that the terminal has been placed in the VR equipment.
Display processing unit proposed by the present invention, sensor and/or camera that can be by terminal by being arranged on, automatically Detect and judge whether it is currently adapted in VR equipment, when it is determined that it is currently adapted in VR equipment, to open the VR Interaction switch, manually open the VR interactions switch when needed without user, simplify user's operation, and it is more automatic Change, be intelligent.
The preferred embodiments of the present invention are these are only, are not intended to limit the scope of the invention, it is every to utilize this hair The equivalent structure or equivalent flow conversion that bright specification and accompanying drawing content are made, or directly or indirectly it is used in other related skills Art field, is included within the scope of the present invention.

Claims (12)

1. a kind of display processing method, it is characterised in that the display processing method includes:
When terminal adaptation is in VR virtual reality devices, the terminal judges whether content to be displayed on its display screen can be by The VR equipment identification;
When the content to be displayed can not be identified by the VR equipment, the terminal is by the layout structure of the content to be displayed It is reconstructed into the layout structure that the VR equipment can identify;
The terminal is according to the layout structure after reconstruct in content to be displayed described in the display screen display.
2. display processing method as claimed in claim 1, it is characterised in that the display processing method also includes:
In the terminal according to the layout structure after reconstruct described in the display screen display during content to be displayed, when described When terminal detects the touch operation on the display screen, content to be displayed is updated according to the touch operation.
3. display processing method as claimed in claim 1 or 2, it is characterised in that when preset VR interaction switches are opened, The terminal determines that it is currently adapted in VR equipment;The display processing method also includes:
The terminal detects by the sensor and/or camera that are arranged on and judges whether it currently adapts to VR equipment In, and when it is determined that it is currently adapted in VR equipment, open the VR interactions switch.
4. display processing method as claimed in claim 1, it is characterised in that the terminal adaptation is in VR virtual reality devices When, the terminal, which judges whether the content to be displayed on its display screen can be identified by the VR equipment, to be included:
When the terminal adaptation is in VR equipment, the terminal obtains the layout structure of the content to be displayed on its display screen;
It is that the viewing area of the display screen is divided into two formed objects in left and right in the layout structure of the content to be displayed And during the viewing area of symmetrical designated shape, determine that the content to be displayed can be identified by the VR equipment;Wherein, two It is completely overlapped after content translation in the viewing area of designated shape.
5. display processing method as claimed in claim 4, it is characterised in that described when the content to be displayed can not be described When VR equipment identifies, the layout structure of the content to be displayed is reconstructed into the layout that the VR equipment can identify by the terminal Structure includes:
When the content to be displayed can not be identified by the VR equipment, the terminal is according to the layout structure got and in advance The reordering rule put, according to specified order rearrangement after each display items included in the layout structure are classified;
Display items after rearrangement are arranged respectively to the viewing area of described two designated shapes with identical layout, to obtain State the layout structure that VR equipment can identify.
6. display processing method as claimed in claim 1, it is characterised in that the content to be displayed includes but is not limited to following Type:
Incoming call, short message, webpage, video, picture, five application page.
7. a kind of display processing unit, it is characterised in that the display processing unit includes:
Judge module, for when terminal adaptation is in VR virtual reality devices, judging to be shown on the terminal display screen Whether content can be identified by the VR equipment;
Reconstructed module, for when the content to be displayed can not be identified by the VR equipment, by the cloth of the content to be displayed Office's structural remodeling is the layout structure that the VR equipment can identify;
Display module, for showing content to be displayed described in screen display described according to the layout structure after reconstruct.
8. display processing unit as claimed in claim 7, it is characterised in that the display processing unit also includes:
Respond module, for the layout structure after according to reconstruct during content to be displayed described in the display screen display, When detecting the touch operation on the display screen, content to be displayed is updated according to the touch operation.
9. display processing unit as claimed in claim 7 or 8, it is characterised in that the display processing unit also includes:
Detection module, for the sensor and/or camera by being arranged in the terminal, detect and judge that the terminal is worked as It is preceding whether to adapt in VR equipment, and when it is determined that the terminal is currently adapted in VR equipment, open the VR interactions switch;
Determining module, for when preset VR interaction switches are opened, determining that the terminal is currently adapted in VR equipment.
10. display processing unit as claimed in claim 7, it is characterised in that the judge module includes:
Acquiring unit, for when the terminal adaptation is in VR equipment, obtaining the content to be displayed on the terminal display screen Layout structure;
Determining unit, for being that the viewing area of the display screen is divided into left and right in the layout structure of the content to be displayed When two formed objects and the viewing area of symmetrical designated shape, determine that the content to be displayed can be known by the VR equipment Not;Wherein, it is completely overlapped after the content translation in the viewing area of two designated shapes.
11. display processing unit as claimed in claim 10, it is characterised in that the reconstructed module includes:
Rearrangement units, for when the content to be displayed can not be identified by the VR equipment, according to the layout structure got And preset reordering rule, according to specified order weight after each display items included in the layout structure are classified Row;
Dispensing unit, for the display items after rearrangement to be arranged respectively to the display of described two designated shapes with identical layout Region, to obtain the layout structure that the VR equipment can identify.
12. display processing unit as claimed in claim 7, it is characterised in that the content to be displayed include but is not limited to Types Below:
Incoming call, short message, webpage, video, picture, five application page.
CN201610821120.7A 2016-09-12 2016-09-12 Display processing method and device Pending CN107817894A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201610821120.7A CN107817894A (en) 2016-09-12 2016-09-12 Display processing method and device
PCT/CN2017/070886 WO2018045699A1 (en) 2016-09-12 2017-01-11 Display processing method and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610821120.7A CN107817894A (en) 2016-09-12 2016-09-12 Display processing method and device

Publications (1)

Publication Number Publication Date
CN107817894A true CN107817894A (en) 2018-03-20

Family

ID=61561336

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610821120.7A Pending CN107817894A (en) 2016-09-12 2016-09-12 Display processing method and device

Country Status (2)

Country Link
CN (1) CN107817894A (en)
WO (1) WO2018045699A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110362203A (en) * 2019-07-11 2019-10-22 Oppo广东移动通信有限公司 Information processing method, device, storage medium and augmented reality equipment
CN114286077A (en) * 2021-01-08 2022-04-05 海信视像科技股份有限公司 Virtual reality equipment and VR scene image display method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120302289A1 (en) * 2011-05-27 2012-11-29 Kang Heejoon Mobile terminal and method of controlling operation thereof
CN104270623A (en) * 2014-09-28 2015-01-07 联想(北京)有限公司 Display method and electronic device
CN105900051A (en) * 2014-01-06 2016-08-24 三星电子株式会社 Electronic device and method for displaying event in virtual reality mode

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2499102B (en) * 2013-01-11 2013-12-25 Mvr Global Ltd Head-mounted display device
US20160019720A1 (en) * 2014-07-15 2016-01-21 Ion Virtual Technology Corporation Method for Viewing Two-Dimensional Content for Virtual Reality Applications
KR102244222B1 (en) * 2014-09-02 2021-04-26 삼성전자주식회사 A method for providing a visual reality service and apparatuses therefor
CN105528207B (en) * 2015-12-03 2018-12-25 北京小鸟看看科技有限公司 A kind of virtual reality system and the method and apparatus for wherein showing Android application image
CN105447898B (en) * 2015-12-31 2018-12-25 北京小鸟看看科技有限公司 The method and apparatus of 2D application interface are shown in a kind of virtual reality device
CN106126145A (en) * 2016-06-29 2016-11-16 联想(北京)有限公司 A kind of display packing and electronic equipment

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120302289A1 (en) * 2011-05-27 2012-11-29 Kang Heejoon Mobile terminal and method of controlling operation thereof
CN105900051A (en) * 2014-01-06 2016-08-24 三星电子株式会社 Electronic device and method for displaying event in virtual reality mode
CN104270623A (en) * 2014-09-28 2015-01-07 联想(北京)有限公司 Display method and electronic device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110362203A (en) * 2019-07-11 2019-10-22 Oppo广东移动通信有限公司 Information processing method, device, storage medium and augmented reality equipment
CN114286077A (en) * 2021-01-08 2022-04-05 海信视像科技股份有限公司 Virtual reality equipment and VR scene image display method
CN114286077B (en) * 2021-01-08 2024-05-17 海信视像科技股份有限公司 Virtual reality device and VR scene image display method

Also Published As

Publication number Publication date
WO2018045699A1 (en) 2018-03-15

Similar Documents

Publication Publication Date Title
US11467715B2 (en) User interface display method, terminal and non-transitory computer-readable storage medium for splitting a display using a multi-finger swipe
WO2021088720A1 (en) Information sending method and electronic device
CN109388304A (en) A kind of screenshotss method and terminal device
CN107948498B (en) A kind of elimination camera Morie fringe method and mobile terminal
CN103472996A (en) Method and device for receiving touch in mobile device
CN109407921A (en) A kind of processing method and terminal device of application program
CN107908330B (en) The management method and mobile terminal of application icon
CN108664185A (en) Picture display process, mobile terminal and computer readable storage medium
CN109828732A (en) A kind of display control method and terminal device
US20190297297A1 (en) Video playing method and device
CN110196667A (en) A kind of processing method and terminal of notification message
CN103197825A (en) Image processor, display control method and program
CN107885512B (en) A kind of application program installation method, mobile terminal
CN109857289A (en) Display control method and terminal device
WO2017101391A1 (en) Method and device for magnifying video image
CN110536006A (en) A kind of object's position method of adjustment and electronic equipment
CN109753202A (en) A kind of screenshotss method and mobile terminal
CN111046211A (en) Article searching method and electronic equipment
CN110198428A (en) A kind of multimedia file producting method and first terminal
CN109901761A (en) A kind of content display method and mobile terminal
CN109947988B (en) Information processing method and device, terminal equipment and server
CN109117054A (en) A kind of display control method and terminal
CN105334955A (en) Information processing method and electronic equipment
CN108510266A (en) A kind of Digital Object Unique Identifier recognition methods and mobile terminal
CN107817894A (en) Display processing method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180320

RJ01 Rejection of invention patent application after publication