CN108958588A - Control method, system, equipment and the readable storage medium storing program for executing of interface icon operation - Google Patents

Control method, system, equipment and the readable storage medium storing program for executing of interface icon operation Download PDF

Info

Publication number
CN108958588A
CN108958588A CN201810771120.XA CN201810771120A CN108958588A CN 108958588 A CN108958588 A CN 108958588A CN 201810771120 A CN201810771120 A CN 201810771120A CN 108958588 A CN108958588 A CN 108958588A
Authority
CN
China
Prior art keywords
user
interface
instruction
interface icon
icon
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810771120.XA
Other languages
Chinese (zh)
Inventor
饶俊成
李媛伊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SuperD Co Ltd
Shenzhen Super Technology Co Ltd
Original Assignee
Shenzhen Super Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Super Technology Co Ltd filed Critical Shenzhen Super Technology Co Ltd
Priority to CN201810771120.XA priority Critical patent/CN108958588A/en
Publication of CN108958588A publication Critical patent/CN108958588A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

The invention discloses control method, system, equipment and the readable storage medium storing program for executing of interface icon operation.Wherein, for method comprising steps of scanning either objective scene, is presented AR display interface on the display screen of intelligent terminal after scanning successfully, interface icon is presented based on target scene in AR display interface in a manner of augmented reality;The first user operation instruction is obtained, at least one interface icon is selected in AR display interface according to the first user operation instruction;Second user operational order is obtained, according to the mobile interface icon chosen of second user operational order;Third user operation instruction is obtained, the interface icon chosen is placed to specified location in user according to third user operation instruction.System, equipment and readable storage medium storing program for executing both correspond to a kind of control method of intelligent terminal interface icon operation based on augmented reality.It is become easy the invention enables user's cell phone desktop icons and intelligent, and improves operating efficiency, user experience is good.

Description

Control method, system, equipment and the readable storage medium storing program for executing of interface icon operation
Technical field
The present invention relates to intelligent terminal control fields, the intelligent terminal interface icon operation specially based on augmented reality Control method, system, equipment and readable storage medium storing program for executing.
Background technique
In the prior art, interface icon (such as desk-top picture of the user in intelligent movable equipment (such as mobile phone, tablet computer) Mark) when, it needs long-pressing icon and reaches by switching screen to want that the position placed just is able to achieve moving operation.Since user needs By finger long-pressing, and screen need to be switched when carrying out interface icon movement and placed, this operating process is cumbersome, and only It can move one by one, integrated operation process mechanism degree is high, inconvenient, poor user experience.
Summary of the invention
The present invention is directed to solve at least some of the technical problems in related technologies.For this purpose, of the invention Purpose is to provide that a kind of operating efficiency is high, the control of the good intelligent terminal interface icon operation based on augmented reality of user experience Method, system, equipment and readable storage medium storing program for executing.
The technical scheme adopted by the invention is that:
In a first aspect, a kind of control method of the intelligent terminal interface icon operation based on augmented reality, which is characterized in that Include:
Either objective scene is scanned, AR display interface is presented after scanning successfully on the display screen of intelligent terminal, it is described Interface icon is presented based on the target scene in AR display interface in a manner of augmented reality;
The first user operation instruction is obtained, selects at least one in the AR display interface according to the first user operation instruction A interface icon;
Second user operational order is obtained, according to the mobile interface icon chosen of second user operational order;
Third user operation instruction is obtained, the interface icon chosen is placed to user according to third user operation instruction Designated position.
Further, the scanning either objective scene, being based on the display screen of intelligent terminal after scanning successfully should Interface icon is presented in target scene in a manner of augmented reality, specifically further include: based on the intelligent terminal and target scene it Between distance and/or relative displacement, adjust the size that shows of interface icon and/or the position in AR display interface.
Alternatively the first preferred embodiment of interface icon step, first user operation instruction include intelligence Terminal vertically moves signal;The first user operation instruction of the acquisition is shown according to the first user operation instruction in the AR At least one described interface icon is selected in interface, is specifically included: being obtained the action signal of intelligent terminal vertically moved, is worked as institute When stating the display area of interface icon more than preset area, the stopping duration of the intelligent terminal is recorded;When the stopping duration When beyond the first preset duration, it is determined as choosing the interface icon.
Alternatively second of preferred embodiment of interface icon step, first user operation instruction includes user To the touching signals of display screen;The first user operation instruction of the acquisition, it is aobvious in the AR according to the first user operation instruction Show and select at least one described interface icon in interface, specifically include: obtaining user to the touching signals of display screen, work as user When interface icon described in touch/long-pressing, it is determined as choosing the interface icon.
Alternatively the third preferred embodiment of interface icon step, first user operation instruction includes user To the crawl hand signal of the interface icon;The first user operation instruction of the acquisition, exists according to the first user operation instruction At least one described interface icon is selected in the AR display interface, is specifically included: obtaining user and the interface icon is grabbed Hand signal is taken, when user gesture signal is to grab the interface icon, is determined as choosing the interface icon.
Further, the first user operation instruction of the acquisition shows boundary in the AR according to the first user operation instruction At least one described interface icon is selected in face, is specifically included: being obtained the first user operation instruction, is referred to according to the first user's operation First interface icon is chosen in order in AR display interface, and pops up choice box on the display screen, to be confirmed whether under selection One interface icon;Such as confirm the next interface icon of selection, continues to obtain the first user operation instruction, be grasped according to the first user It instructs and chooses second interface icon in AR display interface, and pop up choice box on the display screen, to be confirmed whether to select Select next interface icon;And so on carry out multiple interface icon selections.
Further, the first user operation instruction of the acquisition shows boundary in the AR according to the first user operation instruction At least one described interface icon is selected in face, is specifically included: being obtained the first user operation instruction, is referred to according to the first user's operation First interface icon is chosen in order in AR display interface, whether then monitors the stopping duration of the intelligent terminal more than second Preset duration;It is in this way then confirm the next interface icon of selection, continue to obtain the first user operation instruction, be grasped according to the first user Instruct and choose second interface icon in AR display interface, then monitor the intelligent terminal stopping duration whether be more than Second preset duration;And so on carry out multiple interface icon selections.
Further, second operational order includes that intelligent terminal moves in parallel signal;The acquisition second user Operational order is specifically included according to the mobile interface icon chosen of second user operational order: obtaining the flat of intelligent terminal Row movable signal, according to the shifting for moving in parallel signal and the interface icon chosen being presented in AR display interface of intelligent terminal Movement.
Further, second operational order includes the gesture movable signal of user;The acquisition second user operation Instruction is specifically included according to the mobile interface icon chosen of second user operational order: being obtained user and is maintained grasping movement Gesture movable signal, maintain mobile present in AR display interface of the movable signal of the gesture of grasping movement to select according to user In the interface icon shift action.
Further, the third operational order includes that intelligent terminal moves down action signal and/or user to discharge touch-control dynamic Make signal and/or user discharges crawl gesture motion signal.
Further, the first user operation instruction of the acquisition selects at least one institute according to the first user operation instruction After stating interface icon, further includes: obtain fourth user operational order, cancel interface icon choosing according to fourth user operational order It selects.
Further, the fourth user operational order includes clicking interface icon action signal.
Further, the acquisition second user operational order, according to the mobile surface chart of second user operational order After mark, further includes: obtain the 5th user operation instruction, control the interface icon according to the 5th user operation instruction and be back to original Position.
Further, the 5th user operation instruction includes overturning intelligent terminal action signal.
Second aspect, the control system for the intelligent terminal interface icon operation based on augmented reality that the present invention also provides a kind of System, comprising:
Interface icon display module, for showing the interface icon of intelligent terminal in a manner of augmented reality;
Interface icon selecting module is selected for obtaining the first user operation instruction, and according to the first user operation instruction At least one described interface icon;
Interface icon mobile module, for obtaining second user operational order, and it is mobile according to second user operational order The interface icon;
Interface icon puts down module, for obtaining third user operation instruction, puts down institute according to third user operation instruction State interface icon.
Further, further includes: cancellation module is falsely dropped, it is described to falsely drop the input terminal for cancelling module and interface icon selection mould The output end of block connects, and cancels interface icon choosing for obtaining fourth user operational order, and according to fourth user operational order It selects.
Further, further includes: abandon mobile module, the input terminal for abandoning mobile module and the mobile mould of interface icon The output end of block connects, and controls the surface chart for obtaining the 5th user operation instruction, and according to the 5th user operation instruction Mark is back to original position.
The control of the third aspect, the intelligent terminal interface icon operation based on augmented reality that the present invention also provides a kind of is set It is standby, comprising: at least one processor;And the memory being connect at least one described processor communication;Wherein, described to deposit Reservoir is stored with the instruction that can be executed by least one described processor, and described instruction is executed by least one described processor, So that at least one described processor is able to carry out the control of the intelligent terminal interface icon operation based on augmented reality Method.
Fourth aspect, the present invention also provides a kind of computer readable storage medium, the computer readable storage medium is deposited Contain computer executable instructions, it is described based on augmented reality that the computer executable instructions are used to making computer to execute The control method of intelligent terminal interface icon operation.
The beneficial effects of the present invention are:
It is provided by the invention based on augmented reality intelligent terminal interface icon operation control method, system, equipment and Readable storage medium storing program for executing shows intelligent terminal interface icon using augmented reality mode, by setting predetermined registration operation and Rule of judgment, Required moving icon is subjected to customized movement in conjunction with human-computer interaction.Compared with prior art, this programme overcomes interface icon The more hard defect of moving operation effectively increases interface icon mobile operating efficiency and operating experience.
In addition, the operational means by combining setting moving icon simultaneously, so that the movement of more icons is more humanized, just Victoryization.
The present invention is suitable for the interface icon operating system of various intelligent terminals.
Detailed description of the invention
Specific embodiments of the present invention will be further explained with reference to the accompanying drawing:
Fig. 1 is the principle signal for the interface icon for showing intelligent terminal in the embodiment of the present invention one in a manner of augmented reality Figure;
Fig. 2 is the process for showing the interface icon step of intelligent terminal in the embodiment of the present invention one in a manner of augmented reality Figure;
Fig. 3 is the control flow chart of one icon of movement in the embodiment of the present invention one;
The control flow chart of mobile multiple icons while Fig. 4 is in the embodiment of the present invention one;
Fig. 5 is to cancel selection/cancellation moving icon operation control flow chart in the embodiment of the present invention one;
Fig. 6 is the system schematic of the intelligent terminal interface icon operation based on augmented reality of the embodiment of the present invention two.
Specific embodiment
It should be noted that in the absence of conflict, the features in the embodiments and the embodiments of the present application can phase Mutually combination;Printed words such as " first " " second " " third " " the 4th " " the 5 " employed herein not to data or execution order into Row limits, and is distinguished to function and the essentially identical identical entry of effect or similar item.
As shown in Figure 1, smart machine of the present invention includes that mobile phone, tablet computer etc. have the intelligence of communication function eventually End, below only by taking mobile phone 100 as an example;Interface icon of the present invention includes desktop icons, icon etc. inside application program, under Face is only by taking desktop icons 111 as an example;Target scene of the present invention can be any reality scene, below only with plane scene For 200;The technical solution that the present invention will be described in detail.
In the following example, by camera collection image/vision signal built in mobile phone, realizes and obtain a variety of user behaviour It instructs, specifically includes:
Scanning target scene obtains scene image: passing through camera (mobile phone rear camera or front camera) The image/video in scene or acquisition reality scene in scanning reality.
Crawl hand signal of the user to the interface icon: when crawl gesture (such as thumb and index finger kneading hand of user Gesture) (identification to crawl gesture can be realized by image analysis algorithm) when appearing between camera and target scene, it will use The crawl gesture at family is presented in AR display interface, when the crawl gesture of user (such as thumb Chong Die with the position of a certain interface icon Refer to that fingertip location is Chong Die with the position of a certain interface icon) when, be determined as user to the crawl hand signal of the interface icon, Then choose the interface icon.
The gesture movable signal of user: after user chooses one or more interface icons, the crawl gesture of user occurs Between camera and target scene and displacement action is generated, is determined as the gesture movable signal of user, then according to crawl gesture The corresponding mobile interface icon chosen of the size and Orientation of displacement.
User discharges crawl gesture motion signal: after the mobile interface icon chosen of user reaches specified location in user, User is obtained using camera and discharges crawl gesture motion image/video (such as thumb and index finger separately act), is determined as user Release crawl gesture motion signal, then put down the interface icon chosen in current location.
In the following example, the shift action signal of mobile phone is detected and obtained by the gyro sensor built in mobile phone Deng specifically including:
Mobile phone vertically moves signal: the displacement action of mobile phone is incuded by gyroscope, when mobile phone hanging down along plane scene When histogram is to movement (i.e. mobile phone moves up and down), be determined as mobile phone vertically moves signal.
Mobile phone moves in parallel signal: the displacement action of mobile phone is incuded by gyroscope, when mobile phone is along plane scene When parallel direction mobile (i.e. mobile phone back and forth or left and right is mobile), be determined as mobile phone moves in parallel signal.
Mobile phone moves down action signal: after the mobile interface icon chosen of user reaches specified location in user, passing through top Spiral shell instrument incudes the displacement action of mobile phone, when mobile phone moves down (i.e. mobile phone moves down) along the vertical direction of plane scene, determines Action signal is moved down for mobile phone.
In the following example, position or the attitude signal of mobile phone are detected and obtained by the direction sensor built in mobile phone Deng, comprising:
It overturns mobile phone action signal: the angle change of mobile phone is incuded by direction sensor, when mobile phone angle change meets When rotary movement (such as angle change is more than or equal to 180 degree), it is determined as the rotary movement signal of mobile phone.
In the following example, ambient lighting conditions are perceived by light sensor, to adjust dummy object (desk-top picture Mark) brightness;By display screen on touch sensible module (touch screen) detect user touching signals (including user touching Touch/long-pressing interface icon action signal, click interface icon action signal etc.).
Embodiment one
The control method for the mobile phone desktop icon operation based on augmented reality that the present embodiment provides a kind of, comprising:
AR display interface icon step: scanning either objective scene, after scanning successfully on the display screen of intelligent terminal AR display interface is presented, interface icon is presented based on the target scene in the AR display interface in a manner of augmented reality.
Selection interface icon step: obtaining the first user operation instruction, shows boundary in AR according to the first user operation instruction At least one interface icon is selected in face.
After selection interface icon step, such as want to cancel the interface icon chosen, can be performed and cancel interface icon selection Step;Such as think the mobile interface icon chosen, moving boundary icon step can be performed.
Cancel interface icon and select step: after selection interface icon step, obtaining fourth user operational order, according to Fourth user operational order cancels interface icon selection.
Moving boundary icon step: obtaining second user operational order, is chosen according to the movement of second user operational order Interface icon.
In moving boundary icon step, such as wants to cancel movement, can be performed and cancel interface icon moving step;Such as want to place The interface icon chosen, it is executable to put down interface icon step.
Cancel interface icon moving step: obtaining the 5th user operation instruction, institute is controlled according to the 5th user operation instruction It states interface icon and is back to original position.
It puts down interface icon step: obtaining third user operation instruction, chosen according to the placement of third user operation instruction Interface icon is to specified location in user.
Each step is explained in detail below is specifically realization process.
1.AR display interface icon step
Referring to Figures 1 and 2, in the present embodiment, when user wants the desktop icons 111 on cell phone 100, then user It controls mobile phone 100 and opens augmented reality mode (AR mode), then user enters 100 augmented reality interface of mobile phone.
Specifically, the mobile phone 100, by scanning either objective scene, target scene can be any reality scene.Such as A plane scene 200 (such as desktop or metope) is scanned by mobile phone 100, the current of the plane scene 200 is locked after scanning successfully Region 210 (when current region 210 of the desktop or wall section that preceding camera is aligned as plane scene 200), and in mobile phone Desktop icons 111 are presented in the current region 210 based on the plane scene 200 on 100 display screen, i.e., by desktop icons 111 Insertion is fixed in the current region 210 based on the plane scene 200, forms AR display interface 110, and in AR display interface AR desktop icons 111 are shown in 110.AR display interface 110 be based on the distance between the intelligent terminal and target scene and/or Relative displacement adjusts size and/or position that the desktop icons 111 in AR display interface 110 are shown.In the present embodiment, When the mobile phone 100 is directed at desktop icons 111 in AR display interface 110 and moves closer to the plane scene 200, the table Display area of the face icon 111 in the AR display interface 110 is gradually increased;When the mobile phone 100 is gradually distance from described put down Face scene 200, display area of the desktop icons 111 in the AR display interface 110 are gradually reduced;When the mobile phone 100 opposite 200 current regions 210 of plane scene move in parallel, position of the desktop icons 111 in AR display interface 110 It moves.
2. selection interface icon step.
2.1 selection single interface icon steps
Referring to Fig. 3, the first user operation instruction is obtained, a desktop icons 111 are selected according to the first user operation instruction; First user operation instruction include mobile phone vertically move signal and/or user to display screen touching signals and/or Crawl hand signal etc. of the user to the desktop icons 111.Below only using the first user operation instruction as the vertical of mobile phone Explanation is unfolded for movable signal.
Referring to Fig. 3, single target icon selects step, mobile phone 100 is moved close to perpendicular to plane scene 200 (the vertically moving signal of mobile phone), by constantly adjusting the distance between mobile phone 100 and plane scene 200, so that mobile phone 100 is aobvious Displaying target icon (target desktop icon 111) in display screen curtain, while continuing close to plane scene 200, target icon is aobvious Display area on display screen curtain is gradually increased;When display area is more than systemic presupposition area, as desktop icons 111 occupy screen Maximum area is hit exactly, then mobile phone 100 is static (can use the jitter error that stabilization algorithm avoids holding mobile phone 100), stops Operation, and keep former movement, the stopping duration of system start recording mobile phone 100;The first preset duration is reached (such as when stopping duration 1.5 seconds) when, then determine to choose target desktop icon 111;100 automatically scanning of mobile phone frames target icon with wire bar system and completes Target icon selection.
When the first user operation instruction be user to display screen touching signals or user to the desktop icons 111 When grabbing hand signal, select single interface icon step and the first user operation instruction for class when vertically moving signal of mobile phone Seemingly, it is summarized as follows respectively:
It (can when the crawl gesture (such as thumb and index finger kneading gesture) of user appears between camera and target scene The identification to crawl gesture is realized by image analysis algorithm), the crawl gesture of user is presented in AR display interface 110, When the crawl gesture of user (the position weight of such as thumb tip position and a certain interface icon Chong Die with the position of a certain interface icon It is folded) when, it is determined as that user to the crawl hand signal of the interface icon, then chooses the interface icon.
In AR display interface 110, the touch-control of user is detected by the touch sensible module (touch screen) on display screen Signal such as detects user's touch/long-pressing a certain interface icon action signal, is judged to choosing the interface icon.
The 2.2 multiple interface icon steps of selection
Referring to Fig. 4, when user has chosen a desktop icons 111, multiple desk-top pictures can be realized by following two mode The selection of mark 111:
Multiple solutions icon selection mode one
The first user operation instruction is obtained, chooses first in AR display interface 110 according to the first user operation instruction Interface icon, and choice box is popped up on the display screen, to be confirmed whether to select next interface icon;Such as confirm that selection is next A interface icon ("Yes" is such as selected in choice box) continues to obtain the first user operation instruction, according to the first user operation instruction Second interface icon is chosen in AR display interface 110, and pops up choice box on the display screen, to be confirmed whether under selection One interface icon;... if confirmation selects next interface icon, continues to obtain the first user operation instruction, be used according to first Family operational order chooses n-th interface icon in AR display interface 110, and pops up choice box on the display screen, with confirmation Whether next interface icon is selected;Until user stops selection desktop icons 111 (such as selecting "No" in choice box).
Multiple solutions icon selection mode two
The first user operation instruction is obtained, chooses first in AR display interface 110 according to the first user operation instruction Then whether interface icon monitors the stopping duration of the intelligent terminal more than the second preset duration (such as 2 seconds);It is in this way then confirm Next interface icon is selected, continues to obtain the first user operation instruction, according to the first user operation instruction in AR display interface Second interface icon is chosen in 110, then monitor the intelligent terminal stopping duration it is whether default more than second when It is long;... it is in this way then confirm the next interface icon of selection, continue to obtain the first user operation instruction, according to the first user's operation Instruction n-th interface icon is chosen in AR display interface 110, then monitor the intelligent terminal stopping duration whether be more than Second preset duration;Until user stops selection desktop icons 111 (such as mobile desktop icon 111 in the second preset duration).
After choosing target icon each time, by being in the covering of translucent full color covering pattern in AR display interface 110 The target icon being now entirely selected.
2.3, which cancel interface icon, selects step
Referring to Fig. 5, cancel the control flow chart of icon selection in the present embodiment.If user is in selection interface icon step In, falsely drop in do not need operation desktop icons 111, then can by such as click the action signals such as the desktop icons 111 (the 4th behaviour Instruct) cancelled.Wherein, the click of the user desktop is detected by the touch sensible module (touch screen) on display screen The action signal of icon 111.
2.4 moving boundary icon steps
After interface icon (one or more) is chosen, second user operational order is obtained, according to second user operational order The mobile desktop icons 111;Second operational order includes that the gesture for moving in parallel signal and/or user of mobile phone is mobile Signal etc..
Moving boundary icon mode one
After selection interface icon step has selected one or more interface icons, then signal is moved in parallel according to mobile phone (it is mobile to be parallel to plane scene 200), (desktop is presented in mobile phone 100AR display interface 110 in synchronizing moving target icon The shift action of icon 111).
Moving boundary icon mode two
After selection interface icon step has selected one or more interface icons, the crawl gesture of user appears in camera shooting Between head and target scene and displacement action is generated, is determined as the gesture movable signal of user, then according to crawl gesture displacement (shifting of the desktop icons 111 is presented in the corresponding mobile interface icon chosen of size and Orientation in mobile phone A R display interface 110 Movement).
2.5 cancel interface icon moving step
Referring to Fig. 5, in moving boundary icon step, such as wants to cancel movement, can be performed and cancel interface icon moving step. Specifically, can be by such as carrying out mobile phone 100 to overturn etc. action signal (the 5th user operation instruction), system identification takes for user Disappear moving operation, the position of (mobile before) before desktop icons 111 automatically return to.Wherein, hand is incuded by direction sensor The angle change of machine 100 determines when 100 angle change of mobile phone meets rotary movement (such as angle change is more than or equal to 180 degree) For the rotary movement signal of mobile phone 100.
2.6 put down interface icon step
When selected target icon to be moved to interface location (in the desktop scope) of the desired placement of user, third is obtained User operation instruction puts down the desktop icons 111 according to third user operation instruction.The third operational order includes mobile phone It moves down action signal and/or user discharges touch action signal and/or user discharges crawl gesture motion signal etc..Below only with Third operational order is that explanation is unfolded for mobile phone moves down action signal.
After the mobile interface icon chosen of user reaches specified location in user, the position of mobile phone 100 is incuded by gyroscope It is mobile to make, when mobile phone 100 is moved down along the vertical direction of plane scene 200, it is determined as the action signal that moves down of mobile phone 100, then Drop target is illustrated at this position, and it is mobile to complete target icon.
2.7 exit AR display interface step
After completing target icon movement, AR display interface can be exited by the exit button in AR display interface 110 110,100 display interface of regular handset is returned to, and the desktop icons for completing moving operation are presented in 100 display interface of regular handset 111。
Embodiment two
Referring to Fig. 6, a kind of control system of mobile phone desktop icon operation based on augmented reality, packet are present embodiments provided It includes:
Desktop icons display module, for showing the desktop icons of mobile phone in a manner of augmented reality.Desktop icons are shown Module can use including but not limited to mobile phone camera, gyroscope, light sensor and realize.The mobile phone passes through (camera) Either objective scene is scanned, target scene can be any reality scene.Such as by mobile phone scan a plane scene (such as desktop or Metope), the plane scene present image is locked after scanning successfully, and current based on the plane scene on the display screen of mobile phone Desktop icons are presented in image, i.e., desktop icons insertion are fixed in the plane scene present image, form AR desktop icons.It is logical Cross the shift action of gyroscope induction mobile phone.When the mobile phone moves closer to the desktop icons, the desktop icons are described Display area on display screen is gradually increased;When the mobile phone is gradually distance from the desktop icons, the desktop icons are in institute The display area stated on display screen is gradually reduced;When the mobile phone is moved in parallel with respect to plane scene present image, the table Face icon is moved in parallel relative to mobile phone.By light sensor for perceiving light conditions, to adjust dummy object (desktop Icon) display brightness, improve the real sense of reality that shows of icon.
Desktop icons selecting module is selected for obtaining the first user operation instruction, and according to the first user operation instruction One or more desktop icons.Desktop icons selecting module is realized using including but not limited to gyroscope or touches display Screen.For example, incuding mobile phone action signal using gyroscope.Mobile phone is moved close to perpendicular to plane scene, and constantly Close to plane scene, by constantly adjusting the distance between mobile phone and plane scene, so that only display mesh in mobile phone display screen curtain It marks on a map (target desktop icon), while continuing alignment and close plane scene, the display surface of target icon on the display screen Product is gradually increased;When display area is more than systemic presupposition area, if icon occupies screen center maximum area, then mobile phone is static (can use the jitter error that stabilization algorithm avoids holding mobile phone), stops operation, and keep former movement, system start recording The stopping duration of mobile phone;When stopping duration arrival the first preset duration (such as 1.5 seconds), then determine that mobile phone user need to carry out target The motion scan of icon operates;Mobile phone automatically scanning frames target icon with wire bar system and completes target icon selection.
Cancellation module is falsely dropped, the input terminal for falsely dropping cancellation module is connect with the output end of desktop icons selecting module, Cancel desktop icons selection for obtaining fourth user operational order, and according to fourth user operational order.If user is selecting During icon, falsely drops and take unwanted desktop icons, then it can be by such as clicking the action signals such as the desktop icons (the 4th behaviour Instruct) cancelled.
Desktop icons mobile module, for obtaining second user operational order, and it is mobile according to second user operational order The desktop icons.Desktop icons mobile module is realized using including but not limited to gyroscope or touch display screen.Example Such as, mobile phone action signal is incuded using gyroscope.According to the movement (it is mobile to be parallel to plane scene) of mobile phone, synchronizing moving mesh It marks on a map and (shift action of the desktop icons is presented on mobile phone display screen curtain based on plane scene).
Mobile module is abandoned, the input terminal for abandoning mobile module is connect with the output end of desktop icons mobile module, For obtaining the 5th user operation instruction, and the desktop icons are controlled according to the 5th user operation instruction and are back to original position. It, can be by the way that such as mobile phone be overturn etc. if desktop icons mobile module, in executing icon moving process, decision is abandoned moving Action signal (the 5th user operation instruction), system identification are that user abandons moving operation, desktop icons automatically return to before (not Before movement) position.
Desktop icons put down module, for obtaining third user operation instruction, put down institute according to third user operation instruction State desktop icons.Desktop icons mobile module is realized using including but not limited to gyroscope or touch display screen.For example, Mobile phone action signal is incuded using gyroscope.When by selected target icon be moved to user want place interface location ( In desktop scope) when, it can integrally be moved down by mobile phone (mobile phone moves vertically downward along plane scene), then determine drop target figure It is marked in this position, it is mobile to complete target icon.
It should be noted that the control system operated by the mobile phone desktop icon based on augmented reality in this present embodiment It is based on identical inventive concept with the control method of the mobile phone desktop icon operation based on augmented reality in above-described embodiment one, Therefore, the corresponding contents in embodiment of the method one are equally applicable to this system embodiment, and and will not be described here in detail.
Embodiment three
A kind of control equipment of mobile phone desktop icon operation based on augmented reality is also provided in the present embodiment, comprising:
At least one processor;And
The memory being connect at least one described processor communication;Wherein,
The memory is stored with the instruction that can be executed by least one described processor, and described instruction is by described at least one A processor executes, so that at least one described processor is able to carry out the method.
It should be noted that the control system operated by the mobile phone desktop icon based on augmented reality in this present embodiment It is based on identical inventive concept with the control method of the mobile phone desktop icon operation based on augmented reality in above-described embodiment one, Therefore, the corresponding contents in embodiment of the method one are equally applicable to this system embodiment, and and will not be described here in detail.
Example IV
In the present embodiment, the present invention also provides a kind of computer readable storage medium, the computer readable storage medium Computer executable instructions are stored with, the computer executable instructions are used to that computer to be made to execute the method.
It should be noted that the control system operated by the mobile phone desktop icon based on augmented reality in this present embodiment Identical invention is based on the control method of the mobile phone desktop icon operation based on augmented reality in above-described embodiment one and two Design, therefore, the corresponding contents in embodiment of the method one are equally applicable to this system embodiment, and and will not be described here in detail.
Control method, system, the equipment and readable of mobile phone desktop icon operation provided by the invention based on augmented reality Required moving icon is carried out customized movement or even nothing by human-computer interaction using augmented reality mode desktop by storage medium Human finger is needed directly to contact, it is very intelligent, conveniently, meet the AI epoch, the completely new mode of operation of augmented reality bring allows use Family cell phone desktop icons become easy and intelligence, and improve operating efficiency, and user experience is good.
It is to be illustrated to preferable implementation of the invention, but the invention is not limited to the implementation above Example, those skilled in the art can also make various equivalent variations on the premise of without prejudice to spirit of the invention or replace It changes, these equivalent deformations or replacement are all included in the scope defined by the claims of the present application.

Claims (13)

1. a kind of control method of the intelligent terminal interface icon operation based on augmented reality characterized by comprising
Either objective scene is scanned, AR display interface is presented after scanning successfully on the display screen of the intelligent terminal, it is described Interface icon is presented based on the target scene in AR display interface in a manner of augmented reality;
The first user operation instruction is obtained, at least one institute is selected in the AR display interface according to the first user operation instruction State interface icon;
Second user operational order is obtained, according to the mobile interface icon chosen of second user operational order;
Third user operation instruction is obtained, it is specified to user that the interface icon chosen is placed according to third user operation instruction Position.
2. a kind of control method of intelligent terminal interface icon operation based on augmented reality according to claim 1, It is characterized in that, the scanning either objective scene, is based on the target scene after scanning successfully on the display screen of intelligent terminal Interface icon is presented in a manner of augmented reality, specifically further include:
Based on the distance between the intelligent terminal and the target scene and/or relative displacement, the AR display interface is adjusted In the size that shows of the interface icon and/or position.
3. a kind of control method of intelligent terminal interface icon operation based on augmented reality according to claim 1 or 2, It is characterized in that,
First user operation instruction includes that intelligent terminal vertically moves signal;The first user operation instruction of the acquisition, At least one described interface icon is selected in the AR display interface according to the first user operation instruction, is specifically included: being obtained The action signal of the intelligent terminal vertically moved, when the display area of the interface icon is more than preset area, record The stopping duration of the intelligent terminal;When the stopping duration exceeding the first preset duration, it is determined as choosing the surface chart Mark;
Alternatively,
First user operation instruction includes touching signals of the user to display screen;The first user's operation of the acquisition refers to It enables, at least one described interface icon is selected in the AR display interface according to the first user operation instruction, specifically includes: obtaining Family is taken to the touching signals of display screen, when the interface icon described in user's touch/long-pressing, is determined as choosing the surface chart Mark;
Alternatively,
First user operation instruction includes crawl hand signal of the user to the interface icon;The first user of the acquisition Operational order selects at least one described interface icon according to the first user operation instruction, specifically in the AR display interface It include: to obtain user to the crawl hand signal of the interface icon, when user gesture signal is to grab the interface icon, It is determined as choosing the interface icon.
4. the control method of the intelligent terminal interface icon operation according to claim 1 or 2 based on augmented reality, special Sign is, the first user operation instruction of the acquisition, selected in the AR display interface according to the first user operation instruction to A few interface icon, specifically includes:
The first user operation instruction is obtained, chooses first surface chart in AR display interface according to the first user operation instruction Mark, and choice box is popped up on the display screen, to be confirmed whether to select next interface icon;Such as confirm that selection is next Interface icon continues to obtain the first user operation instruction, chooses second in AR display interface according to the first user operation instruction A interface icon, and choice box is popped up on the display screen, to be confirmed whether to select next interface icon;And so on Carry out multiple interface icon selections.
5. the control method of the intelligent terminal interface icon operation according to claim 1 or 2 based on augmented reality, special Sign is, the first user operation instruction of the acquisition, selected in the AR display interface according to the first user operation instruction to A few interface icon, specifically includes:
The first user operation instruction is obtained, first interface is chosen in the AR display interface according to the first user operation instruction Then whether icon monitors the stopping duration of the intelligent terminal more than the second preset duration;It is in this way then confirm selection it is next Interface icon continues to obtain the first user operation instruction, be chosen in the AR display interface according to the first user operation instruction Then whether second interface icon monitors the stopping duration of the intelligent terminal more than the second preset duration;And so on into The multiple interface icon selections of row.
6. a kind of control method of intelligent terminal interface icon operation based on augmented reality according to claim 1 or 2, It is characterized in that,
Second operational order includes that intelligent terminal moves in parallel signal;
The acquisition second user operational order, according to the mobile interface icon chosen of second user operational order, specifically Include:
Obtain intelligent terminal moves in parallel signal, and choosing is presented in AR display interface according to the signal that moves in parallel of intelligent terminal In the interface icon shift action.
7. a kind of control method of intelligent terminal interface icon operation based on augmented reality according to claim 1 or 2, It is characterized in that,
Second operational order includes the gesture movable signal of user;
The acquisition second user operational order, according to the mobile interface icon chosen of second user operational order, specifically Include:
The movable signal that user maintains the gesture of grasping movement is obtained, the movable signal of the gesture of grasping movement is maintained according to user The mobile shift action that the interface icon chosen is presented in AR display interface.
8. the control method of the intelligent terminal interface icon operation according to claim 1 or 2 based on augmented reality, special Sign is, the third operational order include intelligent terminal move down action signal and/or user discharge touch action signal and/or User discharges crawl gesture motion signal.
9. the control method of the intelligent terminal interface icon operation according to claim 1 or 2 based on augmented reality, special Sign is that the first user operation instruction of the acquisition selects at least one described interface icon according to the first user operation instruction Later, further includes:
Fourth user operational order is obtained, the interface icon is cancelled according to fourth user operational order and is selected;
The fourth user operational order includes clicking interface icon action signal.
10. the control method of the intelligent terminal interface icon operation according to claim 1 or 2 based on augmented reality, It is characterized in that, the acquisition second user operational order, after the mobile interface icon of second user operational order, also wraps It includes:
The 5th user operation instruction is obtained, the interface icon is controlled according to the 5th user operation instruction and is back to original position;
5th user operation instruction includes overturning intelligent terminal action signal.
11. a kind of control system of the intelligent terminal interface icon operation based on augmented reality characterized by comprising
Interface icon display module, for showing the interface icon of intelligent terminal in a manner of augmented reality;
Interface icon selecting module, for obtaining the first user operation instruction, and at least according to the selection of the first user operation instruction One interface icon;
Interface icon mobile module, for obtaining second user operational order, and according to the movement of second user operational order Interface icon;
Interface icon puts down module, for obtaining third user operation instruction, puts down the boundary according to third user operation instruction Face icon.
12. a kind of control equipment of the intelligent terminal interface icon operation based on augmented reality characterized by comprising
At least one processor;And
The memory being connect at least one described processor communication;Wherein,
The memory is stored with the instruction that can be executed by least one described processor, and described instruction is by described at least one It manages device to execute, so that at least one described processor is able to carry out method as described in any one of claim 1 to 10.
13. a kind of computer readable storage medium, which is characterized in that the computer-readable recording medium storage has computer can It executes instruction, the computer executable instructions are for making computer execute method as described in any one of claim 1 to 10.
CN201810771120.XA 2018-07-13 2018-07-13 Control method, system, equipment and the readable storage medium storing program for executing of interface icon operation Pending CN108958588A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810771120.XA CN108958588A (en) 2018-07-13 2018-07-13 Control method, system, equipment and the readable storage medium storing program for executing of interface icon operation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810771120.XA CN108958588A (en) 2018-07-13 2018-07-13 Control method, system, equipment and the readable storage medium storing program for executing of interface icon operation

Publications (1)

Publication Number Publication Date
CN108958588A true CN108958588A (en) 2018-12-07

Family

ID=64483230

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810771120.XA Pending CN108958588A (en) 2018-07-13 2018-07-13 Control method, system, equipment and the readable storage medium storing program for executing of interface icon operation

Country Status (1)

Country Link
CN (1) CN108958588A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112148120A (en) * 2020-08-18 2020-12-29 华为技术有限公司 Method, equipment and storage medium for displaying virtual interface

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110107216A1 (en) * 2009-11-03 2011-05-05 Qualcomm Incorporated Gesture-based user interface
US20110296357A1 (en) * 2008-10-13 2011-12-01 Lg Electronics Inc. Method For Providing A User Interface Using Three-Dimensional Gestures And An Apparatus Using The Same
CN102918477A (en) * 2010-04-13 2013-02-06 诺基亚公司 Apparatus, method, computer program and user interface
CN105144197A (en) * 2013-03-14 2015-12-09 高通股份有限公司 Image-based application launcher
CN105229720A (en) * 2013-05-21 2016-01-06 索尼公司 Display control unit, display control method and recording medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110296357A1 (en) * 2008-10-13 2011-12-01 Lg Electronics Inc. Method For Providing A User Interface Using Three-Dimensional Gestures And An Apparatus Using The Same
US20110107216A1 (en) * 2009-11-03 2011-05-05 Qualcomm Incorporated Gesture-based user interface
CN102918477A (en) * 2010-04-13 2013-02-06 诺基亚公司 Apparatus, method, computer program and user interface
CN105144197A (en) * 2013-03-14 2015-12-09 高通股份有限公司 Image-based application launcher
CN105229720A (en) * 2013-05-21 2016-01-06 索尼公司 Display control unit, display control method and recording medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112148120A (en) * 2020-08-18 2020-12-29 华为技术有限公司 Method, equipment and storage medium for displaying virtual interface

Similar Documents

Publication Publication Date Title
US10165189B2 (en) Electronic apparatus and a method for controlling the same
EP2577438B1 (en) User interface with z-axis interaction
US10585531B2 (en) Information processing apparatus, control method, and program
US8638292B2 (en) Terminal apparatus, display control method, and display control program for three dimensional perspective display
CN103348311B (en) Gesture is dragged in user interface
US9313406B2 (en) Display control apparatus having touch panel function, display control method, and storage medium
US20090146968A1 (en) Input device, display device, input method, display method, and program
CN108205419A (en) Double screens control method, apparatus, mobile terminal and computer readable storage medium
US10477090B2 (en) Wearable device, control method and non-transitory storage medium
US20120075294A1 (en) Information processing apparatus including plurality of display portions and information processing system
JP6791994B2 (en) Display device
US20150035800A1 (en) Information terminal apparatus
CN109947243B (en) Intelligent electronic equipment gesture capturing and recognizing technology based on touch hand detection
CN109479096A (en) Electronic equipment and its control method
CN108958588A (en) Control method, system, equipment and the readable storage medium storing program for executing of interface icon operation
CN103577092B (en) Information processing equipment and information processing method
CN105653175A (en) System and method for icon button shift of handheld device
JP2020204914A (en) Electronic apparatus and method for controlling the same
JP6782685B2 (en) Display device and display method
JP6808408B2 (en) Display control device and its control method
WO2014083052A1 (en) Apparatus and method for capturing images
WO2020080107A1 (en) Information processing device, information processing method, and program
KR101188871B1 (en) Touch screen apparatus for patients with low vision and the method of displaying the same
CN109246286A (en) Control method, system, equipment and the storage medium of intelligent terminal application operating
RU2754988C1 (en) Electronic device, control method and computer-readable medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination