CN109934929A - The method, apparatus of image enhancement reality, augmented reality show equipment and terminal - Google Patents

The method, apparatus of image enhancement reality, augmented reality show equipment and terminal Download PDF

Info

Publication number
CN109934929A
CN109934929A CN201711349896.4A CN201711349896A CN109934929A CN 109934929 A CN109934929 A CN 109934929A CN 201711349896 A CN201711349896 A CN 201711349896A CN 109934929 A CN109934929 A CN 109934929A
Authority
CN
China
Prior art keywords
image
terminal
equipment
augmented reality
enhancing image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711349896.4A
Other languages
Chinese (zh)
Inventor
毛颖
钟张翼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou rongmeng Intelligent Technology Co., Ltd
Original Assignee
Shenzhen Dream Vision Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Dream Vision Intelligent Technology Co Ltd filed Critical Shenzhen Dream Vision Intelligent Technology Co Ltd
Priority to CN201711349896.4A priority Critical patent/CN109934929A/en
Priority to PCT/CN2018/073467 priority patent/WO2019114092A1/en
Publication of CN109934929A publication Critical patent/CN109934929A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The present embodiments relate to augmented reality fields, disclose a kind of method, apparatus of image enhancement reality, augmented reality shows equipment and terminal, wherein, the method for described image augmented reality includes: that augmented reality equipment obtains environmental information, and sends the environmental information to terminal；Terminal receives environmental information, and according to the environmental information, obtains image to be reinforced, handle the image to be reinforced, obtains enhancing image, and the enhancing image is sent to the augmented reality and shows equipment；Augmented reality shows that equipment receives the enhancing image, shows the enhancing image.In the above manner, the present embodiment can enable enhancing display display equipment be attached and interact with terminal, it is easy to use, interesting.

Description

The method, apparatus of image enhancement reality, augmented reality show equipment and terminal
Technical field
The present embodiments relate to augmented reality fields, method, dress more particularly to a kind of image enhancement reality It sets, augmented reality shows equipment and terminal.
Background technique
Augmented reality display technology is the new technology developed in recent years, is broadly divided into according to specific application virtual existing Real (Virtual Reality, VR) and two kinds of augmented reality (Augmented Reality, AR).AR technology, which refers to, utilizes calculating Machine generates entity information (such as the visual information, sound for being difficult to experience in the certain time spatial dimension of real world originally Sound, taste, tactile etc.), be user's " immersing " into the environment by various sensor devices, realize user and environment directly into Row natural interaction.
Realize that the actual situation of AR combines, user needs by mainly showing at this stage by wear-type from the point of view of certain device Show that device is realized.There are mainly two types of common head-mounted displays: one is optical perspective formula, user can be directed through eyeglass See real world, while thering is other device to project virtual image on eyeglass；Another kind is video perspective type, user It is seen that image good by computer disposal, that actual situation combines.
In realizing process of the present invention, at least there are the following problems in the related technology for inventor's discovery: existing enhancing is existing Due to needing powerful computing capability, user usually needs to wear bulky head-mounted display real display equipment, or takes Band portable computer or palm PC, outdoors using highly inconvenient.
Summary of the invention
The embodiment of the present invention is mainly solving the technical problems that provide a kind of method, apparatus of image enhancement reality, enhancing Reality display equipment and terminal enable enhancing display display equipment to be attached and interact with terminal, easy to use, interesting.
In a first aspect, being applied to augmented reality the embodiment of the invention provides a kind of method of image enhancement reality and showing Equipment, comprising: obtain environmental information, and send the environmental information to terminal；Enhancing image is received, the enhancing image is by institute It states after terminal is handled according to the environmental information and sends；Show the enhancing image.
Wherein, the method also includes:
If including the terminal in the environmental information, the position of the terminal is identified；
According to the position of the terminal, the position of the enhancing image is adjusted, does not appear in the enhancing image described In terminal.
Wherein, gesture information is obtained, and sends the gesture information to the terminal；Receive the terminal returns first Interaction enhancing image, the first interaction enhancing image is that the terminal carries out the enhancing image according to the gesture information The image obtained after adjustment；Show the first interaction enhancing image.
Wherein, the method also includes: receive the second interaction enhancing image that the terminal sends, second interaction increases Strong image is the image obtained after the terminal is adjusted the enhancing image according to control instruction.
Wherein, the display enhancing image, comprising: obtain predetermined display parameter；According to the predetermined display parameter, Adjust the display signal of the enhancing image；Show the enhancing image adjusted.
Wherein, the augmented reality shows that equipment includes camera, and the environmental information includes ambient image；The acquisition Environmental information, comprising: obtain the ambient image sent by the camera.
Wherein, the augmented reality shows that equipment further includes depth of field sensor and/or binocular camera, the environmental information It further include depth of view information；The acquisition environmental information, further includes: obtain the depth of view information, the depth of view information is by the scape Deep sensor and/or binocular camera are sent.
Wherein, the augmented reality shows that equipment further includes gyroscope, accelerometer and/or magnetometer, and the method is also Include: the variation posture for obtaining the augmented reality and showing equipment, the variation posture by the gyroscope, accelerometer and/ Or magnetometer is sent；The variation posture is sent to the terminal；Variation enhancing image is received, the variation enhancing image is by institute It states after terminal is handled according to the variation posture and sends；Show the variation enhancing image.
Wherein, in the acquisition environmental information, and before sending the environmental information to terminal, the method also includes: Receive the selection instruction of connection equipment；According to the selection instruction, terminal corresponding with the connection equipment is obtained；With the end End is attached.
Wherein, the connection equipment include: USB Type-C DP/HDMI Alt.Mode equipment, Lighting equipment, WIFI equipment or bluetooth equipment.
Second aspect, the embodiment of the invention provides a kind of devices of image enhancement reality, are applied to augmented reality and show Equipment, comprising: environment obtains module, for obtaining environmental information, and sends the environmental information to terminal；Enhance image to receive Module, for receiving enhancing image, the enhancing image is sent after being handled by the terminal according to the environmental information；Enhancing figure As display module, for showing the enhancing image.
Wherein, described device further include:
TIM terminal identification module, if identifying the position of the terminal for including the terminal in the environmental information；
Enhance image adjustment module, for the position according to the terminal, adjusts the position of the enhancing image, make described Enhancing image does not appear in the terminal.
Wherein, described device further include: gesture obtains module, for obtaining gesture information, and sends the gesture information To the terminal；First interaction figure picture receiving module, the first interaction enhancing image returned for receiving the terminal, described the One interaction enhancing image is the image obtained after the terminal is adjusted the enhancing image according to the gesture information；The One interaction figure picture display module, for showing the first interaction enhancing image.
Wherein, described device further include: the second interaction figure picture receiving module is handed over for receiving the terminal is sent second Mutually enhancing image, the second interaction enhancing image is after the terminal is adjusted the enhancing image according to control instruction Obtained image.
Wherein, the enhancing image display includes: parameter acquiring unit, for obtaining predetermined display parameter；Signal Adjustment unit, for adjusting the display signal of the enhancing image according to the predetermined display parameter；Display unit, for showing Show the enhancing image adjusted.
Wherein, the augmented reality shows that equipment includes camera, and the environmental information includes ambient image；The environment Obtaining module includes: camera unit, for obtaining the ambient image sent by the camera.
Wherein, the augmented reality shows that equipment further includes depth of field sensor and/or binocular camera, the environmental information It further include depth of view information；The environment obtains module further include: depth of field unit, for obtaining the depth of view information, the depth of field Information is sent by the depth of field sensor and/or binocular camera.
Wherein, the augmented reality shows that equipment further includes gyroscope, accelerometer and/or magnetometer, and described device is also Include: that variation posture obtains module, the variation posture of equipment is shown for obtaining the augmented reality, the variation posture is by institute Gyroscope, accelerometer and/or magnetometer is stated to send；Change posture sending module, for sending the variation posture to described Terminal；Modified-image receiving module, for receiving variation enhancing image, the variation enhancing image is as the terminal according to It is sent after variation posture processing；Modified-image display module, for showing the variation enhancing image.
Wherein, before the environment acquiring unit, described device further include: connection equipment selecting module, for receiving Connect the selection instruction of equipment；Terminal obtains module, for obtaining corresponding with the connection equipment according to the selection instruction Terminal；Terminal connecting module, for being attached with the terminal.
The third aspect, the embodiment of the invention provides a kind of augmented realities to show equipment, comprising:
At least one processor；And
The memory being connect at least one described processor communication；Wherein,
The memory is stored with the instruction that can be executed by least one described processor, and described instruction is by described at least one A processor executes, so that at least one described processor is able to carry out the side of the reality of image enhancement as described in relation to the first aspect Method.
Fourth aspect, the embodiment of the invention also provides a kind of non-volatile computer readable storage medium storing program for executing, the calculating Machine readable storage medium storing program for executing is stored with computer executable instructions, and the computer executable instructions are for enabling electronic equipment to hold The method of the image enhancement reality of row as described in relation to the first aspect.
5th aspect, the embodiment of the invention also provides a kind of computer program product, the computer program product packet The computer program being stored in non-transient computer readable storage medium is included, the computer program includes program instruction, when When described program instruction is computer-executed, the side for the image enhancement reality for executing the computer as described in relation to the first aspect Method.
6th aspect, the embodiment of the invention provides a kind of methods of image enhancement reality, are applied to terminal, comprising: connect Receive the environmental information that equipment transmission is shown by augmented reality；According to the environmental information, image to be reinforced is obtained；To described wait increase Strong image is handled, and enhancing image is obtained；It sends the enhancing image to the augmented reality and shows equipment.
Wherein, the method also includes: receive by augmented reality show equipment send gesture information；According to the gesture Information is adjusted the enhancing image, obtains the first interaction enhancing image；The first interaction enhancing image is sent to institute It states augmented reality and shows equipment.
Wherein, when the first interaction corresponding virtual objects of enhancing image and the terminal have relationship, the side Method further include: identify that the gesture information included to operation performed by the virtual objects；According to the operation, control The terminal is responded.
Wherein, the method also includes: obtain control instruction；According to the control instruction, the enhancing image is carried out Adjustment obtains the second interaction enhancing image；It sends the second interaction enhancing image to the augmented reality and shows equipment.
Wherein, the method also includes: receive by the augmented reality show equipment send variation posture；According to described Change posture, the enhancing image is adjusted, obtains variation enhancing image；Sending the variation enhances image to the increasing Strong reality display equipment.
Wherein, described that the image to be reinforced is handled, comprising: anti-distortion fortune is carried out to the image to be reinforced It calculates.
Wherein, before the environmental information for receiving and being sent by augmented reality display equipment, the method also includes: it connects It receives the augmented reality and shows the link order that equipment is sent；According to the link order, equipment is shown with the augmented reality It is attached.
7th aspect, the embodiment of the invention provides a kind of devices of image enhancement reality, are applied to terminal, comprising: ring Border receiving module, for receiving the environmental information for showing equipment transmission by augmented reality；Image collection module to be reinforced is used for root According to the environmental information, image to be reinforced is obtained；Processing module is enhanced for handling the image to be reinforced Image；Enhance image sending module, sends the enhancing image to the augmented reality and show equipment.
Wherein, described device further include: gesture receiving module, for receiving the gesture for showing equipment transmission by augmented reality Information；First swap image adjusts module, for according to the gesture information, is adjusted to the enhancing image, obtains the One interaction enhancing image；First swap image sending module, it is existing to the enhancing for sending the first interaction enhancing image Real display equipment.
Wherein, when the first interaction corresponding virtual objects of enhancing image and the terminal have relationship, the dress Set further include: gesture recognition module, for identification the gesture information included to operation performed by the virtual objects； Control module, for controlling the terminal and being responded according to the operation.
Wherein, described device further include: control instruction obtains module, for obtaining control instruction；Second interaction figure picture tune Mould preparation block obtains the second interaction enhancing image for being adjusted to the enhancing image according to the control instruction；Second Interaction figure picture sending module shows equipment for sending the second interaction enhancing image to the augmented reality.
Wherein, described device further include: variation posture receiving module shows equipment hair by the augmented reality for receiving The variation posture sent；Modified-image adjusts module, for being adjusted, obtaining to the enhancing image according to the variation posture Enhance image to variation；Modified-image sending module shows for sending variation enhancing image to the augmented reality and sets It is standby.
Wherein, the processing module includes: anti-distortion unit, for carrying out anti-distortion operation to the image to be reinforced.
Wherein, before the environment receiving module, described device further include: link order receiving module, for receiving The augmented reality shows the link order that equipment is sent；Augmented reality shows equipment link block, for according to the connection Instruction shows that equipment is attached with the augmented reality.
Eighth aspect, the embodiment of the invention provides a kind of terminals, comprising:
At least one processor；And
The memory being connect at least one described processor communication；Wherein,
The memory is stored with the instruction that can be executed by least one described processor, and described instruction is by described at least one A processor executes, so that at least one described processor is able to carry out the side of the image enhancement reality as described in terms of the 6th Method.
9th aspect, the embodiment of the invention also provides a kind of non-volatile computer readable storage medium storing program for executing, the calculating Machine readable storage medium storing program for executing is stored with computer executable instructions, and the computer executable instructions are for enabling electronic equipment to hold The method of image enhancement reality of the row as described in terms of the 6th.
Tenth aspect, the embodiment of the invention also provides a kind of computer program product, the computer program product packet The computer program being stored in non-transient computer readable storage medium is included, the computer program includes program instruction, when Described program instruction is when being computer-executed, the side for the image enhancement reality for executing the computer as described in terms of the 6th Method.
The beneficial effect of the embodiment of the present invention is: being different from the prior art, a kind of image enhancement that present embodiment provides The method of reality shows that equipment obtains environmental information by augmented reality, and sends the environmental information to terminal；Terminal receives Environmental information, and according to the environmental information, image to be reinforced is obtained, the image to be reinforced is handled, is enhanced The enhancing image is sent to the augmented reality and shows equipment by image；Augmented reality shows that equipment receives the enhancing figure Picture shows the enhancing image.In the above manner, the present embodiment can enable enhancing display display equipment carry out with terminal Connection and interaction, it is easy to use, interesting.
Detailed description of the invention
One or more embodiments are illustrated by the picture in corresponding attached drawing, these exemplary theorys The bright restriction not constituted to embodiment, the element in attached drawing with same reference numbers label are expressed as similar element, remove Non- to have special statement, composition does not limit the figure in attached drawing.
Fig. 1 is application scenarios schematic diagram provided in an embodiment of the present invention；
Fig. 2 is a kind of flow diagram of the method for image enhancement reality provided in an embodiment of the present invention；
Fig. 3 be another embodiment of the present invention provides a kind of image enhancement reality method flow diagram；
Fig. 4 is a kind of flow diagram of the method for image enhancement reality that further embodiment of this invention provides；
Fig. 5 is a kind of structural schematic diagram of the device of image enhancement reality provided in an embodiment of the present invention；
Fig. 6 is a kind of structure of the enhancing image display of the device of image enhancement reality provided in an embodiment of the present invention Schematic diagram；
Fig. 7 is the structural schematic diagram that a kind of augmented reality provided in an embodiment of the present invention shows equipment；
Fig. 8 is a kind of flow diagram of the method for image enhancement reality provided in an embodiment of the present invention；
Fig. 9 be another embodiment of the present invention provides a kind of image enhancement reality method flow diagram；
Figure 10 is a kind of flow diagram of the method for image enhancement reality that further embodiment of this invention provides；
Figure 11 is a kind of flow diagram of the method for image enhancement reality that another another embodiment of the invention provides；
Figure 12 is a kind of structural schematic diagram of the device of image enhancement reality provided in an embodiment of the present invention；
Figure 13 is a kind of structural schematic diagram of terminal provided in an embodiment of the present invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art Every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
In addition, as long as technical characteristic involved in the various embodiments of the present invention described below is each other not Constituting conflict can be combined with each other.
The present invention provides a kind of method, apparatus of image enhancement reality, augmented reality shows equipment and terminal, the method Augmented reality can be enable to show that equipment is attached and interacts with terminal with device, it is easy to use, interesting.
Fig. 1 is a kind of application scenarios schematic diagram of the embodiment of the present invention.As shown in Figure 1, augmented reality shows that equipment 10 obtains Environmental information is taken, and sends the environmental information to terminal 20；Terminal 20 receives environmental information, and is obtained according to the environmental information To enhancing image, enhancing image is sent to augmented reality and shows equipment 10；Augmented reality shows that equipment 10 receives enhancing image, Show the enhancing image.For example, it includes computer display screen that augmented reality, which shows that equipment 10 obtains in environmental information, and by environment Information is sent to terminal 20, and terminal is dummy keyboard according to the enhancing image that environmental information obtains, then augmented reality shows equipment 10 display dummy keyboards.
The method of the image enhancement reality of the embodiment of the present invention is applied to augmented reality and shows equipment, can be in any tool There is the augmented reality of processor and memory to show in equipment to execute；The method of the image enhancement reality of the embodiment of the present invention, is answered For terminal, can be executed in the terminal of the processor with user interaction means and operational capability, example in any suitable type In desktop computer, smart phone, tablet computer and other terminals.
The device of the image enhancement reality of the embodiment of the present invention, can be used as one of software or hardware capability list Member is independently arranged at above-mentioned augmented reality and shows in equipment and terminal, can also be used as one of them of integration in the processor Functional module, the method for executing the image enhancement reality of the embodiment of the present invention.
In an embodiment of the present invention, terminal can be smart phone, computer, smartwatch, Intelligent bracelet, plate electricity Brain, palm PC etc. have the electronic equipment of phonetic function.Above-mentioned terminal supports the installation of various multipads, such as One or more multipad in following multipad: instant message application program, telephony application, view Frequency application program, email application, digital video recorder application program and etc..
Specifically, taking the terminal as an example, the embodiment of the present invention is further elaborated in conjunction with attached drawing.
Embodiment one
Fig. 2 is a kind of flow diagram of the method for image enhancement reality provided in an embodiment of the present invention.Referring to Fig. 2, The method of image enhancement reality is applied to augmented reality and shows equipment, wherein the method for image enhancement reality includes:
110, environmental information is obtained, and sends the environmental information to terminal.
Above-mentioned " environmental information " includes ambient image, and ambient image is that augmented reality shows that view is currently taken pictures or shoot to equipment The image for shielding true environment obtained can determine the information of the virtual image projected in the environment by ambient image, with For user's interaction.Ambient image may include telltale mark, and telltale mark is used for by calculating analysis to position augmented reality Show the position of equipment.Augmented reality shows that equipment includes camera, and camera is for obtaining ambient image.Wherein, camera It can be colored monocular cam or high-resolution camera etc., the front end of equipment is shown set on augmented reality.When user wears When wearing augmented reality display equipment, camera is towards the other side relative to user face, to use the camera to be clapped According to.
In the present embodiment, environmental information is obtained, comprising: obtain the ambient image sent by the camera.Example Such as, user puts on augmented reality and shows equipment, and camera shoots to obtain ambient image, include in ambient image a desk and Ambient image is sent to augmented reality and shows equipment by a mobile phone being placed on desk, camera, then augmented reality is shown Equipment obtains the ambient image sent by camera.
After obtaining environmental information, augmented reality shows that environmental information is sent to terminal by equipment, in terminal to environment Information is further processed.
120, enhancing image is received, the enhancing image is sent after being handled by the terminal according to the environmental information.
Above-mentioned " enhancing image " is the virtual image being superimposed upon in true environment, and it is existing by enhancing display to enhance image Real equipment can be for seen in user.For example, if terminal is mobile phone, includes a desk in true environment and be placed on desk Mobile phone, enhancing image be the virtual screen being superimposed upon on desk.Enhancing image is sent after being handled by terminal according to environmental information Equipment is shown to augmented reality.Terminal carries out analytical calculation to environmental information, and the object in environment-identification information refers to according to user It enables or system setting, generation enhancing image is sent to augmented reality and shows equipment.
130, the enhancing image is shown.
In the present embodiment, augmented reality shows that equipment can be by two display module display enhancing images, wherein aobvious Show that module respectively corresponds the left eye and right eye of user, display module can be LCD (Liquid Crystal Display, liquid crystal Display), OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode), LCOS (Liquid Crystal On Silicon, liquid crystal on silicon) etc. types display.After augmented reality shows equipment display enhancing image, user can be seen See the virtual image being superimposed upon in true environment.For example, including a desk and placement in true environment if terminal is mobile phone Mobile phone on desk, user show that equipment sees the virtual screen being superimposed upon on desk by augmented reality.
Wherein, step 130 includes: acquisition predetermined display parameter；According to the predetermined display parameter, the enhancing figure is adjusted The display signal of picture；Show the enhancing image adjusted.
Since the display module of terminal device treated enhancing image and augmented reality display equipment is not adapted to, The adjustment to enhancing image display signal is needed before display.Above-mentioned " predetermined display parameter " is that augmented reality shows the aobvious of equipment Show parameter, may include resolution ratio, timing etc., it can be for system default or by user setting.It, will according to predetermined display parameter The display signal of enhancing image is adjusted to value identical with predetermined display parameter, and enhancing image is shown in augmented reality It is shown in equipment.For example, the resolution ratio of Huawei's mobile phone is 1920x1080, the enhancing image resolution ratio of output is also 1920x1080, augmented reality show that the resolution ratio of equipment is 2160x1920, then the resolution parameter of predetermined display parameter is 2160x1920 is 2160x1920 by the resolution adjustment of image is enhanced, then shows adjusted according to predetermined display parameter Enhance image.
The method of image enhancement reality provided in this embodiment by obtaining environmental information, and sends environmental information to end End receives the enhancing image sent after being handled by the terminal according to the environmental information；Display enhancing image, makes augmented reality Display equipment can be attached and interact with terminal, carry processor without user or the heavy wear-type augmented reality of wearing is aobvious Show equipment, the volume that augmented reality shows equipment can be greatly reduced, and easy to use, interesting.
In some embodiments, the distinctive points with above-mentioned each embodiment are, this method further include: if the environment is believed Include the terminal in breath, identifies the position of the terminal；According to the position of the terminal, the position of the enhancing image is adjusted It sets, does not appear in the enhancing image in the terminal.For example, if terminal is mobile phone, include in true environment a desk, With the mobile phone being placed on desk, enhancing image is virtual screen, and augmented reality is shown in the environmental information that equipment identification obtains Comprising mobile phone, then the position of mobile phone is obtained；Then the position of virtual screen is adjusted, virtual screen is made to be shown in desk On, user shows equipment it can be seen that mobile phone and the virtual screen being superimposed upon on desk by augmented reality.By evading enhancing Image superposition at the terminal, be able to use family using augmented reality show equipment when, can normal use terminal, to make to increase Strong reality display equipment is more humanized.In some embodiments, as shown in figure 3, existing with the distinctive points of above-mentioned each embodiment In this method further include:
141, gesture information is obtained, and sends the gesture information to the terminal；
142, the first interaction enhancing image that the terminal returns is received, the first interaction enhancing image is the terminal The image obtained after being adjusted according to the gesture information to the enhancing image；
143, the first interaction enhancing image is shown.
Wherein, above-mentioned " gesture information " is operation of the user to virtual image, such as: to the button operation of dummy keyboard, To the page turn over operation of virtual books, operation etc. is moved to virtual objects.Above-mentioned " the first interaction enhancing image " is user couple After virtual image is operated, obtained image after terminal is adjusted enhancing image according to gesture information, wherein adjustment can Think that position, size, color etc. to enhancing image are adjusted, adjustment can adjust for dynamic.Augmented reality shows equipment After gesture information is sent to terminal, terminal is adjusted enhancing image according to gesture information, obtains the first interaction figure picture and returns Equipment is shown back to augmented reality, and then augmented reality shows that equipment shows the first interaction figure picture.For example, if enhancing image is void Quasi- keyboard, user make the operation of key to dummy keyboard, then terminal makes the adjustment to lower recess to the key of dummy keyboard, The first interaction enhancing image is generated, augmented reality is returned to and shows equipment, then user sees that the key of dummy keyboard is pressed.It is logical It crosses and enhances the interactivity that augmented reality shows equipment with upper type, improve user experience.
In some embodiments, as shown in figure 4, being with the distinctive points of above-mentioned each embodiment, this method further include:
150, the second interaction enhancing image that the terminal is sent is received, the second interaction enhancing image is the terminal The image obtained after being adjusted according to control instruction to the enhancing image.
Wherein, above-mentioned " the second interaction enhancing image " is the control instruction of the terminal of user's triggering, makes terminal according to control Instruction is adjusted enhancing image, obtained enhancing image.Above-mentioned " control instruction " is that terminal is distributed out according to relevant operation For executing the instruction of enhancing Image Adjusting operation, wherein relevant operation can be soft operation or hard operation, and soft operation can be with Being electronic equipment exports trigger signal according to preparatory logic, hard operation can be external operated to the related hardware of terminal and Terminal is set to distribute control instruction out, for example, it may be the touch operation that user carries out in the touch screen of terminal, can be to terminal Key carry out operation, can also make shake terminal, rotation terminal, and etc..For example, being superimposed virtual screen on the table The enhancing image of curtain, user show the second mobile friendship of screen cursor against virtual screen cell phone, then on virtual screen Mutually enhancing image.In the above manner, can be interacted by terminal and enhancing image, interactive mode is enriched, is increased Interest.
In some embodiments, augmented reality shows that equipment can also include depth of field sensor and/or binocular camera, ring Border information further includes depth of view information；Step 110 further include: obtain the depth of view information, the depth of view information is passed by the depth of field Sensor and/or binocular camera are sent.Wherein, depth of view information is the depth of field in the ambient image of augmented reality display equipment acquisition Data.It can be shown in augmented reality and depth of field sensor is set in equipment, directly obtain the depth of field data in ambient image；Or Person can show in augmented reality and binocular camera is arranged in equipment, and binocular camera can be monochromatic or colored camera, By calculating the depth of field data obtained in ambient image.Depth of view information can be used for calculating augmented reality show equipment posture or Person captures the gesture of user for interaction etc..By obtaining depth of view information, make to enhance position of the image superposition in true environment It is more accurate to set, and improves the usage experience of user.
In some embodiments, augmented reality show equipment can also include gyroscope, accelerometer and/or magnetometer, This method further include: obtain the variation posture that the augmented reality shows equipment, the variation posture is by the gyroscope, acceleration Degree meter and/or magnetometer are sent；The variation posture is sent to the terminal；Receive variation enhancing image, the variation enhancing Image is sent after being handled by the terminal according to the variation posture；Show the variation enhancing image.
Wherein, above-mentioned " variation posture " includes rotational angle and/or displacement that augmented reality shows equipment, passes through camera It is able to carry out Three Degree Of Freedom or the six degree of freedom positioning of equipment with gyroscope, accelerometer and/or magnetometer, that is, obtains equipment Rotational angle and/or displacement are shown for example, being counted by gyro data, accelerometer data and magnetic field and carrying out augmented reality The Three Degree Of Freedom positioning for showing equipment, alternatively, being counted by camera data, gyro data, accelerometer data and magnetic field Fusion carries out the six degree of freedom positioning that augmented reality shows equipment.Above-mentioned " variation enhancing image " is to show to set in augmented reality For the enhancing image that after attitudes vibration, terminal is regenerated.After obtaining the variation posture that augmented reality shows equipment, appearance will be changed State is sent to terminal, so that terminal is handled enhancing image according to variation posture, variation enhancing image is obtained, thus increasing Strong reality display equipment variations enhance image.For example, user puts on augmented reality and shows equipment if enhancing image is dummy keyboard Afterwards, the front for seeing dummy keyboard, when user's rotary head is eyed left, augmented reality shows that equipment obtains the variation posture of equipment simultaneously It is sent to terminal, terminal generates variation enhancing image according to attitudes vibration and returns to augmented reality display equipment, and user passes through increasing Strong reality display equipment it can be seen that dummy keyboard left side.
In some embodiments, prior to step 110, this method further include: receive the selection instruction of connection equipment；According to The selection instruction obtains terminal corresponding with the connection equipment；It is attached with the terminal.
Wherein, above-mentioned " connection equipment " is the equipment that augmented reality shows that equipment and terminal are attached, and connection equipment can To include but is not limited to: USB Type-CDP/HDMI Alt.Mode equipment, Lighting equipment, WIFI equipment or bluetooth are set It is standby.Above-mentioned " selection instruction of connection equipment " is user's equipment selected to use for showing that equipment is attached with augmented reality. For example, augmented reality is shown that equipment connects iPhone by Lighting equipment by user, i.e. user has selected Lighting Equipment, then augmented reality shows that equipment receives the selection instruction of connection equipment.According to selection instruction, augmented reality shows that equipment obtains Terminal corresponding with connection equipment is taken, is then attached with the terminal.After augmented reality shows that equipment and terminal are attached, To carry out the data communication between augmented reality display equipment and terminal.
Embodiment two
Fig. 5 is a kind of structural schematic diagram of the device of image enhancement reality provided in an embodiment of the present invention.As shown in figure 5, The device 200 of image enhancement reality is applied to augmented reality and shows equipment, wherein the device 200 of image enhancement reality wraps It includes environment and obtains module 210, enhancing image receiver module 220 and enhancing image display 230.Environment obtains module 210 and uses In acquisition environmental information, and the environmental information is sent to terminal；Enhancing image receiver module 220 enhances image for receiving, The enhancing image is sent after being handled by the terminal according to the environmental information；Enhancing image display 230 is for showing The enhancing image.
Since Installation practice and embodiment of the method under the premise of content does not conflict mutually, are filled based on same design The content for setting embodiment can be with quoting method embodiment, and this will not be repeated here.
The device 200 of image enhancement reality in the present embodiment obtains module 210 by environment and obtains environmental information, concurrently It send environmental information to terminal, enhances after the reception of image receiver module 220 is handled by the terminal according to the environmental information and send Enhancing image；Enhance the display enhancing image of image display 230, augmented reality is enable to show that equipment is connected with terminal It connects and interacts, carry processor without user or wear heavy wear-type augmented reality display equipment, enhancing can be greatly reduced The volume of reality display equipment, and it is easy to use, interesting.
Optionally, the device 200 of image enhancement reality further include: TIM terminal identification module, if in the environmental information Comprising the terminal, the position of the terminal is identified；
Enhance image adjustment module, for the position according to the terminal, adjusts the position of the enhancing image, make described Enhancing image does not appear in the terminal.
Optionally, the device 200 of image enhancement reality further include: gesture obtains module, for obtaining gesture information, concurrently Send the gesture information to the terminal；First interaction figure picture receiving module, the first interaction returned for receiving the terminal Enhance image, the first interaction enhancing image is that the terminal is adjusted the enhancing image according to the gesture information The image obtained afterwards；First interaction figure picture display module, for showing the first interaction enhancing image.
Optionally, the device 200 of institute's image enhancement reality further include: the second interaction figure picture receiving module, for receiving The second interaction enhancing image that terminal is sent is stated, the second interaction enhancing image is for the terminal according to control instruction to described The image that enhancing image obtains after being adjusted.
Optionally, as shown in fig. 6, the enhancing image display 230 includes: parameter acquiring unit 231, for obtaining Predetermined display parameter, signal adjustment unit 232, for adjusting the display of the enhancing image according to the predetermined display parameter Signal；Display unit 233, for showing the enhancing image adjusted.
Optionally, the augmented reality shows that equipment includes camera, and the environmental information includes ambient image；The ring It includes: camera unit that border, which obtains module 210, for obtaining the ambient image sent by the camera.
Optionally, the augmented reality shows that equipment further includes depth of field sensor and/or binocular camera, the environment letter Breath further includes depth of view information；The environment obtains module 210 further include: depth of field unit, it is described for obtaining the depth of view information Depth of view information is sent by the depth of field sensor and/or binocular camera.
Optionally, the augmented reality shows that equipment further includes gyroscope, accelerometer and/or magnetometer, image enhancement The device 200 of reality further include: variation posture obtains module, and the variation posture of equipment is shown for obtaining the augmented reality, The variation posture is sent by the gyroscope, accelerometer and/or magnetometer；Change posture sending module, for sending Variation posture is stated to the terminal；Modified-image receiving module, for receiving variation enhancing image, the variation enhance image by The terminal is sent after being handled according to the variation posture；Modified-image display module, for showing the variation enhancing image.
Optionally, before the environment acquiring unit 210, the device 200 of image enhancement reality further include: connection equipment Selecting module, for receiving the selection instruction of connection equipment；Terminal obtains module, for according to the selection instruction, obtain with The corresponding terminal of the connection equipment；Terminal connecting module, for being attached with the terminal.
Embodiment three
Fig. 7 is the structural schematic diagram that a kind of augmented reality provided in an embodiment of the present invention shows equipment.As shown in fig. 7, should Augmented reality shows that equipment 30 includes one or more processors 301 and memory 302.Wherein, with a processor in Fig. 7 For 301.
Processor 301 can be connected with memory 302 by bus or other modes, to be connected by bus in Fig. 7 For.
Memory 302 is used as a kind of non-volatile computer readable storage medium storing program for executing, can be used for storing non-volatile software journey Sequence, non-volatile computer executable program and module, the method such as the image enhancement reality in the embodiment of the present invention are corresponding Program instruction/module (for example, attached drawing 5, modules shown in fig. 6 or unit).Processor 301 is stored in by operation Non-volatile software program, instruction and module in reservoir 302, thereby executing the various functions of the device of image enhancement reality Using and data processing, that is, realize one image enhancement of above method embodiment reality method and above-mentioned apparatus embodiment two Modules and unit function.
Memory 302 may include high-speed random access memory, can also include nonvolatile memory, for example, at least One disk memory, flush memory device or other non-volatile solid state memory parts.In some embodiments, memory 302 Optional includes the memory remotely located relative to processor 301, these remote memories can pass through network connection to processing Device 301.The example of above-mentioned network includes but is not limited to internet, intranet, local area network, mobile radio communication and combinations thereof.
Described program instruction/module is stored in the memory 302, when by one or more of processors 301 When execution, the method for executing the image enhancement reality in above-mentioned any means embodiment, for example, executing Fig. 1 described above extremely Each step shown in Fig. 4；It can also realize the function of attached drawing 5, modules shown in fig. 6 or unit.
The embodiment of the invention also provides a kind of nonvolatile computer storage media, the computer storage medium storage There are computer executable instructions, which is executed by one or more processors, such as at one in Fig. 7 Device 301 is managed, may make said one or multiple processors that the image enhancement reality in above-mentioned any means embodiment can be performed Method, for example, the method for executing the image enhancement reality in above method embodiment one, for example, executing Fig. 1 described above extremely Each step shown in Fig. 4；It can also realize the function of attached drawing 5, modules shown in fig. 6 or unit.
Example IV
Fig. 8 is a kind of flow diagram of the method for image enhancement reality provided in an embodiment of the present invention.As shown in figure 8, The method of image enhancement reality is applied to terminal, wherein the method for image enhancement reality includes:
410, the environmental information that equipment transmission is shown by augmented reality is received.
Above-mentioned " environmental information " is that augmented reality shows that screen true environment obtained is currently taken pictures or shoot to equipment Image can show that the camera of equipment is obtained by augmented reality, then show that equipment is sent to terminal by augmented reality.
420, according to the environmental information, image to be reinforced is obtained.
Above-mentioned " image to be reinforced " is terminal according to environment information acquisition or the virtual image model of generation, virtual image Model needs just obtain enhancing image by processing.Image to be reinforced can be obtained by terminal from the database in memory It takes, can perhaps be obtained from network or can also be by carrying out wireless transmission acquisition etc. with other equipment.According to environment Information, obtains image to be reinforced, and specific embodiment may is that terminal is received and show that the environment that equipment is sent is believed by augmented reality It ceases, the object in terminal recognition environmental information, from the virtual graph for obtaining one with the object matches in environmental information in database As model, then image to be reinforced is obtained.For example, terminal receives the environmental information for showing equipment transmission by augmented reality, the environment Information includes a desk and a book being placed on desk, and terminal identifies book, and virtual steel is obtained from database Model, then virtual pen model is image to be reinforced.
430, the image to be reinforced is handled, obtains enhancing image.
Above-mentioned " enhancing image " is the virtual image being superimposed upon in true environment, and it is existing by enhancing display to enhance image Real equipment can be for seen in user.Image to be reinforced is handled, comprising: anti-distortion fortune is carried out to the image to be reinforced It calculates.Augmented reality shows that equipment generally requires big field angle to improve the feeling of immersion of user, but bigger field angle, Jiu Huizao The pattern distortion of Cheng Yue great.If not carrying out anti-distortion operation to image to be reinforced, obtained enhancing image is shown in augmented reality Display effect can occur the deformation such as to squeeze, stretch, deviate and distort in equipment, and therefore, it is necessary to handle to treat increasing by anti-distortion Strong image is corrected, so as to show that equipment can show the image of normal vision effect in augmented reality.Wherein, anti-distortion fortune The process of calculation can be with are as follows: image to be reinforced is pre-processed, pretreatment includes smooth threshold transformation, refinement etc., then to Mesh point is extracted in enhancing image, obtains deformation net lattice point；According to preset standard mesh point and deformation net lattice point, deformation net is obtained Coordinate shift amount of the lattice point relative to preset standard mesh point；Finally warp mesh point is adjusted according to coordinate shift amount, Image after obtaining distortion correction.
In some other embodiments, image to be reinforced is handled, can also include: that ash is carried out to image to be reinforced Spend interpolation processing, image coding etc., can the effect according to the needs of users with city picture selected.
440, it sends the enhancing image to the augmented reality and shows equipment.
After obtaining enhancing image, terminal will enhance image and be sent to augmented reality display equipment, to show in augmented reality Enhancing image is shown in equipment.
The method of image enhancement reality in the present embodiment shows that the environment that equipment is sent is believed by augmented reality by receiving Breath；According to environmental information, image to be reinforced is obtained；Image to be reinforced is handled, enhancing image is obtained；Send enhancing image Equipment is shown to augmented reality, so that augmented reality is shown that equipment is attached and interacts with terminal, is enriched the function of terminal Can, and carry processor without user or wear heavy wear-type augmented reality and show equipment, it is existing that enhancing can be greatly reduced The volume of real display equipment, and it is easy to use, interesting.
In some embodiments, as shown in figure 9, being with the distinctive points of above-mentioned each embodiment, this method further include:
451, the gesture information that equipment transmission is shown by augmented reality is received；
452, according to the gesture information, the enhancing image is adjusted, obtains the first interaction enhancing image；
453, it sends the first interaction enhancing image to the augmented reality and shows equipment.
Wherein, above-mentioned " gesture information " is operation of the user to virtual image, and above-mentioned " the first interaction enhancing image " is to use After family operates virtual image, obtained image after terminal is adjusted enhancing image according to gesture information.According to institute Gesture information is stated, the enhancing image is adjusted, specific embodiment can be with are as follows: receives augmented reality and shows that equipment is sent Gesture information after, terminal carries out feature identification to gesture information, corresponding adjustment instruction is identified according to feature, to enhancing image Image procossing is carried out, the first interaction enhancing image is obtained.In the above manner, the interaction that augmented reality shows equipment can be enhanced Effect effectively improves user experience.
In some embodiments, as shown in Figure 10, the distinctive points with above-mentioned each embodiment are, when first interaction When enhancing the corresponding virtual objects of image and the terminal with relationship, this method further include:
461, identify that the gesture information included to operation performed by the virtual objects；
462, it according to the operation, controls the terminal and is responded.
Wherein, above-mentioned " the first interaction corresponding virtual objects of enhancing image and terminal have relationship " is when user's operation the When one interaction enhances the virtual objects in image, terminal should generate corresponding variation.For example, if the first interaction enhancing image pair The virtual objects answered are virtual screen touch pen for operating terminal screen, when user is when terminal screen operates virtual screen touch pen, The screen of terminal should generate corresponding variation, then the corresponding virtual objects of the first interaction enhancing image and terminal have relationship. In another example if the corresponding virtual objects of the first interaction enhancing image are virtual mobile phone keyboard, when user's operation virtual mobile phone keyboard When, terminal should respond the input of keyboard, then the corresponding virtual objects of the first interaction enhancing image and terminal have relationship.According to The operation controls the terminal and is responded, and specific embodiment can be with are as follows: and terminal carries out feature identification to gesture information, Identification gesture information included to operation performed by virtual objects after, generate corresponding operation instruction, according to operational order, Controlling terminal is responded.For example, if the first exchange enhancing image is virtual mobile phone keyboard, when user is on virtual mobile phone keyboard When key-press input " a ", terminal is to, to the button operation of virtual mobile phone keyboard, generation corresponding operation refers in identification gesture information It enables, according to operational order, shows " a " on the screen of controlling terminal.In the above manner, enriching the function of terminal, improve Interactive interest.
In some embodiments, as shown in figure 11, the distinctive points with above-mentioned each embodiment are, this method further include:
471, control instruction is obtained；
472, according to the control instruction, the enhancing image is adjusted, obtains the second interaction enhancing image；
473, it sends the second interaction enhancing image to the augmented reality and shows equipment.
Wherein, above-mentioned " control instruction " is that terminal is distributed out according to relevant operation for executing enhancing Image Adjusting operation Instruction, wherein relevant operation can be electronic equipment and be exported according to preparatory logic for soft operation or hard operation, soft operation Trigger signal, hard operation can be outside and operated to the related hardware of terminal and terminal is made to distribute control instruction out, for example, It can be the touch operation that user carries out in the touch screen of terminal, can be the operation of the key progress to terminal, can also make It shakes terminal, rotate terminal, and etc..Above-mentioned " the second interaction enhancing image " is the control instruction of the terminal of user's triggering, It is adjusted terminal to enhancing image according to control instruction, obtained enhancing image.For example, being superimposed virtual screen on the table The enhancing image of curtain, user then obtain the mobile control instruction of cursor against virtual screen cell phone, according to control instruction, Terminal carries out position adjustment to the virtual cursor in enhancing image, obtains the second mobile interaction enhancing image of screen cursor, so The second interaction enhancing image is sent to augmented reality afterwards and shows equipment.In the above manner, can be schemed by terminal and enhancing As interacting, interactive mode is enriched, interest is added.
In some embodiments, the distinctive points with above-mentioned each embodiment are, this method further include: receive by the increasing The variation posture that strong reality display equipment is sent；According to the variation posture, the enhancing image is adjusted, is changed Enhance image；Sending the variation enhances image to augmented reality display equipment.
In some embodiments, the distinctive points with above-mentioned each embodiment are that before step 410, this method is also wrapped It includes: receiving the augmented reality and show the link order that equipment is sent；According to the link order, shown with the augmented reality Equipment is attached.
Embodiment five
Figure 12 is a kind of structural schematic diagram of the device of image enhancement reality provided in an embodiment of the present invention.Such as Figure 12 institute Show, the device 500 of image enhancement reality is applied to terminal, wherein the device 500 of image enhancement reality includes: that environment connects Receive module 510, image collection module to be reinforced 520, processing module 530 and enhancing image sending module 540.Environment receiving module 510 are shown the environmental information of equipment transmission for receiving by augmented reality；Image collection module 520 to be reinforced is used for according to Environmental information obtains image to be reinforced；Processing module 530 obtains enhancing image for handling the image to be reinforced； Enhancing image sending module 540 sends the enhancing image to the augmented reality and shows equipment.
Since Installation practice and embodiment of the method under the premise of content does not conflict mutually, are filled based on same design The content for setting embodiment can be with quoting method embodiment, and this will not be repeated here.
The device 500 of image enhancement reality in the present embodiment is received by environment receiving module 510 and is shown by augmented reality Show the environmental information that equipment is sent；Image collection module 520 to be reinforced obtains image to be reinforced according to environmental information；Handle mould Block 530 handles image to be reinforced, obtains enhancing image；Enhance image sending module 540 and sends enhancing image to enhancing Reality display equipment, enables augmented reality to show that equipment is attached and interacts with terminal, enriches the function of terminal, and Processor is carried without user or wears heavy wear-type augmented reality and shows equipment, can be greatly reduced augmented reality and is shown and sets Standby volume, and it is easy to use, interesting.
Optionally, the device 500 of image enhancement reality further include: gesture receiving module is shown for receiving by augmented reality Show the gesture information that equipment is sent；First swap image adjusts module, is used for according to the gesture information, to the enhancing image It is adjusted, obtains the first interaction enhancing image；First swap image sending module, for sending the first interaction enhancing figure As showing equipment to the augmented reality.
Optionally, when the first interaction corresponding virtual objects of enhancing image and the terminal have relationship, image The device 500 of augmented reality further include: gesture recognition module, for identification the gesture information included to the virtual object Operation performed by product；Control module, for controlling the terminal and being responded according to the operation.
Optionally, the device 500 of image enhancement reality further include: control instruction obtains module, for obtaining control instruction； Second interaction figure picture adjusts module, for being adjusted to the enhancing image according to the control instruction, obtains the second interaction Enhance image；Second interaction figure picture sending module is shown for sending the second interaction enhancing image to augmented reality Equipment.
Optionally, the device 500 of image enhancement reality further include: variation posture receiving module, for receiving by the increasing The variation posture that strong reality display equipment is sent；Modified-image adjusts module, is used for according to the variation posture, to the enhancing Image is adjusted, and obtains variation enhancing image；Modified-image sending module enhances image to described for sending the variation Augmented reality shows equipment.
Optionally, processing module 530 includes: anti-distortion unit, for carrying out anti-distortion operation to the image to be reinforced.
Optionally, before environment receiving module, the device 500 of image enhancement reality further include: link order receives mould Block shows the link order of equipment transmission for receiving the augmented reality；Augmented reality shows equipment link block, is used for root According to the link order, show that equipment is attached with the augmented reality.
Embodiment six
Figure 13 is a kind of structural schematic diagram of terminal provided in an embodiment of the present invention.As shown in figure 13, which includes One or more processors 601 and memory 602.Wherein, in Figure 13 by taking a processor 601 as an example.
Processor 601 can be connected with memory 602 by bus or other modes, to be connected by bus in Figure 13 For.
Memory 602 is used as a kind of non-volatile computer readable storage medium storing program for executing, can be used for storing non-volatile software journey Sequence, non-volatile computer executable program and module, the method such as the image enhancement reality in the embodiment of the present invention are corresponding Program instruction/module (for example, modules shown in attached drawing 12 or unit).Processor 601 is stored in storage by operation Non-volatile software program, instruction and module in device 602, the various functions thereby executing the device of image enhancement reality are answered With and data processing, i.e. the method and above-mentioned apparatus embodiment five of realization four image enhancement of above method embodiment reality The function of modules and unit.
Memory 602 may include high-speed random access memory, can also include nonvolatile memory, for example, at least One disk memory, flush memory device or other non-volatile solid state memory parts.In some embodiments, memory 602 Optional includes the memory remotely located relative to processor 601, these remote memories can pass through network connection to processing Device 601.The example of above-mentioned network includes but is not limited to internet, intranet, local area network, mobile radio communication and combinations thereof.
Described program instruction/module is stored in the memory 602, when by one or more of processors 601 When execution, the method for executing the image enhancement reality in above-mentioned any means embodiment, for example, executing Fig. 8 described above extremely Each step shown in Figure 11；It can also realize the function of modules shown in attached drawing 12 or unit.
The embodiment of the invention also provides a kind of nonvolatile computer storage media, the computer storage medium storage There are computer executable instructions, which is executed by one or more processors, such as one in Figure 13 Processor 601 may make said one or multiple processors that the image enhancement reality in above-mentioned any means embodiment can be performed Method, for example, execute above method embodiment four in image enhancement reality method, for example, executing Fig. 8 described above To each step shown in Figure 11；It can also realize the function of modules or unit shown in Figure 12.
Device or apparatus embodiments described above is only schematical, wherein it is described as illustrated by the separation member Unit module may or may not be physically separated, and the component shown as modular unit can be or can also Not to be physical unit, it can it is in one place, or may be distributed on multiple network module units.It can basis It is actual to need that some or all of the modules therein is selected to achieve the purpose of the solution of this embodiment.
Through the above description of the embodiments, those skilled in the art can be understood that each embodiment can It is realized by the mode of software plus general hardware platform, naturally it is also possible to pass through hardware.Based on this understanding, above-mentioned technology Scheme substantially in other words can be embodied in the form of software products the part that the relevant technologies contribute, the computer Software product may be stored in a computer readable storage medium, such as ROM/RAM, magnetic disk, CD, including some instructions are with directly To computer equipment (can be personal computer, server or the network equipment etc.) execute each embodiment or Method described in certain parts of embodiment.
Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；At this It under the thinking of invention, can also be combined between the technical characteristic in above embodiments or different embodiment, step can be with It is realized with random order, and there are many other variations of different aspect present invention as described above, for simplicity, they do not have Have and is provided in details；Although the present invention is described in detail referring to the foregoing embodiments, the ordinary skill people of this field Member is it is understood that it is still possible to modify the technical solutions described in the foregoing embodiments, or to part of skill Art feature is equivalently replaced；And these are modified or replaceed, each reality of the present invention that it does not separate the essence of the corresponding technical solution Apply the range of a technical solution.

Claims (37)

1. a kind of method of image enhancement reality is applied to augmented reality and shows equipment characterized by comprising
Environmental information is obtained, and sends the environmental information to terminal；
Enhancing image is received, the enhancing image is sent after being handled by the terminal according to the environmental information；
Show the enhancing image.
2. the method according to claim 1, wherein the method also includes:
Gesture information is obtained, and sends the gesture information to the terminal；
The first interaction enhancing image that the terminal returns is received, the first interaction enhancing image is the terminal according to The image that gesture information obtains after being adjusted to the enhancing image；
Show the first interaction enhancing image.
3. the method according to claim 1, wherein the method also includes:
The second interaction enhancing image that the terminal is sent is received, the second interaction enhancing image is the terminal according to control Instruct the image obtained after being adjusted to the enhancing image.
4. the method according to claim 1, wherein the display enhancing image, comprising:
Obtain predetermined display parameter；
According to the predetermined display parameter, the display signal of the enhancing image is adjusted；
Show the enhancing image adjusted.
5. the method according to claim 1, wherein the method also includes:
If including the terminal in the environmental information, the position of the terminal is identified；
According to the position of the terminal, the position of the enhancing image is adjusted, the enhancing image is made not appear in the terminal On.
6. the method according to claim 1, wherein the augmented reality show equipment include camera, it is described Environmental information includes ambient image；
The acquisition environmental information, comprising:
Obtain the ambient image sent by the camera.
7. according to the method described in claim 5, it is characterized in that, the augmented reality shows that equipment further includes depth of field sensor And/or binocular camera, the environmental information further include depth of view information；
The acquisition environmental information, further includes:
The depth of view information is obtained, the depth of view information is sent by the depth of field sensor and/or binocular camera.
8. the method according to claim 1, wherein the augmented reality shows that equipment further includes gyroscope, adds Speedometer and/or magnetometer,
The method also includes:
Obtain the variation posture that the augmented reality shows equipment, the variation posture by the gyroscope, accelerometer and/or Magnetometer is sent；
The variation posture is sent to the terminal；
Variation enhancing image is received, the variation enhancing image is sent after being handled by the terminal according to the variation posture；
Show the variation enhancing image.
9. method according to claim 1-8, which is characterized in that in the acquisition environmental information, and send institute Before stating environmental information to terminal, the method also includes:
Receive the selection instruction of connection equipment；
According to the selection instruction, terminal corresponding with the connection equipment is obtained；
It is attached with the terminal.
10. according to the method described in claim 9, it is characterized in that, the connection equipment includes: USB Type-C DP/HDM I A l t.Mode equipment, Li ght i ng equipment, WI F I equipment or bluetooth equipment.
11. a kind of device of image enhancement reality is applied to augmented reality and shows equipment characterized by comprising
Environment obtains module, for obtaining environmental information, and sends the environmental information to terminal；
Enhance image receiver module, for receiving enhancing image, the enhancing image is by the terminal according to the environmental information It is sent after processing；
Enhance image display, for showing the enhancing image.
12. device according to claim 11, which is characterized in that described device further include:
Gesture obtains module, for obtaining gesture information, and sends the gesture information to the terminal；
First interaction figure picture receiving module, the first interaction enhancing image returned for receiving the terminal, first interaction Enhancing image is the image obtained after the terminal is adjusted the enhancing image according to the gesture information；
First interaction figure picture display module, for showing the first interaction enhancing image.
13. device according to claim 11, which is characterized in that described device further include:
Second interaction figure picture receiving module, the second interaction enhancing image sent for receiving the terminal, second interaction Enhancing image is the image obtained after the terminal is adjusted the enhancing image according to control instruction.
14. device according to claim 11, which is characterized in that the enhancing image display includes:
Parameter acquiring unit, for obtaining predetermined display parameter；
Signal adjustment unit, for adjusting the display signal of the enhancing image according to the predetermined display parameter；
Display unit, for showing the enhancing image adjusted.
15. device according to claim 11, which is characterized in that described device further include:
TIM terminal identification module, if identifying the position of the terminal for including the terminal in the environmental information；
Enhance image adjustment module, for the position according to the terminal, adjusts the position of the enhancing image, make the enhancing Image does not appear in the terminal.
16. device according to claim 11, which is characterized in that the augmented reality shows that equipment includes camera, institute Stating environmental information includes ambient image；
The environment obtains module
Camera unit, for obtaining the ambient image sent by the camera.
17. device according to claim 16, which is characterized in that the augmented reality shows that equipment further includes depth of field sensing Device and/or binocular camera, the environmental information further include depth of view information；
The environment obtains module further include:
Depth of field unit, for obtaining the depth of view information, the depth of view information is by the depth of field sensor and/or binocular camera It sends.
18. device according to claim 11, which is characterized in that the augmented reality show equipment further include gyroscope, Accelerometer and/or magnetometer,
Described device further include:
Change posture and obtain module, the variation posture of equipment is shown for obtaining the augmented reality, the variation posture is by institute Gyroscope, accelerometer and/or magnetometer is stated to send；
Change posture sending module, for sending the variation posture to the terminal；
Modified-image receiving module, for receiving variation enhancing image, the variation enhancing image is as the terminal according to It is sent after variation posture processing；
Modified-image display module, for showing the variation enhancing image.
19. the described in any item devices of 1-18 according to claim 1, which is characterized in that before the environment acquiring unit, institute State device further include:
Equipment selecting module is connected, for receiving the selection instruction of connection equipment；
Terminal obtains module, for obtaining terminal corresponding with the connection equipment according to the selection instruction；
Terminal connecting module, for being attached with the terminal.
20. a kind of augmented reality shows equipment characterized by comprising
At least one processor；And
The memory being connect at least one described processor communication；Wherein,
The memory is stored with the instruction that can be executed by least one described processor, and described instruction is by described at least one It manages device to execute, so that at least one described processor is able to carry out described in any item methods of claim 1-10.
21. a kind of non-volatile computer readable storage medium storing program for executing, the computer-readable recording medium storage have computer that can hold Row instruction, the computer executable instructions are for making augmented reality show that equipment is able to carry out any one of claim 1-10 institute The method stated.
22. a kind of method of image enhancement reality is applied to terminal characterized by comprising
Receive the environmental information that equipment transmission is shown by augmented reality；
According to the environmental information, image to be reinforced is obtained；
The image to be reinforced is handled, enhancing image is obtained；
It sends the enhancing image to the augmented reality and shows equipment.
23. according to the method for claim 22, which is characterized in that the method also includes:
Receive the gesture information that equipment transmission is shown by augmented reality；
According to the gesture information, the enhancing image is adjusted, obtains the first interaction enhancing image；
It sends the first interaction enhancing image to the augmented reality and shows equipment.
24. according to the method for claim 23, which is characterized in that when the corresponding virtual object of the first interaction enhancing image When product and the terminal have relationship, the method also includes:
Identify that the gesture information included to operation performed by the virtual objects；
According to the operation, controls the terminal and responded.
25. according to the method for claim 22, which is characterized in that the method also includes:
Obtain control instruction；
According to the control instruction, the enhancing image is adjusted, obtains the second interaction enhancing image；
It sends the second interaction enhancing image to the augmented reality and shows equipment.
26. according to the method for claim 22, which is characterized in that the method also includes:
Receive the variation posture that equipment transmission is shown by the augmented reality；
According to the variation posture, the enhancing image is adjusted, obtains variation enhancing image；
Sending the variation enhances image to augmented reality display equipment.
27. according to the described in any item methods of claim 22-26, which is characterized in that described to be carried out to the image to be reinforced Processing, comprising:
Anti- distortion operation is carried out to the image to be reinforced.
28. according to the method for claim 27, which is characterized in that show what equipment was sent by augmented reality in described receive Before environmental information, the method also includes:
It receives the augmented reality and shows the link order that equipment is sent；
According to the link order, show that equipment is attached with the augmented reality.
29. a kind of device of image enhancement reality is applied to terminal characterized by comprising
Environment receiving module, for receiving the environmental information for showing equipment transmission by augmented reality；
Image collection module to be reinforced, for obtaining image to be reinforced according to the environmental information；
Processing module obtains enhancing image for handling the image to be reinforced；
Enhance image sending module, sends the enhancing image to the augmented reality and show equipment.
30. device according to claim 29, which is characterized in that described device further include:
Gesture receiving module, for receiving the gesture information for showing equipment transmission by augmented reality；
First swap image adjusts module, for being adjusted to the enhancing image, obtaining first according to the gesture information Interaction enhancing image；
First swap image sending module shows equipment for sending the first interaction enhancing image to the augmented reality.
31. device according to claim 30, which is characterized in that when the corresponding virtual object of the first interaction enhancing image When product and the terminal have relationship, described device further include:
Gesture recognition module, for identification the gesture information included to operation performed by the virtual objects；
Control module, for controlling the terminal and being responded according to the operation.
32. device according to claim 29, which is characterized in that described device further include:
Control instruction obtains module, for obtaining control instruction；
Second interaction figure picture adjusts module, for being adjusted to the enhancing image, obtaining second according to the control instruction Interaction enhancing image；
Second interaction figure picture sending module shows equipment for sending the second interaction enhancing image to the augmented reality.
33. device according to claim 29, which is characterized in that described device further include:
Change posture receiving module, for receiving the variation posture for showing equipment transmission by the augmented reality；
Modified-image adjusts module, for being adjusted to the enhancing image according to the variation posture, obtains variation enhancing Image；
Modified-image sending module enhances image to augmented reality display equipment for sending the variation.
34. according to the described in any item devices of claim 29-33, which is characterized in that the processing module includes:
Anti- distortion unit, for carrying out anti-distortion operation to the image to be reinforced.
35. device according to claim 34, which is characterized in that before the environment receiving module, described device is also Include:
Link order receiving module shows the link order of equipment transmission for receiving the augmented reality；
Augmented reality shows equipment link block, for showing that equipment is carried out with the augmented reality according to the link order Connection.
36. a kind of terminal characterized by comprising
At least one processor；And
The memory being connect at least one described processor communication；Wherein,
The memory is stored with the instruction that can be executed by least one described processor, and described instruction is by described at least one It manages device to execute, so that at least one described processor is able to carry out described in any item methods of claim 22-28.
37. a kind of non-volatile computer readable storage medium storing program for executing, the computer-readable recording medium storage have computer that can hold Row instruction, the computer executable instructions are for making augmented reality show that equipment is able to carry out any one of claim 22-28 The method.
CN201711349896.4A 2017-12-15 2017-12-15 The method, apparatus of image enhancement reality, augmented reality show equipment and terminal Pending CN109934929A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201711349896.4A CN109934929A (en) 2017-12-15 2017-12-15 The method, apparatus of image enhancement reality, augmented reality show equipment and terminal
PCT/CN2018/073467 WO2019114092A1 (en) 2017-12-15 2018-01-19 Image augmented reality method and apparatus, and augmented reality display device and terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711349896.4A CN109934929A (en) 2017-12-15 2017-12-15 The method, apparatus of image enhancement reality, augmented reality show equipment and terminal

Publications (1)

Publication Number Publication Date
CN109934929A true CN109934929A (en) 2019-06-25

Family

ID=66819885

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711349896.4A Pending CN109934929A (en) 2017-12-15 2017-12-15 The method, apparatus of image enhancement reality, augmented reality show equipment and terminal

Country Status (2)

Country Link
CN (1) CN109934929A (en)
WO (1) WO2019114092A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110531847A (en) * 2019-07-26 2019-12-03 中国人民解放军军事科学院国防科技创新研究院 A kind of novel social contact method and system based on augmented reality
CN113377203A (en) * 2021-07-05 2021-09-10 浙江商汤科技开发有限公司 Augmented reality display method and related device
CN114063778A (en) * 2021-11-17 2022-02-18 北京蜂巢世纪科技有限公司 Method and device for simulating image by utilizing AR glasses, AR glasses and medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105527711A (en) * 2016-01-20 2016-04-27 福建太尔电子科技股份有限公司 Smart glasses with augmented reality
CN105867599A (en) * 2015-08-17 2016-08-17 乐视致新电子科技（天津）有限公司 Gesture control method and device
CN106101575A (en) * 2016-06-28 2016-11-09 广东欧珀移动通信有限公司 Generation method, device and the mobile terminal of a kind of augmented reality photo
CN106155311A (en) * 2016-06-28 2016-11-23 努比亚技术有限公司 AR helmet, AR interactive system and the exchange method of AR scene
CN106373198A (en) * 2016-09-18 2017-02-01 福州大学 Method for realizing augmented reality
CN106773063A (en) * 2017-03-03 2017-05-31 深圳增强现实技术有限公司 The augmented reality intelligent glasses and method of various main frames can be adapted to
CN106997235A (en) * 2016-01-25 2017-08-01 亮风台（上海）信息科技有限公司 Method, equipment for realizing augmented reality interaction and displaying
CN107238929A (en) * 2017-07-17 2017-10-10 深圳市世尊科技有限公司 Wearable system

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100309097A1 (en) * 2009-06-04 2010-12-09 Roni Raviv Head mounted 3d display
CN105807428B (en) * 2016-05-09 2019-03-26 范杭 A kind of head-mounted display apparatus and system

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105867599A (en) * 2015-08-17 2016-08-17 乐视致新电子科技（天津）有限公司 Gesture control method and device
CN105527711A (en) * 2016-01-20 2016-04-27 福建太尔电子科技股份有限公司 Smart glasses with augmented reality
CN106997235A (en) * 2016-01-25 2017-08-01 亮风台（上海）信息科技有限公司 Method, equipment for realizing augmented reality interaction and displaying
CN106101575A (en) * 2016-06-28 2016-11-09 广东欧珀移动通信有限公司 Generation method, device and the mobile terminal of a kind of augmented reality photo
CN106155311A (en) * 2016-06-28 2016-11-23 努比亚技术有限公司 AR helmet, AR interactive system and the exchange method of AR scene
CN106373198A (en) * 2016-09-18 2017-02-01 福州大学 Method for realizing augmented reality
CN106773063A (en) * 2017-03-03 2017-05-31 深圳增强现实技术有限公司 The augmented reality intelligent glasses and method of various main frames can be adapted to
CN107238929A (en) * 2017-07-17 2017-10-10 深圳市世尊科技有限公司 Wearable system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110531847A (en) * 2019-07-26 2019-12-03 中国人民解放军军事科学院国防科技创新研究院 A kind of novel social contact method and system based on augmented reality
CN113377203A (en) * 2021-07-05 2021-09-10 浙江商汤科技开发有限公司 Augmented reality display method and related device
CN114063778A (en) * 2021-11-17 2022-02-18 北京蜂巢世纪科技有限公司 Method and device for simulating image by utilizing AR glasses, AR glasses and medium

Also Published As

Publication number Publication date
WO2019114092A1 (en) 2019-06-20

Similar Documents

Publication Publication Date Title
CN105593785B (en) Stare auxiliary touch-screen input
US9996979B2 (en) Augmented reality technology-based handheld viewing device and method thereof
Henrysson et al. Face to face collaborative AR on mobile phones
US20180033211A1 (en) Personal Electronic Device with a Display System
CN108646997A (en) A method of virtual and augmented reality equipment is interacted with other wireless devices
CN105320262A (en) Method and apparatus for operating computer and mobile phone in virtual world and glasses thereof
CN111726536A (en) Video generation method and device, storage medium and computer equipment
CN108259496A (en) The generation of special efficacy program file packet and special efficacy generation method and device, electronic equipment
US20140306891A1 (en) Holographic object feedback
CN107533369A (en) The magnetic tracking of glove fingertip with peripheral unit
CN106233227A (en) There is the game device of volume sensing
WO2021016334A1 (en) Trackability enhancement of a passive stylus
US20180197345A1 (en) Augmented reality technology-based handheld viewing device and method thereof
CN109934929A (en) The method, apparatus of image enhancement reality, augmented reality show equipment and terminal
CN102779000A (en) User interaction system and method
US10922878B2 (en) Lighting for inserted content
CN108563327B (en) Augmented reality method, device, storage medium and electronic equipment
CN112199016A (en) Image processing method, image processing device, electronic equipment and computer readable storage medium
WO2019067482A1 (en) Displaying applications in a simulated reality setting
CN112835445A (en) Interaction method, device and system in virtual reality scene
CN106502401B (en) Image control method and device
CN110717993B (en) Interaction method, system and medium of split type AR glasses system
GB2533789A (en) User interface for augmented reality
CN114779948A (en) Method, device and equipment for controlling instant interaction of animation characters based on facial recognition
CN205360552U (en) Three -dimensional interactive game system of 3D bore hole

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20191226

Address after: Room a-b102-1229, 198 Qidi Road, Xiaoshan Economic and Technological Development Zone, Xiaoshan District, Hangzhou City, Zhejiang Province

Applicant after: Hangzhou rongmeng Intelligent Technology Co., Ltd

Address before: 518000 Guangdong city of Shenzhen province Qianhai Shenzhen Hong Kong cooperation zone before Bay Road No. 1 building 201 room A (located in Shenzhen Qianhai business secretary Co. Ltd.)

Applicant before: Shenzhen Dream Vision Intelligent Technology Co., Ltd.

RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190625