CN107808416A

CN107808416A - Image processing method, image display method, image processing device, image display device, electronic equipment and storage medium

Info

Publication number: CN107808416A
Application number: CN201710909822.5A
Authority: CN
Inventors: 朱铭恩; 陈小清; 郭佳楠; 厉源; 侯雯佩; 李源; 甘彧; 乔立; 焦弟琴; 余芝兰; 巩雪
Original assignee: Beijing Kingsoft Internet Security Software Co Ltd
Current assignee: Beijing Kingsoft Internet Security Software Co Ltd
Priority date: 2017-09-29
Filing date: 2017-09-29
Publication date: 2018-03-16

Abstract

The embodiment of the invention provides an image processing method, an image display method, an image processing device, an image display device, electronic equipment and a storage medium. According to the method and the device, the virtual graph input aiming at the existing characteristic region is obtained, the depth information of the virtual graph is adjusted to be matched with the depth information of the existing characteristic region, the adjusted virtual graph is displayed in the window of the first electronic equipment according to the position of the existing characteristic region, and the diversity and the user experience of the virtual graph are improved because the obtained virtual graph is input aiming at the existing characteristic region by a user.

Description

A kind of image procossing, display methods, device, electronic equipment and storage medium

Technical field

The present invention relates to augmented reality field, more particularly to a kind of image procossing, display methods, device, electronics Equipment and storage medium.

Background technology

Augmented reality (Augmented Reality, abbreviation AR) is a kind of by real world information and virtual world information " seamless " integrated new technology, it is difficult the entity information experienced in the certain time spatial dimension of real world script to be (visual information, sound, taste, tactile etc.), by science and technology such as computers, it is superimposed again after analog simulation, by virtual information Real world is applied to, is perceived by human sensory, so as to reach the sensory experience of exceeding reality.Real environment and virtual Object has been added to same picture or space in real time.

AR systems have three it is prominent the characteristics of：1. the information integration of real world and virtual world；2. with friendship in real time Mutual property；3. it is to increase positioning dummy object in three dimension scale space.Augmented reality will really change us and observe the side in the world Formula.

In the prior art, the method for the augmented reality of visualization is generally：Electronic equipment obtains real scene image, so Enhanced scene image is synthesized with default virtual image afterwards, enhanced scene image is included in electronic equipment window, user is Enhanced scene image can be viewed by electronic equipment window.Because existing virtual image is default image, species is solid It is fixed, negligible amounts, cause virtual image content single so that user can only view fixed virtual image in fixed place Enhanced scene image after being synthesized with real scene image, causes Consumer's Experience poor.

The content of the invention

The purpose of the embodiment of the present invention is that providing a kind of image procossing, display methods, device, electronic equipment and storage is situated between Matter, solves the problems, such as the single caused poor user experience of virtual image content.Concrete technical scheme is as follows：

In a first aspect, the embodiment of the present invention provides a kind of image processing method, applied to the first electronic equipment, methods described Including：

Detect and whether there is characteristic area in current real scene image；

If it is, obtain depth information and the position of existing characteristic area；

Obtain the virtual pattern for the existing characteristic area input；

The depth information of the virtual pattern is adjusted to the depth information with the existing characteristic area and matched；

According to the position of the existing characteristic area, the virtual pattern after adjustment is included in first electronics In device window.

Optionally, the characteristic area is plane domain, whether there is feature in the current real scene image of detection The step of region, including：

According to preset plane detection algorithm, detect and whether there is plane domain in current real scene image.

Optionally, the depth information by the virtual pattern is adjusted to the depth of the existing characteristic area and believed The step of manner of breathing matches, including：

Obtain the depth information of all pixels point in the existing characteristic area；

According to acquired depth information, the mean depth information of the calculating existing characteristic area；

The depth information of the virtual pattern is adjusted to identical with the mean depth information.

Optionally, in the position according to the existing characteristic area, the virtual pattern after adjustment is included in institute After stating the step in the first electronic equipment window, methods described also includes：

The virtual pattern and the current real scene image comprising the existing characteristic area are sent to high in the clouds Server.

Optionally, described by the virtual pattern and current real scene figure comprising the existing characteristic area As sending the step of cloud server, methods described also includes：

Obtain current geographic position information；

The current geographic position information is sent to cloud server.

Second aspect, the embodiment of the present invention provides a kind of image processing apparatus, applied to the first electronic equipment, described device Including：

First detection module, it whether there is characteristic area in current real scene image for detecting, if it is, triggering the One obtains module；

Described first obtains module, for obtaining depth information and the position of existing characteristic area；

First virtual pattern obtains module, for obtaining the virtual pattern for the existing characteristic area input；

First adjusting module, for by the depth information of the virtual pattern adjust to the existing characteristic area Depth information matches；

First display module, for the position according to the existing characteristic area, by the virtual pattern after adjustment It is shown in the first electronic equipment window.

Optionally, the characteristic area is plane domain, the first detection module, is specifically used for：

Optionally, first adjusting module, including：

Depth Information Acquistion unit, for obtaining the depth information of all pixels point in the existing characteristic area；

Mean depth information calculating unit, for according to acquired depth information, calculating the existing characteristic area Mean depth information；

Adjustment unit, for the depth information of the virtual pattern to be adjusted to identical with the mean depth information.

Optionally, described device also includes：

Virtual pattern sending module, in the position according to the existing characteristic area, by the void after adjustment After plan is graphically displayed in the first electronic equipment window, by the virtual pattern and the existing characteristic area is included The current real scene image in domain is sent to cloud server.

Optionally, described device also includes：

Current geographic position information obtains module, for by the virtual pattern and including the existing characteristic area The current real scene image in domain is sent to cloud server, obtains current geographic position information；

First geographical location information sending module, for the current geographic position information to be sent to cloud server.

The third aspect, the embodiment of the present invention provide a kind of electronic equipment, including first processor, the first communication interface, the One memory and the first communication bus, wherein, first processor, the first communication interface, first memory communicates total by first Line completes mutual communication；

First memory, for depositing computer program；

First processor, during for performing the program deposited on first memory, realize any of the above-described described method Step.

Fourth aspect, the embodiment of the present invention provide a kind of computer-readable recording medium, the computer-readable storage medium Matter internal memory contains computer program, and the computer program realizes any of the above-described described method and step when being executed by processor.

5th aspect, the embodiment of the present invention provide a kind of application program, wherein, the application program is used to operationally hold Any of the above-described described method and step of row.

6th aspect, the embodiment of the present invention provides a kind of method for displaying image, applied to the second electronic equipment, methods described Including：

Detect and whether there is characteristic area in current real scene image；

If it is, the current real scene image is sent to cloud server；

Receive the virtual pattern corresponding with the currently real scene image that the cloud server is sent；

Obtain depth information and the position of existing characteristic area；

The depth information of the virtual pattern is adjusted to the depth information with existing characteristic area and matched；

According to the position of existing characteristic area, the virtual pattern after adjustment is included setting in second electronics In standby window.

Optionally, sent by the current real scene image the step of cloud server before, methods described is also Including：

Current geographic position information is obtained, the current geographic position information is sent to cloud server.

7th aspect, the embodiment of the present invention provides a kind of image display device, applied to the second electronic equipment, methods described Including：

Second detection module, detect and whether there is characteristic area in current real scene image, if it is, triggering image hair Send module；

Described image sending module, for the current real scene image to be sent to cloud server；

Virtual pattern receiving module is sending with the current real scene image pair for receiving the cloud server The virtual pattern answered；

Second obtains module, for obtaining depth information and the position of existing characteristic area；

Second adjusting module, for the depth information of the virtual pattern to be adjusted to the depth with existing characteristic area Spend information match；

Second display module, for the position according to existing characteristic area, the virtual pattern after adjustment is shown Show in the second electronic equipment window.

Optionally, described device also includes：

Second geographical location information sending module, for being sent by the current real scene image to cloud server Before, current geographic position information is obtained, the current geographic position information is sent to cloud server.

Eighth aspect, the embodiment of the present invention provide a kind of electronic equipment, including second processor, the second communication interface, the Two memories and the second communication bus, wherein, second processor, the second communication interface, second memory communicates total by second Line completes mutual communication；

Second memory, for depositing computer program；

Second processor, during for performing the program deposited on second memory, realize any of the above-described described method Step.

9th aspect, a kind of computer-readable recording medium of the embodiment of the present invention, in the computer-readable recording medium Computer program is stored with, the computer program realizes any of the above-described described method and step when being executed by processor.

Tenth aspect, the embodiment of the present invention provide a kind of application program, wherein, the application program is used to operationally hold Any of the above-described described method and step of row.

Tenth on the one hand, and the embodiment of the present invention provides a kind of data processing method, applied to cloud server, methods described Including：

Receive and store the virtual pattern of the first electronic equipment transmission and the real scene image comprising characteristic area；

Record the corresponding relation of the virtual pattern and the real scene image.

Optionally, after the step of corresponding relation for recording the virtual pattern and the real scene image described, Methods described also includes：

Receive the real scene image of the second electronic equipment transmission；

The characteristic area that the real scene image sent based on second electronic equipment is included, by second electronics The real scene image that equipment is sent is matched with the real scene image stored, obtains sending with second electronic equipment Real scene images match target real scene image；

According to the virtual pattern of record and the corresponding relation of real scene image, it is determined that with the target real scene image Corresponding destination virtual figure；

The destination virtual figure is sent to second electronic equipment.

Optionally, after the step of recording the corresponding relation of the virtual pattern information and the real scene image, Methods described also includes：

Receive and store the geographical location information of the first electronic equipment transmission；

Record the corresponding relation of the geographical location information and the real scene image.

Optionally, the step of corresponding relation for recording the geographical location information and the real scene image described it Afterwards, methods described also includes：

Receive the geographical location information and real scene image of the second electronic equipment transmission；

According to the geographical location information of record and the corresponding relation of real scene image, it is determined that being sent with the second electronic equipment Geographical location information corresponding to real scene image；

The characteristic area that is included of real scene image sent based on second electronic equipment, from identified true In scene image, the target real scene image of real scene images match sent with second electronic equipment is obtained；

The destination virtual figure is sent to second electronic equipment.

12nd aspect, the embodiment of the present invention provides a kind of data processing equipment, applied to cloud server, described device Including：

First memory module, for receiving and storing the virtual pattern of the first electronic equipment transmission and comprising characteristic area Real scene image；

First logging modle, for recording the corresponding relation of the virtual pattern and the real scene image.

Optionally, described device also includes：

Real scene image receiver module, for recording the corresponding pass of the virtual pattern and the real scene image After system, the real scene image that the second electronic equipment is sent is received；

First object real scene image determining module, for the real scene figure sent based on second electronic equipment As the characteristic area included, the real scene image that second electronic equipment is sent is entered with the real scene image stored Row matching, obtain the target real scene image of real scene images match sent with second electronic equipment；

First object virtual pattern determining module, closed for the virtual pattern according to record and the corresponding of real scene image System, it is determined that destination virtual figure corresponding with the target real scene image；

First sending module, for the destination virtual figure to be sent to second electronic equipment.

Optionally, described device also includes：

Second memory module, for record the virtual pattern information and the real scene image corresponding relation it Afterwards, receive and store the geographical location information of the first electronic equipment transmission；

Second logging modle, for recording the corresponding relation of the geographical location information and the real scene image.

Optionally, described device also includes：

Receiving module, for the corresponding relation for recording the geographical location information and the real scene image it Afterwards, the geographical location information and real scene image that the second electronic equipment is sent are received；

Real scene image determining module, for the pass corresponding with real scene image of the geographical location information according to record System, it is determined that real scene image corresponding with the geographical location information that the second electronic equipment is sent；

Second target real scene image determining module, for the real scene figure sent based on second electronic equipment As the characteristic area included, from identified real scene image, obtain true with second electronic equipment transmission The target real scene image of scene image matching；

Second destination virtual figure determining module, closed for the virtual pattern according to record and the corresponding of real scene image System, it is determined that destination virtual figure corresponding with the target real scene image；

Second sending module, for the destination virtual figure to be sent to second electronic equipment.

13rd aspect, the embodiment of the present invention provide a kind of electronic equipment, including the 3rd processor, third communication interface, 3rd memory and third communication bus, wherein, the 3rd processor, third communication interface, the 3rd memory passes through the third communication Bus completes mutual communication；

3rd memory, for depositing computer program；

3rd processor, during for performing the program deposited on the 3rd memory, realize any of the above-described described method Step.

Fourteenth aspect, the embodiment of the present invention provide a kind of computer-readable recording medium, the computer-readable storage Dielectric memory contains computer program, and the computer program realizes any of the above-described described method step when being executed by processor Suddenly.

15th aspect, the embodiment of the present invention provide a kind of application program, wherein, the application program is used for operationally Perform any of the above-described described method and step.

In the embodiment of the present invention, detect and whether there is characteristic area in current real scene image, deposited if it is, obtaining Characteristic area depth information and position, the virtual pattern for existing characteristic area input is obtained, by virtual pattern Depth information adjust to the depth information with existing characteristic area and match, will according to the position of existing characteristic area Virtual pattern after adjustment is shown in the first electronic equipment window.The present invention is obtained for depositing after characteristic area is detected Characteristic area input virtual pattern, then the depth information of virtual pattern is adjusted to the depth with existing characteristic area Information match is spent, according to the position of existing characteristic area, the virtual pattern after adjustment is included in the first electronic equipment window No longer it is default a kind of or more by the virtual pattern obtained is that user is directed to existing characteristic area input in mouthful Kind virtual pattern, therefore, substantially increases the diversity of virtual pattern, improves Consumer's Experience.

Brief description of the drawings

In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing There is the required accompanying drawing used in technology description to be briefly described, it should be apparent that, drawings in the following description are only this Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can be with Other accompanying drawings are obtained according to these accompanying drawings.

Fig. 1 is a kind of the first schematic flow sheet of image processing method provided in an embodiment of the present invention；

Fig. 2 (a) -2 (c) is the signal provided in an embodiment of the present invention that virtual pattern is shown in the first electronic equipment window Figure；

Fig. 3 adjusts the depth information of virtual pattern to the depth information with characteristic area to be provided in an embodiment of the present invention The schematic flow sheet to match；

Fig. 4 is a kind of second of schematic flow sheet of image processing method provided in an embodiment of the present invention；

Fig. 5 is a kind of the third schematic flow sheet of image processing method provided in an embodiment of the present invention；

Fig. 6 is a kind of structural representation of image processing apparatus provided in an embodiment of the present invention；

Fig. 7 is the first structural representation of electronic equipment provided in an embodiment of the present invention；

Fig. 8 is the first schematic flow sheet of method for displaying image provided in an embodiment of the present invention；

Fig. 9 is the schematic diagram that show map marks in cell phone map provided in an embodiment of the present invention；

Figure 10 (a) -10 (d) shows showing for virtual pattern to be provided in an embodiment of the present invention in the second electronic equipment window It is intended to；

Figure 11 is second of schematic flow sheet of method for displaying image provided in an embodiment of the present invention；

Figure 12 is the structural representation of image display device provided in an embodiment of the present invention；

Figure 13 is second of structural representation of electronic equipment provided in an embodiment of the present invention；

Figure 14 is the first schematic flow sheet of data processing method provided in an embodiment of the present invention；

Figure 15 is second of schematic flow sheet of data processing method provided in an embodiment of the present invention；

Figure 16 is the third schematic flow sheet of data processing method provided in an embodiment of the present invention；

Figure 17 is the 4th kind of schematic flow sheet of data processing method provided in an embodiment of the present invention；

Figure 18 is the structural representation of data processing equipment provided in an embodiment of the present invention；

Figure 19 is the third structural representation of electronic equipment provided in an embodiment of the present invention.

Embodiment

Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, rather than whole embodiments.It is based on Embodiment in the present invention, those of ordinary skill in the art are obtained every other under the premise of creative work is not made Embodiment, belong to the scope of protection of the invention.

In order to solve prior art problem, the embodiments of the invention provide a kind of image procossing, display methods, device, electricity Sub- equipment and storage medium.

A kind of image procossing for being there is provided first below from the angle of electronic equipment the embodiment of the present invention, display methods are entered Row is introduced.

It should be noted that a kind of image processing method that the embodiment of the present invention is provided is applied to the first electronic equipment. In actual applications, first electronic equipment can be smart mobile phone, tablet personal computer etc., and this is all rational.

, can be with applied to the first electronic equipment as shown in figure 1, a kind of image processing method provided in an embodiment of the present invention Including：

S101：Detect and whether there is characteristic area in current real scene image, if it is, step S102 is performed, if It is no, it is without any processing.

At present, augmented reality can incorporate dummy object in real scene, give people preferable visual experience. , it is necessary to obtain current real scene image by the image capture device of the first electronic equipment in practical application.

Such as：First electronic equipment is mobile phone, and current real scene image is obtained by the camera of mobile phone.

Due to some characteristic areas for easily allowing people to produce creation idea, example in current real scene image always be present Such as：Metope or lawn etc., therefore, after current real scene image is obtained, detect and whether deposited in current real scene image In characteristic area.

S102：Obtain depth information and the position of existing characteristic area.

After characteristic area is detected, you can it is determined that the position of existing characteristic area.It is determined that existing feature Behind the position in region, the depth information of existing characteristic area is obtained.

Detailed, obtaining the mode of the depth information of existing characteristic area can be：Obtain current real scene figure The current depth image as corresponding to, the depth information of existing characteristic area is determined according to current depth image.

Wherein, current depth image can be passed by the image for sampling depth image set in the first electronic equipment Sensor obtains.The depth information of each point in real scene is included in the current depth image, i.e., each point is to image in real scene The range information of collecting device, wherein, in one implementation, the pixel value of each pixel is in the current depth image For：The depth information of point in real scene corresponding to each pixel.

S103：Obtain the virtual pattern for existing characteristic area input.

In order to increase the diversity of virtual image, after characteristic area is detected, can obtain for existing characteristic area The virtual pattern of domain input.

Detailed, the mode obtained for the virtual image of existing characteristic area input includes but is not limited to following several Kind：

First way：After characteristic area is detected, display editor's entrance, user can be edited by editor's entrance Virtual pattern, obtain the virtual pattern that user is directed to existing characteristic area input.

The second way：User stores multiple virtual patterns in the first electronic equipment in advance, is detecting characteristic area Afterwards, display addition entrance, user add any virtual pattern by the addition entrance, obtain user and are directed to existing characteristic area The virtual pattern of input.

Because different users can edit different virtual patterns, and same user can also edit it is different virtual Figure, therefore, the whether mode of the first real-time edition virtual pattern, or pre-set the side of virtual pattern for second Formula, it can reach the multifarious purpose of greatly increased virtual pattern.Detailed, virtual pattern can include but unlimited In：Numeral, letter and stick figure.

S104：The depth information of virtual pattern is adjusted to the depth information with existing characteristic area and matched.

In order that virtual pattern can be dissolved into real scene image, after the virtual pattern of user's input is obtained, obtain The depth information of virtual pattern is obtained, then adjusts the depth information of virtual pattern to the depth information with existing characteristic area Match.Thus, virtual pattern is dissolved into real scene image.

S105：According to the position of existing characteristic area, the virtual pattern after adjustment is included in the first electronic equipment window In mouthful.

Because virtual pattern is directed to existing characteristic area, and the position of existing characteristic area may be true Any position in scene image, such as：Left side or right side, therefore, in order that virtual pattern can be dissolved into real scene figure As in, the depth information of virtual pattern is adjusted to the depth information with existing characteristic area match after, it is necessary to according to The position of existing characteristic area, the virtual pattern after adjustment is included in the first electronic equipment window.

Such as：Existing characteristic area then includes the virtual pattern after adjustment the in the left side of real scene image Left side in one electronic equipment window.

Method shown in Fig. 1 is described in detail below by a specific embodiment.

Such as：Assuming that the first electronic equipment is mobile phone, characteristic area is plane domain, it is assumed that in current real scene image Metope be present, the virtual pattern of user's input is " You are my”；

Referring to Fig. 2 (a), current real scene image is obtained；

Referring to Fig. 2 (b), detect and whether there is plane domain in current real scene image, due to current real scene figure Metope be present as in, therefore, detect wall section, obtain depth information and the position of wall section, and show input entrance, " click to draw " in as Fig. 2 (b)；

" click to draw " can input virtual pattern to user's click, obtain the virtual graph for wall section input Shape " You are my”；

By virtual pattern " You are my" depth information adjust to the depth of wall section letter Manner of breathing matches；

Referring to Fig. 2 (c), according to the position of wall section, by virtual pattern " the You are my after adjustment" be shown in mobile phone window.

Further, features described above region can include but is not limited to plane domain or curved surface area.

When features described above region is plane domain, the step S101 in Fig. 1, can include：

Detailed, plane domain can be wall section, computer display screen region etc..

When features described above region is curved surface area, the step S101 in Fig. 1, can include：

According to default Curved dectection algorithm, detect and whether there is curved surface area in current real scene image.

Detailed, curved surface area can be cup exterior surface area, the curved surface area etc. of mouse.

Further, it is above-mentioned to adjust the depth information of virtual pattern to the depth information phase with existing characteristic area Match somebody with somebody, Ke Yiwei：The depth information of virtual pattern is adjusted by way of the mean depth information of characteristic area existing for calculating.Ginseng See that Fig. 3, S104 can include：

S1041：The depth information of all pixels point in characteristic area existing for acquisition.

Because existing characteristic area includes multiple pixels, in order to calculate the mean depth letter of existing characteristic area Breath is, it is necessary to obtain the depth information of all pixels point in existing characteristic area.

S1042：According to acquired depth information, the mean depth information of characteristic area existing for calculating.

After the depth information of all pixels point in obtaining existing characteristic area, you can according to acquired depth Information, the mean depth information of characteristic area existing for calculating.

Detailed, according to acquired depth information, the mode of the mean depth information of characteristic area existing for calculating is：

Characteristic area existing for the depth information sum ÷ of all pixels point of mean depth information=existing characteristic area The number for the pixel that domain is included.

S1043：The depth information of virtual pattern is adjusted to identical with mean depth information.

After the mean depth information of existing characteristic area is calculated, you can by the depth information of virtual pattern adjust to It is identical with mean depth information.

Detailed, the depth information of virtual pattern, which is adjusted to identical with mean depth information, to be：Believed by parallax Cease the depth information as intermediate variable adjustment virtual pattern.

The relation of the depth information of default parallax information and virtual pattern is：Disp is parallax value, d_virtualFor the depth value of virtual pattern, α is constant, and wherein α can be by stochastic inputs parallax value disp₀Measured with corresponding Virtual pattern depth d_real,0It is determined that α=disp₀·d_real,0。

Need the adjustment of the depth information of virtual pattern is identical with mean depth information, then d_virtual=d_real, d_realIt is flat Equal depth information, it can drawThe depth information of virtual pattern is adjusted according to parallax value.

Certainly, adjust virtual pattern depth information be not limited in more than by way of be adjusted, can also lead to Cross other modes to be adjusted, the present invention does not do any restriction.

On the basis of method shown in Fig. 1, referring to Fig. 4, a kind of image processing method provided in an embodiment of the present invention, in step After rapid S105, it can also include：

S106：Virtual pattern and the current real scene image comprising existing characteristic area are sent to cloud service Device.

In order that other users can also use the virtual pattern for the existing characteristic area, after by adjustment After virtual pattern is shown in the first electronic equipment window, by virtual pattern and the current of existing characteristic area can be included Real scene image is sent to cloud server.

Cloud server after virtual pattern and current real scene image comprising existing characteristic area is received, Virtual pattern and the current real scene image comprising existing characteristic area can be stored, and record virtual pattern with it is current The corresponding relation of real scene image.

On the basis of method shown in Fig. 4, referring to Fig. 5, a kind of image processing method provided in an embodiment of the present invention, in step After rapid S106, it can also include：

S107：Obtain current geographic position information.

In order that other users can with easier virtual pattern found for the existing characteristic area, it is necessary to Know the geographical position where the existing characteristic area, therefore, by virtual pattern and include existing characteristic area Current real scene image is sent to cloud server, can obtain current geographic position information.

S108：Current geographic position information is sent to cloud server.

After current geographic position information is obtained, current geographic position information is sent to cloud server.

Cloud server is after current geographic position information is received, you can preserves current geographic position information, and records The corresponding relation of current geographic position information and current real scene image comprising existing characteristic area.

In addition, cloud server can also generate map label according to current geographic position information, and it is shown in the first electricity In the map of sub- equipment, thus, where user had edited virtual pattern if being informed in.

Relative to above method embodiment, as shown in fig. 6, the embodiment of the present invention additionally provides a kind of image processing apparatus, Applied to the first electronic equipment, described device can include：

First detection module 201, it whether there is characteristic area in current real scene image for detecting, if it is, touching Hair first obtains module 202；

Described first obtains module 202, for obtaining depth information and the position of existing characteristic area；

First virtual pattern obtains module 203, for obtaining the virtual pattern for the existing characteristic area input；

First adjusting module 204, for by the depth information of the virtual pattern adjust to the existing characteristic area The depth information in domain matches；

First display module 205, for the position according to the existing characteristic area, by the virtual graph after adjustment Shape is shown in the first electronic equipment window.

In a kind of implementation of the present invention, the characteristic area is plane domain, the first detection module 201, It can be specifically used for：

In a kind of implementation of the present invention, first adjusting module 204, it can include：

In a kind of implementation of the present invention, described device can also include：

The embodiment of the present invention additionally provides a kind of electronic equipment, as shown in fig. 7, comprises first processor 701, first communicates Interface 702, the communication bus 704 of first memory 703 and first, wherein, first processor 701, the first communication interface 702, the One memory 703 completes mutual communication by the first communication bus 704,

First memory 703, for depositing computer program；

First processor 701, during for performing the program deposited on first memory 703, realize image processing method Step, methods described are applied to the first electronic equipment, and methods described includes：

Detect and whether there is characteristic area in current real scene image；

Obtain the virtual pattern for the existing characteristic area input；

In a kind of implementation of the present invention, the characteristic area is plane domain, the current real scene of detection The step of whether there is characteristic area in image, can include：

The present invention a kind of implementation in, the depth information by the virtual pattern adjust to the presence The depth information of characteristic area the step of matching, can include：

In a kind of implementation of the present invention, in the position according to the existing characteristic area, by the institute after adjustment After stating the step that virtual pattern is shown in the first electronic equipment window, methods described can also include：

In a kind of implementation of the present invention, by the virtual pattern and the existing characteristic area is included described The current real scene image in domain was sent the step of cloud server, and methods described can also include：

Obtain current geographic position information；

The current geographic position information is sent to cloud server.

The first communication bus that above-mentioned electronic equipment is mentioned can be Peripheral Component Interconnect standard (Peripheral Component Interconnect, PCI) bus or EISA (Extended Industry Standard Architecture, EISA) bus etc..First communication bus can be divided into address bus, data/address bus, controlling bus etc.. For ease of representing, only represented in figure with a thick line, it is not intended that an only bus or a type of bus.

The communication that first communication interface is used between above-mentioned electronic equipment and other equipment.

First memory can include random access memory (Random Access Memory, RAM), can also include Nonvolatile memory (Non-Volatile Memory, NVM), for example, at least a magnetic disk storage.Optionally, first deposit Reservoir can also be at least one storage device for being located remotely from aforementioned processor.

Above-mentioned first processor can be general processor, including central processing unit (Central Processing Unit, CPU), network processing unit (Network Processor, NP) etc.；It can also be digital signal processor (Digital Signal Processing, DSP), application specific integrated circuit (Application Specific Integrated Circuit, ASIC), field programmable gate array (Field-Programmable Gate Array, FPGA) or other FPGAs Device, discrete gate or transistor logic, discrete hardware components.

The embodiment of the present invention additionally provides a kind of computer-readable recording medium, the computer-readable recording medium internal memory Computer program is contained, the computer program realizes image processing method step, methods described application when being executed by processor In the first electronic equipment, methods described includes：

Detect and whether there is characteristic area in current real scene image；

Obtain the virtual pattern for the existing characteristic area input；

Obtain current geographic position information；

The current geographic position information is sent to cloud server.

The embodiment of the present invention additionally provides a kind of application program, wherein, the application program is used to operationally perform figure As process method step, methods described is applied to the first electronic equipment, and methods described includes：

Detect and whether there is characteristic area in current real scene image；

Obtain the virtual pattern for the existing characteristic area input；

Obtain current geographic position information；

The current geographic position information is sent to cloud server.

Relative to above-mentioned image processing method, referring to Fig. 8, the embodiment of the present invention additionally provides a kind of method for displaying image, Applied to the second electronic equipment, this method includes：

S301：Detect and whether there is characteristic area in current real scene image, if it is, step S302 is performed, if It is no, it is without any processing.

It should be noted that the second electronic equipment can be same equipment with the first electronic equipment, or difference is set It is standby.

Current real scene image is obtained by the image capture device of the second electronic equipment.Second electronic equipment is worked as The opportunity of preceding real scene image can be：User comes any one place, and opening image capture device can start to be worked as Preceding real scene image.

The opportunity that second electronic equipment obtains current real scene image can also be：User is tagged to up to finger according to the map The fixed place for having edited virtual pattern, opening image capture device can start to obtain current real scene image.Wherein, ground Icon note is after other users edited virtual pattern in somewhere, and current geographic position information is sent to cloud server Afterwards, the mark that cloud server generates according to current geographic position information.

Such as：Referring to Fig. 9, it is assumed that the second electronic equipment is mobile phone, four map labels be present in the map of mobile phone, when with Behind place where any one map label of family arrival, the plus button is clicked on, you can the camera acquisition for opening mobile phone is current true Real scene image.

After current real scene image is obtained, detect and whether there is characteristic area in current real scene image, and Subsequent step is performed according to testing result.

S302：Current real scene image is sent to cloud server.

When detecting characteristic area, current real scene image is sent to cloud server.

After cloud server receives current real scene image, you can the spy included based on current real scene image Region is levied, it is determined that virtual pattern corresponding with current real scene image, and the virtual image is sent to the second electronic equipment.

S303：Receive the virtual pattern corresponding with current real scene image that cloud server is sent.

Sent by current real scene image to cloud server, receive that cloud server sends with it is current true Virtual pattern corresponding to scene image.

S304：Obtain depth information and the position of existing characteristic area.

After characteristic area is detected the presence of, you can it is determined that the position of existing characteristic area.It is determined that existing Behind the position of characteristic area, the depth information of existing characteristic area is obtained.

Detailed, obtaining the mode of the depth information of existing characteristic area can be：Obtain current real scene figure The current depth image as corresponding to, the depth information of characteristic area is determined according to current depth image.

Wherein, current depth image can be passed by the image for sampling depth image set in the second electronic equipment Sensor obtains.The depth information of each point in real scene is included in the current depth image, i.e., each point is to image in real scene The range information of collecting device, wherein, in one implementation, the pixel value of each pixel is in the current depth image For：The depth information of point in real scene corresponding to each pixel.

S305：The depth information of virtual pattern is adjusted to the depth information with existing characteristic area and matched.

In order that the virtual pattern received can be dissolved into real scene image, the depth information of virtual pattern is adjusted The whole depth information to existing characteristic area matches.Thus, the virtual pattern received is dissolved into real scene In image.

S306：According to the position of existing characteristic area, the virtual pattern after adjustment is included in the second electronic equipment In window.

Because virtual pattern is directed to characteristic area, and the position of characteristic area may be in real scene image Any position, such as：Left side or right side, therefore, in order that virtual pattern can be dissolved into real scene image, by virtually The depth information of figure is adjusted to the depth information with characteristic area match after, it is necessary to according to the position of characteristic area, will adjust Virtual pattern after whole is shown in the second electronic equipment window.

In the embodiment of the present invention, detect and whether there is characteristic area in current real scene image, if it is, will be currently true Real scene image is sent to cloud server, receives the virtual graph corresponding with current real scene image that cloud server is sent Shape, obtain depth information and the position of existing characteristic area, by the depth information of virtual pattern adjust to it is existing The depth information of characteristic area matches, and according to the position of existing characteristic area, the virtual pattern after adjustment is included In second electronic equipment window.In the present invention, after characteristic area is detected, current real scene image is sent to high in the clouds and taken Business device, virtual pattern corresponding to the current real scene image that cloud server is sent is received, then by the depth of virtual image Information, which is adjusted to the depth information with existing characteristic area, to match, and according to the position of existing characteristic area, will adjust Virtual pattern after whole is shown in the second electronic equipment window, because virtual pattern is being used by other for cloud server transmission The virtual pattern of family editor, is no longer default one or more virtual patterns, therefore, substantially increases the various of virtual pattern Property, improve Consumer's Experience.

Method shown in Fig. 8 is described in detail below by a specific embodiment.

Such as：Assuming that the second electronic equipment is mobile phone, characteristic area is plane domain, it is assumed that in current real scene image Metope be present, the virtual pattern inputted using the user of the first electronic equipment is " You are my”；

Referring to Figure 10 (a), current real scene image is obtained；

Referring to Figure 10 (b), detect and whether there is plane domain in current real scene image, due to current real scene figure Metope be present as in, therefore, detect wall section, current real scene image is sent to cloud server, cloud service Device is found comprising after the real scene image of wall section detected, showing virtual tag, the prismatic in as Figure 10 (b) Mark；

Then cloud server determines virtual pattern corresponding with the real scene image found, as shown in Figure 10 (c) Display obtains virtual pattern；

Receive virtual pattern " the You are my corresponding with current real scene image that cloud server is sent”；

Depth information and the position of wall section are obtained, by virtual pattern " You are my" depth Information, which is adjusted to the depth information with wall section, to match；

Referring to Figure 10 (d), according to the position of wall section, by virtual pattern " the You are my after adjustment" be shown in mobile phone window.

On the basis of method shown in Fig. 8, referring to Figure 11, a kind of method for displaying image provided in an embodiment of the present invention, Before step S302, it can also include：

S302A：Current geographic position information is obtained, current geographic position information is sent to cloud server.

In order that cloud server can quickly find virtual pattern corresponding with current real scene image, it is necessary to Current geographic position information is obtained, and current geographic position information is sent to cloud server.

After cloud server receives current geographic position information, find corresponding with current geographic position information true Scene image, the characteristic area then included again based on current real scene image, it is determined that with current real scene image pair The virtual pattern answered, and the virtual image is sent to the second electronic equipment.

Thus, the time that cloud server finds virtual pattern is greatly accelerated.

Relative to above method embodiment, as shown in figure 12, the embodiment of the present invention additionally provides a kind of image display device, Applied to the second electronic equipment, described device can include：

Second detection module 401, detect and whether there is characteristic area in current real scene image, if it is, triggering figure As sending module 402；

Described image sending module 402, for the current real scene image to be sent to cloud server；

Virtual pattern receiving module 403 is sending with the current real scene figure for receiving the cloud server The virtual pattern as corresponding to；

Second obtains module 404, for obtaining depth information and the position of existing characteristic area；

Second adjusting module 405, for by the depth information of the virtual pattern adjust to existing characteristic area Depth information match；

Second display module 406, for the position according to existing characteristic area, by the virtual pattern after adjustment It is shown in the second electronic equipment window.

In the embodiment of the present invention, detect and whether there is characteristic area in current real scene image, if it is, will be currently true Real scene image is sent to cloud server, receives the virtual graph corresponding with current real scene image that cloud server is sent Shape, obtain depth information and the position of existing characteristic area, by the depth information of virtual pattern adjust to it is existing The depth information of characteristic area matches, and according to the position of existing characteristic area, the virtual pattern after adjustment is included In second electronic equipment window.In the present invention, because virtual pattern is the void by other users editor that cloud server is sent Intend figure, be no longer default one or more virtual patterns, therefore, substantially increase the diversity of virtual pattern, improve Consumer's Experience.

The embodiment of the present invention additionally provides a kind of electronic equipment, and as shown in figure 13, including second processor 1301, second is logical Believe interface 1302, the communication bus 1304 of second memory 1303 and second, wherein, second processor 1301, the second communication interface 1302, second memory 1303 completes mutual communication by the second communication bus 1304,

Second memory 1303, for depositing computer program；

Second processor 1301, during for performing the program deposited on second memory 1303, realize image display side Method step, methods described are applied to the second electronic equipment, and methods described includes：

Detect and whether there is characteristic area in current real scene image；

If it is, the current real scene image is sent to cloud server；

Obtain depth information and the position of existing characteristic area；

In a kind of implementation of the present invention, sent by the current real scene image to the step of cloud server Before rapid, methods described also includes：

The second communication bus that above-mentioned electronic equipment is mentioned can be Peripheral Component Interconnect standard (Peripheral Component Interconnect, PCI) bus or EISA (Extended Industry Standard Architecture, EISA) bus etc..Second communication bus can be divided into address bus, data/address bus, controlling bus etc.. For ease of representing, only represented in figure with a thick line, it is not intended that an only bus or a type of bus.

The communication that second communication interface is used between above-mentioned electronic equipment and other equipment.

Second memory can include random access memory (Random Access Memory, RAM), can also include Nonvolatile memory (Non-Volatile Memory, NVM), for example, at least a magnetic disk storage.Optionally, second deposit Reservoir can also be at least one storage device for being located remotely from aforementioned processor.

Above-mentioned second processor can be general processor, including central processing unit (Central Processing Unit, CPU), network processing unit (Network Processor, NP) etc.；It can also be digital signal processor (Digital Signal Processing, DSP), application specific integrated circuit (Application Specific Integrated Circuit, ASIC), field programmable gate array (Field-Programmable Gate Array, FPGA) or other FPGAs Device, discrete gate or transistor logic, discrete hardware components.

The embodiment of the present invention additionally provides a kind of computer-readable recording medium, the computer-readable recording medium internal memory Computer program is contained, the computer program realizes method for displaying image step, methods described application when being executed by processor In the second electronic equipment, methods described includes：

Detect and whether there is characteristic area in current real scene image；

If it is, the current real scene image is sent to cloud server；

Obtain depth information and the position of existing characteristic area；

The embodiment of the present invention additionally provides a kind of application program, wherein, the application program is used to operationally perform figure As display methods step, methods described is applied to the second electronic equipment, and methods described includes：

Detect and whether there is characteristic area in current real scene image；

If it is, the current real scene image is sent to cloud server；

Obtain depth information and the position of existing characteristic area；

A kind of data processing method provided below from the angle of cloud server the embodiment of the present invention is introduced.

As shown in figure 14, a kind of data processing method provided in an embodiment of the present invention, applied to cloud server, can wrap Include：

S501：Receive and store the virtual pattern of the first electronic equipment transmission and the real scene figure comprising characteristic area Picture.

In order that the virtual graph for the pin characteristic area that other users can also be edited using the user of the first electronic equipment Shape, the first electronic equipment is after editing virtual pattern and being shown in the first electronic equipment window, by virtual pattern and bag Current real scene image containing characteristic area is sent to cloud server.

Cloud server is receiving the virtual pattern of the first electronic equipment transmission and true field comprising characteristic area After scape image, you can storage virtual pattern and the real scene image comprising characteristic area.

S502：Record the corresponding relation of virtual pattern and real scene image.

Due to the quantity of the first electronic equipment may have it is multiple, therefore, the virtual pattern and bag that cloud server receives Real scene image containing characteristic area may have it is multiple, for convenience inquiry, it is necessary to record virtual pattern and real scene The corresponding relation of image.

In the embodiment of the present invention, receive and store the first electronic equipment transmission virtual pattern and comprising the true of characteristic area Real scene image, record the corresponding relation of virtual pattern and real scene image.In order to which other users are carried out to virtual pattern Inquiry.

On the basis of method shown in Figure 14, referring to Figure 15, a kind of data processing method provided in an embodiment of the present invention, After step S502, it can also include：

S503：Receive the real scene image of the second electronic equipment transmission.

The image capture device of second electronic equipment is obtaining current real scene image, and detects current real scene In image behind existing characteristics region, in order to obtain the virtual pattern corresponding with current real scene image of other users editor, Current real scene image is sent to cloud server, cloud server and receives the true field that the second electronic equipment is sent Scape image.

S504：The characteristic area that the real scene image sent based on the second electronic equipment is included, the second electronics is set The real scene image that preparation is sent is matched with the real scene image stored, is obtained true with the transmission of the second electronic equipment The target real scene image of scene image matching.

Due to being stored with virtual pattern and real scene image comprising characteristic area, therefore, high in the clouds in cloud server Server is after real scene image is received, you can the spy that the real scene image sent based on the second electronic equipment is included Region is levied, the real scene image that the second electronic equipment is sent is matched with the real scene image of storage, is obtained and the The target real scene image for the real scene images match that two electronic equipments are sent, comprising the in the target real scene image The characteristic area that the real scene image that two electronic equipments are sent is included.

S505：According to the virtual pattern of record and the corresponding relation of real scene image, it is determined that with target real scene figure The destination virtual figure as corresponding to.

Because record has the corresponding relation of virtual pattern and real scene image in cloud server, therefore, mesh is being obtained After marking real scene image, you can according to the virtual pattern of record and the corresponding relation of real scene image, it is determined that true with target Destination virtual figure corresponding to real scene image.

S506：Destination virtual figure is sent to the second electronic equipment.

It is determined that after destination virtual figure, destination virtual figure is sent to the second electronic equipment.Thus, the second electronics is set It is standby to would know that the virtual pattern that other users are edited.

Thus, cloud server is after the real scene image of the second electronic equipment transmission is received, you can according to itself The virtual pattern and real scene image of storage, and the corresponding relation of the virtual pattern of self record and real scene image, Determine destination virtual figure and send to the second electronic equipment, so that the second electronic equipment knows that other users are edited virtual Figure.

On the basis of method shown in Figure 14, referring to Figure 16, a kind of data processing method provided in an embodiment of the present invention, After step S502, it can also include：

S507：Receive and store the geographical location information of the first electronic equipment transmission.

In order that other users can be directed to spy with easier find using what the user of the first electronic equipment was edited The virtual pattern in region is levied, geographical location information is sent to cloud server, cloud server and received simultaneously by the first electronic equipment Store the geographical location information of the first electronic equipment transmission.

S508：The corresponding relation of recording geographical position information and real scene image.

Because the quantity of the first electronic equipment may have multiple, therefore, geographical position that cloud server receives may Have multiple, in addition, the quantity positioned at first electronic equipment in same geographical position may also have multiple, therefore, look into for convenience Ask, after receiving and storing the geographical location information of the first electronic equipment transmission, recording geographical position information and real scene figure The corresponding relation of picture.

Thus, cloud server receives and stores the geographical location information of the first electronic equipment transmission, and records geographical position Confidence ceases and the corresponding relation of real scene image, facilitates other users and virtual pattern is inquired about according to geographical position.

On the basis of method shown in Figure 16, referring to Figure 17, a kind of data processing method provided in an embodiment of the present invention, After step S508, it can also include：

S509：Receive the geographical location information and real scene image of the second electronic equipment transmission.

The image capture device of second electronic equipment is obtaining current real scene image, and detects current real scene In image behind existing characteristics region, in order to quickly obtain the corresponding with current real scene image of other users editor Virtual pattern, current geographic position information and current real scene image are sent to cloud server, cloud server and received Receive the geographical location information and real scene image of the second electronic equipment transmission.

S510：According to the geographical location information of record and the corresponding relation of real scene image, it is determined that being set with the second electronics Real scene image corresponding to the geographical location information that preparation is sent.

Because cloud server record has the corresponding relation of geographical location information and real scene image, therefore, high in the clouds clothes After business device receives geographical location information, according to the geographical location information of record and the corresponding relation of real scene image, it is determined that Real scene image corresponding with the geographical location information that the second electronic equipment is sent.

S511：The characteristic area that is included of real scene image sent based on the second electronic equipment, from identified true In real scene image, the target real scene image of real scene images match sent with the second electronic equipment is obtained.

Due to being stored with virtual pattern and real scene image comprising characteristic area, therefore, high in the clouds in cloud server Server is after the corresponding real scene image of geographical location information sent with the second electronic equipment is determined, you can based on the The characteristic area that the real scene image that two electronic equipments are sent is included, the real scene image that the second electronic equipment is sent Matched with identified real scene image, obtain the target of real scene images match sent with the second electronic equipment Real scene image, the spy that the real scene image sent comprising the second electronic equipment in the target real scene image is included Levy region.

S512：According to the virtual pattern of record and the corresponding relation of real scene image, it is determined that with target real scene figure The destination virtual figure as corresponding to.

S513：Destination virtual figure is sent to the second electronic equipment.

Thus, cloud server is receiving the geographical location information and real scene image of the transmission of the second electronic equipment Afterwards, you can according to the geographical location information of record and the corresponding relation of real scene image, it is determined that being sent with the second electronic equipment Geographical location information corresponding to real scene image.Then again from identified real scene image, obtain and the second electricity The target real scene image for the real scene images match that sub- equipment is sent.Compared to Figure 11 directly according to the second electronic equipment The real scene image of transmission is matched to determine the mode with target real scene image with the real scene image stored, Greatly accelerate the time that cloud server finds target true picture.

Relative to above method embodiment, as shown in figure 18, the embodiment of the present invention additionally provides a kind of data processing equipment, Applied to cloud server, described device can include：

First memory module 601, for receiving and storing the virtual pattern of the first electronic equipment transmission and comprising characteristic area The real scene image in domain；

First logging modle 602, for recording the corresponding relation of the virtual pattern and the real scene image.

The embodiment of the present invention additionally provides a kind of electronic equipment, as shown in figure 19, including the 3rd processor 1901, threeway Believe interface 1902, the 3rd memory 1903 and third communication bus 1904, wherein, the 3rd processor 1901, third communication interface 1902, the 3rd memory 1903 completes mutual communication by third communication bus 1904,

3rd memory 1903, for depositing computer program；

3rd processor 1901, for perform the 3rd memory 1903 on deposited program when, realize data processing side Method step, methods described are applied to cloud server, and methods described can include：

In a kind of implementation of the present invention, in pair for recording the virtual pattern and the real scene image After the step of should being related to, methods described also includes：

Receive the real scene image of the second electronic equipment transmission；

The destination virtual figure is sent to second electronic equipment.

In a kind of implementation of the present invention, pair of the virtual pattern information and the real scene image is being recorded After the step of should being related to, methods described can also include：

In a kind of implementation of the present invention, the geographical location information and the real scene image are recorded described Corresponding relation the step of after, methods described can also include：

The destination virtual figure is sent to second electronic equipment.

The third communication bus that above-mentioned electronic equipment is mentioned can be Peripheral Component Interconnect standard (Peripheral Component Interconnect, PCI) bus or EISA (Extended Industry Standard Architecture, EISA) bus etc..The third communication bus can be divided into address bus, data/address bus, controlling bus etc.. For ease of representing, only represented in figure with a thick line, it is not intended that an only bus or a type of bus.

The communication that third communication interface is used between above-mentioned electronic equipment and other equipment.

3rd memory can include random access memory (Random Access Memory, RAM), can also include Nonvolatile memory (Non-Volatile Memory, NVM), for example, at least a magnetic disk storage.Optionally, the 3rd deposit Reservoir can also be at least one storage device for being located remotely from aforementioned processor.

The 3rd above-mentioned processor can be general processor, including central processing unit (Central Processing Unit, CPU), network processing unit (Network Processor, NP) etc.；It can also be digital signal processor (Digital Signal Processing, DSP), application specific integrated circuit (Application Specific Integrated Circuit, ASIC), field programmable gate array (Field-Programmable Gate Array, FPGA) or other FPGAs Device, discrete gate or transistor logic, discrete hardware components.

The embodiment of the present invention additionally provides a kind of computer-readable recording medium, the computer-readable recording medium internal memory Computer program is contained, the computer program realizes data processing method steps, methods described application when being executed by processor In cloud server, methods described can include：

Receive the real scene image of the second electronic equipment transmission；

The destination virtual figure is sent to second electronic equipment.

The embodiment of the present invention additionally provides a kind of application program, wherein, the application program is used to operationally perform number According to process method step, methods described is applied to cloud server, and methods described can include：

Receive the real scene image of the second electronic equipment transmission；

The destination virtual figure is sent to second electronic equipment.

For device, electronic equipment, storage medium and application program embodiment, because it is substantially similar to method reality Example is applied, so description is fairly simple, the relevent part can refer to the partial explaination of embodiments of method.

The term used in the embodiment of the present application is only merely for the purpose of description specific embodiment, rather than is only being limited The application." one kind ", " described " and "the" of singulative used in the embodiment of the present application and appended claims It is also intended to including most forms, unless context clearly shows that other implications.It is also understood that term used herein "and/or" refers to and any or all may be combined comprising the associated list items purpose of one or more.

It will be appreciated that though it may be described in the embodiment of the present application using term " first ", " second ", " the 3rd " etc. Various connectivity ports and identification information etc., but these connectivity ports and identification information etc. should not necessarily be limited by these terms.These terms Only it is used for connectivity port and identification information etc. being distinguished from each other out.For example, in the case where not departing from the embodiment of the present application scope, First connectivity port can also be referred to as second connection end mouth, and similarly, second connection end mouth can also be referred to as the first connection Port.

Depending on linguistic context, word as used in this " if " can be construed to " ... when " or " when ... When " or " in response to determining " or " in response to detection ".Similarly, depending on linguistic context, phrase " if it is determined that " or " if detection (condition or event of statement) " can be construed to " when it is determined that when " or " in response to determine " or " when the detection (condition of statement Or event) when " or " in response to detecting (condition or event of statement) ".

Through the above description of the embodiments, it is apparent to those skilled in the art that, for description It is convenient and succinct, can as needed will be upper only with the division progress of above-mentioned each functional module for example, in practical application State function distribution to be completed by different functional modules, i.e., the internal structure of device is divided into different functional modules, to complete All or part of function described above.The specific work process of the system, apparatus, and unit of foregoing description, before may be referred to The corresponding process in embodiment of the method is stated, will not be repeated here.

In several embodiments provided herein, it should be understood that disclosed system, apparatus and method can be with Realize by another way.For example, device embodiment described above is only schematical, for example, the module or The division of unit, only a kind of division of logic function, can there are other dividing mode, such as multiple units when actually realizing Or component can combine or be desirably integrated into another system, or some features can be ignored, or not perform.It is another, institute Display or the mutual coupling discussed or direct-coupling or communication connection can be by some interfaces, device or unit INDIRECT COUPLING or communication connection, can be electrical, mechanical or other forms.

The unit illustrated as separating component can be or may not be physically separate, show as unit The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs 's.

In addition, each functional unit in each embodiment of the application can be integrated in a processing unit, can also That unit is individually physically present, can also two or more units it is integrated in a unit.Above-mentioned integrated list Member can both be realized in the form of hardware, can also be realized in the form of SFU software functional unit.

If the integrated unit is realized in the form of SFU software functional unit and is used as independent production marketing or use When, it can be stored in a computer read/write memory medium.Based on such understanding, the technical scheme of the application is substantially The part to be contributed in other words to prior art or all or part of the technical scheme can be in the form of software products Embody, the computer software product is stored in a storage medium, including some instructions are causing a computer It is each that equipment (can be personal computer, server, or network equipment etc.) or processor (processor) perform the application The all or part of step of embodiment methods described.And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage (Read Only Memory；Hereinafter referred to as：ROM), random access memory (Random Access Memory；Hereinafter referred to as： RAM), magnetic disc or CD etc. are various can be with the medium of store program codes.

Described above, the only embodiment of the application, but the protection domain of the application is not limited thereto is any Those familiar with the art can readily occur in change or replacement in the technical scope that the application discloses, and should all contain Cover within the protection domain of the application.Therefore, the protection domain of the application should be based on the protection scope of the described claims.

Claims

1. a kind of image processing method, it is characterised in that applied to the first electronic equipment, methods described includes：

Detect and whether there is characteristic area in current real scene image；

Obtain the virtual pattern for the existing characteristic area input；

According to the position of the existing characteristic area, the virtual pattern after adjustment is included in first electronic equipment In window.

2. a kind of image processing apparatus, it is characterised in that applied to the first electronic equipment, described device includes：

First detection module, it whether there is characteristic area in current real scene image for detecting, if it is, triggering first obtains Obtain module；

First adjusting module, for the depth information of the virtual pattern to be adjusted to the depth with the existing characteristic area Information match；

First display module, for the position according to the existing characteristic area, the virtual pattern after adjustment is shown In the first electronic equipment window.

3. a kind of electronic equipment, it is characterised in that logical including first processor, the first communication interface, first memory and first Believe bus, wherein, first processor, the first communication interface, first memory is completed mutual logical by the first communication bus Letter；

First memory, for depositing computer program；

First processor, during for performing the program deposited on first memory, realize the method step described in claim 1 Suddenly.

4. a kind of method for displaying image, it is characterised in that applied to the second electronic equipment, methods described includes：

Detect and whether there is characteristic area in current real scene image；

If it is, the current real scene image is sent to cloud server；

Obtain depth information and the position of existing characteristic area；

According to the position of existing characteristic area, the virtual pattern after adjustment is included in the second electronic equipment window In mouthful.

5. a kind of image display device, it is characterised in that applied to the second electronic equipment, methods described includes：

Second detection module, detect and whether there is characteristic area in current real scene image, if it is, triggering image sends mould Block；

Virtual pattern receiving module, for receiving the corresponding with the current real scene image of the cloud server transmission Virtual pattern；

Second adjusting module, believe for the depth information of the virtual pattern to be adjusted to the depth of existing characteristic area Manner of breathing matches；

Second display module, for the position according to existing characteristic area, the virtual pattern after adjustment is included In the second electronic equipment window.

6. a kind of electronic equipment, it is characterised in that logical including second processor, the second communication interface, second memory and second Believe bus, wherein, second processor, the second communication interface, second memory is completed mutual logical by the second communication bus Letter；

Second memory, for depositing computer program；

Second processor, during for performing the program deposited on second memory, realize the method step described in claim 4 Suddenly.

7. a kind of data processing method, it is characterised in that applied to cloud server, methods described includes：

8. a kind of data processing equipment, it is characterised in that applied to cloud server, described device includes：

First memory module, for receiving and storing the virtual pattern of the first electronic equipment transmission and comprising the true of characteristic area Scene image；

9. a kind of electronic equipment, it is characterised in that including the 3rd processor, third communication interface, the 3rd memory and threeway Believe bus, wherein, the 3rd processor, third communication interface, the 3rd memory is completed mutual logical by third communication bus Letter；

3rd memory, for depositing computer program；

3rd processor, for perform the 3rd memory on deposited program when, realize described in claim 7 method step Suddenly.

10. a kind of computer-readable recording medium, it is characterised in that the computer-readable recording medium internal memory contains computer Program, the computer program realize method and step described in claim 1 or realize claim 4 institute when being executed by processor The method and step stated realizes method and step described in claim 7.