Invention content
In view of this, the embodiment of the present invention be to provide a kind of image processing method, user terminal, image processing terminal and
Image processing system can fast, steadily obtain 3D resources, and be not necessarily to high cost of manufacture.
To solve the above problems, what the technical solution of the embodiment of the present invention was realized in:
A kind of image processing method, the method includes:
User terminal reports acquisition parameter and multimedia data resources based on different points of view;The user terminal is position
Unfixed arbitrary user terminal;
User terminal receives the figure of the multiple views synthesis obtained according to the acquisition parameter and the multimedia data resources
As handling result.
Preferably, the acquisition parameter includes:At least one of acquisition parameters, camera site.
Preferably, the method further includes:It receives and is obtained according to the acquisition parameter and the multimedia data resources
Multiple views synthesis processing result image, according to the display parameters of user terminal configuration or hardware running configuration regarded from described more
It selects to be shown in the processing result image of point synthesis.
A kind of image processing method, the method includes:
Image processing terminal receives acquisition parameter and multimedia data resources based on different points of view;
Image processing terminal obtains the image of multiple views synthesis according to the acquisition parameter and the multimedia data resources
Handling result.
Preferably, described image processing terminal obtains multiple views according to the acquisition parameter and the multimedia data resources
The processing result image of synthesis, including:
Image processing terminal establishes reference coordinate and reference resources;
Image processing terminal by the reference coordinate of foundation and reference resources, with the acquisition parameter and the multi-medium data
Resource is compared, and is grouped and therefrom selects and the reference coordinate and reference resources to the multimedia data resources
The grouped data to match;
Image processing terminal carries out the grouped data Data Synthesis of each viewpoint, obtains multiple and different viewpoint numbers
The processing result image of multiple views synthesis is incorporated as according to collection.
A kind of user terminal, the user terminal include:
Reporting unit, for reporting acquisition parameter and multimedia data resources based on different points of view;
First receiving unit, for receiving the multiple views obtained according to the acquisition parameter and the multimedia data resources
The processing result image of synthesis;
The user terminal is the unfixed arbitrary user terminal in position.
Preferably, the acquisition parameter includes:At least one of acquisition parameters, camera site.
Preferably, the user terminal further includes:
Display unit is closed for receiving according to the multiple views that the acquisition parameter and the multimedia data resources obtain
At processing result image, according to the configuration of the display parameters of user terminal or the figure that is synthesized from the multiple views of hardware running configuration
It is shown as selecting one in handling result.
A kind of image processing terminal, described image processing terminal include:
Second receiving unit, for receiving acquisition parameter and multimedia data resources based on different points of view;
Image processing unit, for obtaining multiple views synthesis according to the acquisition parameter and the multimedia data resources
Processing result image;
Transmission unit, for sending described image handling result.
Preferably, described image processing unit further comprises:
Subelement is established, for establishing reference coordinate and reference resources;
Comparison subunit, the reference coordinate and reference resources for that will establish and the acquisition parameter and the multimedia
Data resource is compared, and is grouped and therefrom selects and the reference coordinate and reference to the multimedia data resources
The grouped data that resource matches;
Synthesizing subunit, the Data Synthesis for carrying out each viewpoint to the grouped data obtain multiple and different regard
Point data collection is incorporated as the processing result image of multiple views synthesis.
A kind of image processing system, including user terminal described in any one of the above embodiments and image described in any one of the above embodiments
Processing terminal.
The image processing method of the embodiment of the present invention includes:User terminal reports acquisition parameter based on different points of view and more
Media data resource;The user terminal is the unfixed arbitrary user terminal in position;User terminal is received according to the acquisition
The processing result image for the multiple views synthesis that parameter and the multimedia data resources obtain.Since the user terminal is position
Unfixed arbitrary user terminal, then be properly termed as free user using the user of this kind of user terminal, is carried by free user
The data resource of confession without adjusting the parameter of video camera, the position etc. of video camera in advance, to finally can fast, steadily obtain
3D resources are obtained, and are not necessarily to high cost of manufacture.
Specific implementation mode
The implementation of technical solution is described in further detail below in conjunction with the accompanying drawings.
The image processing method of the embodiment of the present invention, as shown in Fig. 2, including the following steps:
Step 101:User terminal reports acquisition parameter and multimedia data resources based on different points of view;The user is whole
End is the unfixed arbitrary user terminal in position.
Here, acquisition parameter and multimedia data resources based on different points of view are for the same photographed scene
's.
Here, the multimedia data resources include:Various multi-medium datas money including text, image and video etc.
Source.
Here, the user terminal is the unfixed arbitrary user terminal in position, then uses the user of this kind of user terminal
It is properly termed as free user.
Step 102:User terminal receives the multiple views obtained according to the acquisition parameter and the multimedia data resources
The processing result image of synthesis.
It need to be noted that be:The user terminal and step 101 of the processing result image of synthesis are received in step 102
The middle user terminal for uploading source data can be different terminal, can also be same terminal.
In one preferred embodiment of the embodiment of the present invention, the acquisition parameter includes:The user terminal is to being adopted
At least one of acquisition parameters, camera site when collection object is acquired.
The acquisition parameters include:Shoot image quality, shooting angle etc..
In one preferred embodiment of the embodiment of the present invention, the method further includes:It receives according to the acquisition parameter
The processing result image of the multiple views synthesis obtained with the multimedia data resources, configures according to the display parameters of user terminal
Or hardware running configuration selects to be shown from the processing result image that the multiple views synthesize.
It need to be noted that be:For the selection is shown, a user terminal can select therein
One or more results are used for showing.
Here, specifically, display parameters are configured to display resolution, hardware running configuration can be terminal operating speed and
The parameter configurations such as resource occupation, it is thus possible to be matched according to display resolution or the parameters such as terminal operating speed and resource occupation
It sets, to select a result for showing, the display necessarily a best image result.
The image processing method of the embodiment of the present invention, as shown in figure 3, including the following steps:
Step 201:Image processing terminal receives acquisition parameter and multimedia data resources based on different points of view.
Step 202:Image processing terminal obtains multiple views according to the acquisition parameter and the multimedia data resources and closes
At processing result image, send described image handling result.
It need to be noted that be:It, can be with after obtaining the processing result image of multiple views synthesis for step 202
Described image handling result is sent to user terminal, can also only provide described image handling result for subsequently using, you can
Not send described image handling result temporarily to user terminal.That is, the final process knot based on image processing terminal
The use of fruit includes several situations:1) one is image processing terminals, for example image processing terminal is a server at this time,
A link is provided by server, user terminal sends acquisition request described image handling result;2) one is image procossing ends
End, for example image processing terminal is a server at this time, is that server is transmitted directly to user terminal, such as the feelings of step 202
Condition;3) it is also possible to be stored in a place can be queried or other operation.
In one preferred embodiment of the embodiment of the present invention, the described image processing terminal in step 202 is adopted according to
Collection parameter and the multimedia data resources obtain the processing result image of multiple views synthesis, including:
Image processing terminal establishes reference coordinate and reference resources;
Image processing terminal by the reference coordinate of foundation and reference resources, with the acquisition parameter and the multi-medium data
Resource is compared, and is grouped and therefrom selects and the reference coordinate and reference resources to the multimedia data resources
The grouped data to match;
The Data Synthesis that each viewpoint is carried out to the grouped data obtains multiple and different viewpoint data sets and is incorporated as
The processing result image of multiple views synthesis.
The user terminal of the embodiment of the present invention, including:Reporting unit, for report acquisition parameter based on different points of view and
Multimedia data resources;First receiving unit is obtained for receiving according to the acquisition parameter and the multimedia data resources
Multiple views synthesis processing result image.
It is to be herein pointed out the user terminal is the unfixed arbitrary user terminal in position.
In one preferred embodiment of the embodiment of the present invention, the acquisition parameter includes:In acquisition parameters, camera site
It is at least one.
In one preferred embodiment of the embodiment of the present invention, the user terminal further includes:Display unit, for receiving
According to the processing result image for the multiple views synthesis that the acquisition parameter and the multimedia data resources obtain, according to user's end
The display parameters at end configure or hardware running configuration selects one from the processing result image that the multiple views synthesize and shown
Show.
The image processing terminal of the embodiment of the present invention, is referred to as focus device, which can be certain individual character
The higher user terminal of energy, can also be a server.
In one preferred embodiment of the embodiment of the present invention, described image processing terminal includes:Second receiving unit, is used for
Receive acquisition parameter and multimedia data resources based on different points of view;Image processing unit, for according to the acquisition parameter
The processing result image of multiple views synthesis is obtained with the multimedia data resources;Transmission unit, for sending at described image
Manage result.
In one preferred embodiment of the embodiment of the present invention, described image processing unit further comprises:It is single to establish son
Member, for establishing reference coordinate and reference resources;Comparison subunit, the reference coordinate and reference resources for that will establish and institute
It states acquisition parameter and the multimedia data resources is compared, the multimedia data resources are grouped and are therefrom selected
Go out the grouped data to match with the reference coordinate and reference resources;Synthesizing subunit, for being carried out to the grouped data
The Data Synthesis of each viewpoint obtains the processing result image that multiple and different viewpoint data sets is incorporated as multiple views synthesis.
The image processing system of the embodiment of the present invention includes above-mentioned user terminal and above-mentioned image processing terminal.
The source of the data resource of the embodiment of the present invention is not limited to fixed user, can actively be carried by each free user
For data resource, 3D application scenarios are not limited to, cover each scene of image procossing, here for convenience, below with 3D
It is described for application scenarios.
Under 3D application scenarios, in the prior art, 3D resources, need such as TV station of resources making side, in advance in order to obtain
Adjust the parameter of video camera, position of video camera etc., that is to say, that need be taken pair when making 3D rendering resource at present
As surrounding places a certain number of video cameras according to certain requirement, camera parameters etc. have been recorded at case before shooting,
The location of video camera needs to be placed on the positions such as different angle, height according to viewpoint, and obtaining data resource, (data resource is
Multimedia data resources, including image and video resource) after, data resource is handled, resources making root is not according to from
The 3D views that different points of view is synthesized with the data of position and its corresponding camera parameters, are presented to the user eventually by program.
It is in the core of whole image processing procedure:How data resource to be obtained, and the prior art is due to being fixed user, fixed position
Set and prepare in advance spent plenty of time and cost.
The embodiment of the present invention is this in order to avoid fixed user is acquired subject under 3D application scenarios
Fixed position and prepare spent plenty of time and cost in advance, it is proposed that free user can also to subject into
Row acquisition, due to being free user, there is no need to be set to camera position in advance, sets camera parameters in advance
It is fixed, it can save plenty of time and cost, moreover, because data resource is from customer-furnished, therefore, image procossing is a kind of
Free view-point composition service scheme, i.e., by the current a large amount of terminal device for carrying related sensor, in its taken the photograph image
Relevant acquisition parameter (including camera parameters information, location information etc.) is carried, and gives associated picture resource to coke
Point device processing, focus device judge and are grouped according to a coordinate-system, by the image resource information of gained, are tied according to detection
These information are carried out View Synthesis by fruit, are formed the data of different points of view, are finally integrated into the 3D data of multiple viewpoints, Ke Yirang
Different user uses.The greatest feature of this programme is exactly that the source of data is free, i.e., has many use for the same scene
These image datas can be carried out viewpoint conjunction by family with the image that the terminal device of oneself is obtained in different angle by this business
At the data for obtaining different angle are truer, therefore referred to as free view-point composition service scheme.
In conclusion the embodiment of the present invention is directed to 3D application scenarios, it is a kind of business side of multimedia 3D multiple views synthesis
Case, including:1) each free user by equipment image or video resource be sent in focus device, focus device can be
The higher terminal device of some performance can also be a server apparatus;2) focus device is evaluated according to set coordinate
The image obtained or video resource are grouped processing by system, judge that optimum image is (so-called optimal to include not only
The picture quality of shooting further includes the angle etc. of shooting), the optimum image for choosing different points of view carries out View Synthesis, is formed not
It is supplied to each user with the image or video data of viewpoint, then the data after the synthesis.
Compared with prior art, it is mainly reflected in following for the superiority of 3D application scenarios using the embodiment of the present invention
Several aspects:
1, the position of each equipment need not be previously set;
2, user is allowed to define relevant parameter and synthetic parameters setting;
3, the ability of user equipment is taken full advantage of.
Scheme one:An implementation under 3D application scenarios:The program is to utilize from customer-furnished data resource
It includes user 1 to obtain View Synthesis 3D rendering or 3D video datas, the program, user 2 ... ... user N, and user 1, user
Equipment used in 2 ... ... user N is used for gathered data resource as each terminal device, and focus device was used for each end
End equipment acquires the image procossing that the data resource summarized carries out multiple views synthesis, as shown in figure 4, including the following steps:
Step 301:Each user shoots corresponding object by respective equipment, obtains corresponding image or video money
Source needs in the resource to carry camera parameters and location parameter etc., and later, focus device provides and the information of user's interaction,
It can such as be swapped by network linking, and corresponding memory space is provided, (user 1, user 2 ... ... user by each user
N) focus device is reported to handle data resource.
Here, data resource includes:The multimedia data resources such as the image or video resource taken the photograph;Reported data resource
When, parameter information, location information of user's video camera etc. can also be carried simultaneously.
Step 302:Focus device is directed to the image procossing that the data resource reported carries out View Synthesis.
Here, step 302 includes:1) reference coordinate and reference resources, setup parameter information are selected in focus device setting;2)
Focus device is by set parameter information and the image or video resource that are obtained, according to the parameter information and coke in resource
Judgement is compared in the parameter information set in point device, is grouped to resource, and resource is in optimized selection;3) it sorts
Image is simultaneously grouped and according to condition does View Synthesis image procossing, i.e. focus device passes through the optimum choice to data, focus device
The Data Synthesis that each viewpoint is carried out to grouped data forms different viewpoint data acquisition systems.
Step 303:The 3D data that focus device obtains View Synthesis store, and generate corresponding information, are supplied to use
Family.
For this programme in free view-point synthesis, the image of taken the photograph object or video resource are supplied to coke by user by network
Point device, focus device distinguish obtained data resource according to set condition, and sorting selects suitable data resource and carries out viewpoint
Synthesis, forms the synthesis 3D data of different points of view, is finally provided to user's use.
Scheme two:An implementation under 3D application scenarios:The program is to be provided using from customer-furnished 3D data
Source forms the masterplate resource used in augmented reality after obtaining View Synthesis 3D rendering or 3D video datas.
Step 401:Each user shoots corresponding object by respective equipment, obtains corresponding image or video money
Source needs in the resource to carry camera parameters and location parameter etc., and later, focus device provides and the information of user's interaction,
It can such as be swapped by network linking, and corresponding memory space is provided, (user 1, user 2 ... ... user by each user
N) focus device is reported to handle data resource.
Here, data resource includes:The image or video resource taken the photograph, parameter information, the location information of user's video camera
Deng.
Step 402:Focus device is directed to the image procossing that the data resource reported carries out View Synthesis.
Here, step 402 includes:1) reference coordinate and reference resources, setup parameter information are selected in focus device setting;2)
Focus device is by set parameter information and the image or video resource that are obtained, according to the parameter information and coke in resource
Judgement is compared in the parameter information set in point device, is grouped to resource, and resource is in optimized selection;3) it sorts
Image is simultaneously grouped and according to condition does View Synthesis image procossing, i.e. focus device passes through the optimum choice to data, focus device
The Data Synthesis that each viewpoint is carried out to grouped data forms different viewpoint data acquisition systems.
Step 403:According to business needs, View Synthesis data are reprocessed, form the template of augmented reality business
Data resource.
Step 404:View Synthesis data are stored and are generated corresponding information by focus device, are supplied to user.User makes
It is convenient caused by augmented reality business to be enjoyed with the template data resource.
For template data resource, for example, in said program one, an essential information is merely provided,
It may also be said that being to record all information, but cannot select to handle, for example shooting obtains the letter in a UEFA Champions League competition field
Breath, including court and sportsman etc. cannot carry out selection and later stage modification, can only constantly carry out viewpoint conjunction with variation
At, obtain it is different as a result, and this programme is to provide a template data resource, the information recorded can be selected
Processing can be changed with the later stage, for example shooting obtains the information in a UEFA Champions League competition field, including court and sportsman etc., by these
Information plays as a template resource if having changed sportsman in the court, can at will replace data, to carry out the later stage
Processing.
Fig. 5-6 is the data format using the schematic diagram of the data format of the embodiment of the present invention, image or video resource
It is the camera site parameter for increasing corresponding camera parameters and the corresponding image or video resource in data format.Video camera
Parameter is provided by the camera on camera terminal, and location parameter can be obtained by the positional sensor devices on camera terminal, such as
The equipment such as electronic compass, GPS can provide corresponding location parameter.Camera parameters and location parameter in addition to as seen in figs. 5-6,
The head data field of resource can also be placed in.
If the module integrated described in the embodiment of the present invention is realized in the form of software function module and as independent production
Product are sold or in use, can also be stored in a computer read/write memory medium.Based on this understanding, the present invention is real
Applying the technical solution of example, substantially the part that contributes to existing technology can embody in the form of software products in other words
Come, which is stored in a storage medium, including some instructions are used so that a computer equipment (can
To be personal computer, server or network equipment etc.) execute the whole or portion of each embodiment the method for the present invention
Point.And storage medium above-mentioned includes:USB flash disk, read-only memory (ROM, Read-Only Memory), is deposited mobile hard disk at random
The various media that can store program code such as access to memory (RAM, Random Access Memory), magnetic disc or CD.
It is combined in this way, the embodiment of the present invention is not limited to any specific hardware and software.
Correspondingly, the embodiment of the present invention also provides a kind of computer storage media, wherein it is stored with computer program, the meter
Method of the calculation machine program for the decision that interoperates with WLAN in executing the terminal housing estate switching of the embodiment of the present invention.
The foregoing is only a preferred embodiment of the present invention, is not intended to limit the scope of the present invention.