CN107330937A - Data handling system and method - Google Patents
Data handling system and method Download PDFInfo
- Publication number
- CN107330937A CN107330937A CN201710513366.2A CN201710513366A CN107330937A CN 107330937 A CN107330937 A CN 107330937A CN 201710513366 A CN201710513366 A CN 201710513366A CN 107330937 A CN107330937 A CN 107330937A
- Authority
- CN
- China
- Prior art keywords
- data
- camera
- measurement apparatus
- processing unit
- line
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
Abstract
Present disclose provides a kind of data handling system, including：Camera, for being shot to reference object to generate corresponding image data；And measurement apparatus, measure to obtain corresponding bearing data for the shooting orientation to camera, wherein, there is signal transmission passage between measurement apparatus and camera, signal transmission passage is used to realize that the bearing data that measurement apparatus measurement is obtained is synchronous with the image data that camera shooting is obtained.The disclosure additionally provides a kind of data processing method.
Description
Technical field
This disclosure relates to a kind of data handling system and method.
Background technology
With the development of science and technology, various camera devices emerge in an endless stream.But requirement of the people to camera technique is also therewith
How more and more higher, handle the data (image data that the bearing data of such as camera device and shooting after obtains) related to shooting
As focus of concern.For example, in augmented reality field, with augmented reality AR (Augmented Reality,
Abbreviation AR) camera site and the angle of camera device are calculated in real time, and corresponding image is handled, the purpose is in electronic equipment
It is enclosed on screen by virtual world in real world and carries out interaction.But, during the embodiment of the present disclosure is implemented, hair
A person of good sense has found at least there is following defect in correlation technique：Image fluency on the display unit after display processing is poor, causes
Poor user experience.
The content of the invention
An aspect of this disclosure provides a kind of data handling system, and the data handling system includes：Camera, is used
In being shot to reference object to generate corresponding image data；And measurement apparatus, for the bat to above-mentioned camera
Orientation is taken the photograph to measure to obtain corresponding bearing data, wherein, there is signal between above-mentioned measurement apparatus and above-mentioned camera
Transmission channel, above-mentioned signal transmission passage is used for the bearing data and above-mentioned camera for realizing that above-mentioned measurement apparatus measurement is obtained
Shoot obtained image data synchronous.
Alternatively, the signal transmission passage between above-mentioned measurement apparatus and above-mentioned camera includes first data transmission
Line, above-mentioned first data transmission line is connected between above-mentioned measurement apparatus and above-mentioned camera；And/or above-mentioned measurement dress
The signal transmission passage put between above-mentioned camera includes wireless transmission link.
Alternatively, above-mentioned measurement apparatus includes aspect sensor；And above-mentioned aspect sensor passes through above-mentioned first data
Transmission line is connected with above-mentioned camera.
Alternatively, above-mentioned measurement apparatus includes：Aspect sensor；And processing unit, for handling above-mentioned sensing directional
The bearing data that device is sensed, wherein, above-mentioned processing unit is connected with above-mentioned aspect sensor by the second data line, and
And, above-mentioned processing unit is connected by above-mentioned first data transmission line with above-mentioned camera.
Alternatively, said system also includes：3rd data line；Strobe unit, for determine above-mentioned measurement apparatus with
The transmission route of data syn-chronization is carried out between above-mentioned camera, above-mentioned transmission route includes：Above-mentioned aspect sensor passes through upper
State the transmission route that the 3rd data line carries out data syn-chronization with above-mentioned camera；And/or above-mentioned aspect sensor
Data are carried out by above-mentioned second data line, above-mentioned processing unit and above-mentioned first data transmission line and above-mentioned camera
Synchronous transmission route.
Alternatively, said system also includes：Control device, is connected between above-mentioned processing unit and above-mentioned camera,
For controlling above-mentioned measurement apparatus to measure the shooting orientation of above-mentioned camera, and by after the processing of above-mentioned processing unit
Bearing data is transmitted to above-mentioned camera.
Alternatively, above-mentioned measurement apparatus is connected with above-mentioned control device by the 4th data line, so that above-mentioned measurement
Device transmits the bearing data after processing to above-mentioned control device.
Alternatively, above-mentioned second data line, above-mentioned 3rd data line, and/or above-mentioned 4th data line
In at least one or more include I2C buses.
According to another aspect of the present disclosure, a kind of data processing method is additionally provided, including：By camera to shooting
Object is shot to generate corresponding image data；The shooting orientation of above-mentioned camera is measured by measurement apparatus
To obtain corresponding bearing data；And will be upper by the signal transmission passage between above-mentioned measurement apparatus and above-mentioned camera
Stating the bearing data that measurement apparatus measurement obtains, that obtained image data is shot with above-mentioned camera is synchronous.
Alternatively, above-mentioned signal transmission passage includes first data transmission line, and above-mentioned data processing method also includes：It is above-mentioned
The aspect sensor of measurement apparatus measures the shooting orientation of above-mentioned camera, obtains corresponding bearing data；And above-mentioned side
Level sensor is transmitted above-mentioned bearing data to above-mentioned camera by above-mentioned first data transmission line, to realize above-mentioned measurement
It is synchronous that the bearing data that measurement device is obtained shoots obtained image data with above-mentioned camera.
Alternatively, above-mentioned signal transmission passage includes first data transmission line, and above-mentioned measurement apparatus includes aspect sensor；
And processing unit, for handling the bearing data that above-mentioned aspect sensor is sensed, wherein, above-mentioned processing unit and above-mentioned side
Level sensor is connected by the second data line, and above-mentioned processing unit is filled by above-mentioned first data transmission line and above-mentioned photography
Connection is put, the above method also includes：Above-mentioned aspect sensor measures the shooting orientation of above-mentioned camera, obtains corresponding orientation
Data；Above-mentioned aspect sensor is transmitted above-mentioned bearing data to above-mentioned processing unit by above-mentioned second data line；With
And above-mentioned processing unit is transmitted the bearing data after processing to above-mentioned camera, with reality by above-mentioned first data transmission line
It is synchronous that bearing data after existing above-mentioned processing shoots obtained image data with above-mentioned camera.
Another aspect of the present disclosure provides a kind of non-volatile memory medium, and be stored with computer executable instructions, on
Stating instruction is used to realize the method described in any of the above-described when executed.
Another aspect of the present disclosure provides a kind of computer program, and above computer program includes the executable finger of computer
Order, above-mentioned instruction is used to realize the method described in any of the above-described when executed.
Brief description of the drawings
In order to be more fully understood from the disclosure and its advantage, referring now to the following description with reference to accompanying drawing, wherein：
Figure 1A diagrammatically illustrates the schematic diagram of the data handling system according to the embodiment of the present disclosure；
Figure 1B diagrammatically illustrates the schematic diagram of the data handling system according to another embodiment of the disclosure；
Fig. 2A diagrammatically illustrates the schematic diagram of the data handling system according to another embodiment of the disclosure；
Fig. 2 B diagrammatically illustrate the schematic diagram of the data handling system according to another embodiment of the disclosure；
Fig. 3 A diagrammatically illustrate the schematic diagram of the data handling system according to another embodiment of the disclosure；
Fig. 3 B diagrammatically illustrate the schematic diagram of the data handling system according to another embodiment of the disclosure；
Fig. 4 diagrammatically illustrates the flow chart of the data processing method according to the embodiment of the present disclosure；
Fig. 5 A diagrammatically illustrate the flow chart of the data processing method according to another embodiment of the disclosure；
Fig. 5 B diagrammatically illustrate the flow chart of the data processing method according to another embodiment of the disclosure；And
Fig. 6 diagrammatically illustrates the block diagram of the data handling system according to another embodiment of the disclosure.
Embodiment
Hereinafter, it will be described with reference to the accompanying drawings embodiment of the disclosure.However, it should be understood that these descriptions are simply exemplary
, and it is not intended to limit the scope of the present disclosure.In addition, in the following description, the description to known features and technology is eliminated, with
Avoid unnecessarily obscuring the concept of the disclosure.
Term as used herein is not intended to limit the disclosure just for the sake of description specific embodiment.Used here as
Word " one ", " one (kind) " and "the" etc. should also include " multiple ", the meaning of " a variety of ", unless context clearly refers in addition
Go out.In addition, term " comprising " as used herein, "comprising" etc. indicate the presence of the feature, step, operation and/or part,
But it is not excluded that in the presence of or add one or more other features, step, operation or part.
All terms (including technology and scientific terminology) as used herein have what those skilled in the art were generally understood
Implication, unless otherwise defined.It should be noted that term used herein should be interpreted that with consistent with the context of this specification
Implication, without that should be explained with idealization or excessively mechanical mode.
Shown in the drawings of some block diagrams and/or flow chart.It should be understood that some sides in block diagram and/or flow chart
Frame or its combination can be realized by computer program instructions.These computer program instructions can be supplied to all-purpose computer,
The processor of special-purpose computer or other programmable data processing units, so that these instructions can be with when by the computing device
Create the device for realizing function/operation illustrated in these block diagrams and/or flow chart.
Therefore, the technology of the disclosure can be realized in the form of hardware and/or software (including firmware, microcode etc.).Separately
Outside, the technology of the disclosure can take the form of the computer program product on the computer-readable medium for the instruction that is stored with, should
Computer program product is available for instruction execution system use or combined command execution system to use.In the context of the disclosure
In, computer-readable medium can include, store, transmit, propagate or transmit the arbitrary medium of instruction.For example, calculating
Machine computer-readable recording medium can include but is not limited to electricity, magnetic, optical, electromagnetic, infrared or semiconductor system, device, device or propagation medium.
The specific example of computer-readable medium includes：Magnetic memory apparatus, such as tape or hard disk (HDD)；Light storage device, such as CD
(CD-ROM)；Memory, such as random access memory (RAM) or flash memory；And/or wire/wireless communication link.
With the continuous progress of science and technology, the operational capability of electronic product is more and more stronger, the purposes of augmented reality
Also it is more and more wider.Augmented reality carries out real world information and virtual world information integrated so that the real generation of script
In boundary, the entity information that can not be experienced in certain time spatial dimension carries out simulation imitative by science and technology such as computers
After very, user can perceive the presence of virtual world, so as to improve Consumer's Experience.Wherein, by real world information and virtual generation
The technology of more key is the image and photography dress for handling the real world of camera intake when boundary's information carries out integrated
Put the bearing data when absorbing the image of real world.
Embodiment of the disclosure provides a kind of data handling system and data processing method.The data handling system includes
Including camera and measurement apparatus.Camera is used to reference object is shot to generate corresponding image data.Survey
Amount device is used to measure to obtain corresponding bearing data the shooting orientation of camera, wherein, measurement apparatus is with taking the photograph
There is signal transmission passage between image device, signal transmission passage is used for the bearing data and photography for realizing that measurement apparatus measurement is obtained
It is synchronous that device shoots obtained image data.
It is understood that the embodiment of the present disclosure can be applied not only to augmented reality field, it can also be applied to
The various fields of the processing data related to photography.
Figure 1A diagrammatically illustrates the schematic diagram of the data handling system according to the embodiment of the present disclosure.
As shown in Figure 1A, the data handling system 100 includes camera 110 and measurement apparatus 120, wherein, photography dress
Putting has signal transmission passage between 110 and measurement apparatus 120, signal transmission passage is used to realize the side that measurement apparatus measurement is obtained
It is synchronous that position data shoot obtained image data with camera.
By embodiment of the disclosure, the object in real world is shot by camera, formed photo or
Other image datas such as person's video, by the shooting orientation of measurement apparatus metric photography device to obtain corresponding bearing data,
Pass through the signal transmission passage between measurement apparatus and camera so that can directly enter between measurement apparatus and camera
Row data transfer, it is not necessary to carry out data transmission by other controllers, can not only simplify system design, has reached measurement dress
Putting the data between camera can share in time, realize the effect of synchrodata, and this improves augmented reality skill
Image fluency in art, and improve Consumer's Experience.
In accordance with an embodiment of the present disclosure, the signal transmission passage between measurement apparatus and camera is passed including the first data
Defeated line, first data transmission line is connected between measurement apparatus and camera；And/or measurement apparatus and camera it
Between signal transmission passage include wireless transmission link.
Figure 1B diagrammatically illustrates the schematic diagram of the data handling system according to the embodiment of the present disclosure.
As shown in Figure 1B, the data handling system 100 includes camera 110 and measurement apparatus 120, wherein, photography dress
110 are put with measurement apparatus 120 by first data transmission line 130 to be connected.
In accordance with an embodiment of the present disclosure, camera 110 is used to reference object is shot to generate corresponding image
Data.
In accordance with an embodiment of the present disclosure, camera 110 can be used for shooting object in real world, is formed and shone
Other image datas such as piece or video, camera 110 can be DV, can be supervising device (such as camera)
Etc. other cameras with shoot function, in accordance with an embodiment of the present disclosure, camera 110 can be automatically moved, 360 degree
Full-automatic inverting, can also be automatically snapped.
Measurement apparatus 120, is measured to obtain corresponding bearing data for the shooting orientation to camera 110,
Wherein, measurement apparatus 120 is connected by first data transmission line 130 with camera 110, to allow measurement apparatus 120 with taking the photograph
Data syn-chronization is realized between image device 110.
In accordance with an embodiment of the present disclosure, when being shot to reference object, in order to reach optimal shooting effect, or
In order to the world that truly reflects reality, camera 110 may need movement in shooting process is carried out to reference object,
Shooting angle is converted, or changes shooting speed to adapt to the things of change.
In order to make real world information and virtual world information reach preferably integrated result, it can be filled by measuring
The shooting orientation of 120 metric photography devices 110 is put, to obtain corresponding bearing data.The bearing data of camera 110 can be with
It is following any or a variety of：The position of reference object and the spot for photography of camera 110, the shooting of camera 110
The movement velocity or acceleration of angle or camera 110 when shooting etc..In accordance with an embodiment of the present disclosure, camera
110 are connected with measurement apparatus 120 by first data transmission line 130, and first data transmission line 130 can be used in photography dress
Put and carry out data transmission between 110 and measurement apparatus 120, to reach the effect of data syn-chronization.
In accordance with an embodiment of the present disclosure, the signal transmission passage between measurement apparatus and camera includes wireless transmission line
Road, by the wireless transmission link between measurement apparatus and camera, the bearing data that measurement apparatus measurement can be obtained
Data syn-chronization is carried out with the image data that camera is shot, wherein, realize that the mode being wirelessly transferred can have various ways, example
Such as, after by bluetooth connection, data transfer is realized by Bluetooth transmission link, or by wireless communication connection, realizes number
According to transmission.In accordance with an embodiment of the present disclosure, in this case, the effect of synchrodata can be not only reached, and is simplified
The design of data handling system.
It should be noted that the signal transmission passage between measurement apparatus and camera can include the first data simultaneously
Transmission line and wireless transmission link.In accordance with an embodiment of the present disclosure, the effect of synchrodata can be not only reached, and is improved
The reliability of data transmission link.
By embodiment of the disclosure, the object in real world is shot by camera, formed photo or
Other image datas such as person's video, by the shooting orientation of measurement apparatus metric photography device to obtain corresponding bearing data,
Measurement apparatus and camera are connected by first data transmission line, and/or by between measurement apparatus and camera
Wireless transmission link so that can directly carry out data transmission between measurement apparatus and camera, it is not necessary to pass through other
Controller carries out data transmission, and can not only simplify system design, has reached the data energy between measurement apparatus and camera
It is enough shared in time, realize the effect of synchrodata.And the image fluency in augmented reality can be improved, improve and use
Experience at family.
Below with reference to Fig. 2A~Fig. 3 B, the data handling system shown in Fig. 1 is described further in conjunction with specific embodiments.
In accordance with an embodiment of the present disclosure, measurement apparatus can include aspect sensor；And aspect sensor can pass through
First data transmission line is connected with camera.
Fig. 2A diagrammatically illustrates the schematic diagram of the data handling system according to another embodiment of the disclosure.
As shown in Figure 2 A, the data handling system 100 includes camera 110 and measurement apparatus 120.Measurement apparatus 120
Aspect sensor 121 can be included, also, aspect sensor 121 is connected by first data transmission line 130 with camera 110
Connect.
In accordance with an embodiment of the present disclosure, one or more aspect sensors 121 can be included in measurement apparatus 120 (in figure
Illustrate only includes the situation of an aspect sensor 121), the shooting orientation of the metric photography device 110 of measurement apparatus 120 with
Can be to camera 110 by one or more of measurement apparatus 120 aspect sensor 121 to corresponding bearing data
Shooting orientation measure., can be with it should be noted that when needing multiple orientation to camera 110 to measure
Camera 110 is measured using multiple aspect sensors 121.Enter when needing some orientation to camera 110
During row measurement, camera 110 can be measured using an aspect sensor 121.Passed when with one or more orientation
When sensor 121 is measured to the shooting orientation of camera 110, aspect sensor 121 and camera 110 are passed through first
Data line 130 is connected, to realize the data transfer between aspect sensor 121 and camera 110.
By embodiment of the disclosure, object in real world is shot by camera, formed photo or
Other image datas such as video, by the shooting orientation of aspect sensor metric photography device to obtain corresponding bearing data,
Pass through first data transmission line connection orientation sensor and camera so that can be straight between aspect sensor and camera
Connect and carry out data transmission, it is not necessary to carry out data transmission by other controllers, reached aspect sensor and camera it
Between data can share in time, realize the effect of data syn-chronization.
In accordance with an embodiment of the present disclosure, measurement apparatus can include：Aspect sensor；And processing unit, for handling
The bearing data that aspect sensor is sensed, wherein, processing unit is connected with aspect sensor by the second data line, and
And, processing unit is connected by first data transmission line with camera.
Fig. 2 B diagrammatically illustrate the schematic diagram of the data handling system according to another embodiment of the disclosure.
As shown in Figure 2 B, the data handling system 100 includes camera 110 and measurement apparatus 120.Measurement apparatus 120
Including aspect sensor 121 and processing unit 122, processing unit 122 is used to handle the orientation that aspect sensor 121 is sensed
Data, wherein, processing unit 122 is connected with aspect sensor 121 by the second data line 140, also, processing unit
122 are connected by first data transmission line 130 with camera 110.
In accordance with an embodiment of the present disclosure, when needing multiple orientation to camera 110 to measure, it can use many
Individual aspect sensor 121 is measured to camera 110, when multiple aspect sensors 121 are measured to camera 110
When, obtaining the bearing data of camera 110 can be handled by processing unit 122, after being handled through processing unit 122
Bearing data has predetermined data format, is carried out data transmission by first data transmission line 130 with camera 110, needs
It is noted that it is by the second data line 140 to carry out data transmission between processing unit 122 and aspect sensor 121
It is transmitted.
By embodiment of the disclosure, the orientation of camera is measured using one or more aspect sensors
When, the data format for the bearing data that aspect sensor is sensed is likely difficult to reach the requirement of data transfer.By by orientation
Sensor is connected with processing unit, and processing unit can handle the bearing data that aspect sensor is sensed, to obtain being suitable to number
According to the data format requirement of transmission, so as to reach transmission data in time, the effect of synchrodata further, can be realized true
Real world information is preferably integrated with virtual world information, improves Consumer's Experience.
Fig. 3 A diagrammatically illustrate the schematic diagram of the data handling system according to another embodiment of the disclosure.
In accordance with an embodiment of the present disclosure, data handling system can also include the 3rd data line and strobe unit.Choosing
Exchange device is used to determine the transmission route that data syn-chronization is carried out between measurement apparatus and camera, and transmission route can include：
Aspect sensor carries out the transmission route of data syn-chronization by the 3rd data line and camera；And/or orientation is passed
Sensor carries out the transmission road of data syn-chronization by the second data line, processing unit and first data transmission line and camera
Line.
Specifically, as shown in Figure 3A, the data handling system 100 can include camera 110, measurement apparatus 120, choosing
Exchange device 160.Measurement apparatus 120 can include aspect sensor 121 and processing unit 122.Strobe unit 160 is used to determine
The transmission route of data syn-chronization is carried out between measurement apparatus 120 and camera 110, transmission route includes aspect sensor 121
The transmission route of data syn-chronization, and/or aspect sensor are carried out with camera 110 by the 3rd data line 150
121 carry out data by the second data line 140, processing unit 122 and first data transmission line 130 and camera 110
Synchronous transmission route.
In accordance with an embodiment of the present disclosure, strobe unit 160 has to enter between selection measurement apparatus 120 and camera 110
The function of the transmission route of row data syn-chronization.Wherein, transmission line is including a variety of, for example, the first transmission line is to pass through side
Level sensor 121 carries out the transmission route of data syn-chronization by the 3rd data line 150 with camera 110.Second of biography
Defeated circuit is for aspect sensor 121 by the second data line 140, processing unit 122 and first data transmission line 130 with taking the photograph
Image device 110 carries out the transmission route of data syn-chronization.The third transmission line is the first above-mentioned transmission line and second of biography
Can be simultaneously by first when carrying out data syn-chronization between the combination of defeated circuit, i.e. measurement apparatus 120 and camera 110
Plant transmission line and second of transmission line carries out data transmission.
, can be using a variety of transmission lines simultaneously when the data volume for needing to transmit is more by embodiment of the disclosure
Carry out data transmission., can be using above-mentioned second biography when can be just transmitted after the data of transmission need to be pre-processed
Defeated circuit carries out data transmission.By the above-mentioned means, having reached a variety of transmission line simultaneous transmissions or having selected a kind of its transmission line
The effect of road transmission, is conducive to ensureing the stability of data transfer.
Fig. 3 B diagrammatically illustrate the schematic diagram of the data handling system according to another embodiment of the disclosure.
In accordance with an embodiment of the present disclosure, data transmission system can also include control device, be connected to processing unit and take the photograph
Between image device, the shooting orientation of camera is measured for control and measure device, and after processing unit is handled
Bearing data is transmitted to camera.
Specifically, as shown in Figure 3 B, the data handling system 100 can include camera 110, measurement apparatus 120, control
Device 170 processed.Measurement apparatus 120 can include aspect sensor 121 and processing unit 122.Control device 170 is connected to place
Manage between device 122 and camera 110, the shooting orientation of camera 110 is surveyed for control and measure device 120
Amount, and bearing data after processing unit 122 is handled transmitted to camera 110.
In accordance with an embodiment of the present disclosure, in order to realize the orientation number of the automatic measurement camera 110 of measurement apparatus 120
According to can be controlled using control device 170 to measurement apparatus 120.It will be handled at the same time it can also control process device 122
Back side data transfer is to camera 110, and the orientation after processing unit 122 is handled by control device 170 itself
Data transfer is to camera 110.
In accordance with an embodiment of the present disclosure, measurement apparatus 120 is connected with control device 170 by the 4th data line 180,
So that measurement apparatus 120 transmits the bearing data after processing to control device 170.
In accordance with an embodiment of the present disclosure, to enter between measurement apparatus and control device by the 4th data line
Row data transfer, has reached control and measure device to realize the effect of automatic measurement.
In accordance with an embodiment of the present disclosure, the second data line, the 3rd data line, and/or the 4th data line
In at least one or more include I2C buses.
In accordance with an embodiment of the present disclosure, I2C buses are a kind of general universal serial bus, with data transmission bauds having soon
At least one or more biography in beneficial effect, the second data line, the 3rd data line, and/or the 4th data line
When defeated line is 12C buses, quick transmission data can be reached to realize the effect of data syn-chronization.
In accordance with an embodiment of the present disclosure, data handling system goes for mobile phone, personal computer, augmented reality eye
Mirror, head mounted display etc. electronic equipment, will not be repeated here.
Fig. 4 diagrammatically illustrates the flow chart of the data processing method according to the embodiment of the present disclosure.
As shown in figure 4, this method includes operation S401~S403.
In operation S401, reference object is shot by camera to generate corresponding image data.
In operation S402, the shooting orientation of camera is measured by measurement apparatus to obtain corresponding orientation number
According to.
In operation S403, measurement apparatus measurement is obtained by the signal transmission passage between measurement apparatus and camera
Bearing data and camera to shoot obtained image data synchronous.
In accordance with an embodiment of the present disclosure, object in real world is shot by camera, formed photo or
Other image datas such as video, by the shooting orientation of measurement apparatus metric photography device to obtain corresponding bearing data, lead to
The signal transmission passage crossed between measurement apparatus and camera so that can directly be carried out between measurement apparatus and camera
Data transfer, it is not necessary to carry out data transmission by other controllers, can not only simplify system design, reach measurement apparatus
Data between camera can be shared in time, realize the effect of data syn-chronization, and can improve augmented reality skill
Image fluency in art, improves Consumer's Experience.
Below with reference to Fig. 5 A and Fig. 5 B, the method shown in Fig. 4 is described further in conjunction with specific embodiments.
In accordance with an embodiment of the present disclosure, signal transmission passage includes first data transmission line, and data processing method also includes：
The shooting orientation of the aspect sensor metric photography device of measurement apparatus, obtains corresponding bearing data；And aspect sensor
Bearing data is transmitted to camera by first data transmission line, with realize bearing data that measurement apparatus measurement obtains with
It is synchronous that camera shoots obtained image data.
Fig. 5 A diagrammatically illustrate the flow chart of the data processing method according to another embodiment of the disclosure.In the embodiment
In, except the corresponding operating including being described above with reference to Fig. 4, this method includes operation S501 and S502, succinct for description
For the sake of, eliminate and operated accordingly in accompanying drawing 4.
As shown in Figure 5A, this method includes operation S501 and S502.
In operation S501, the shooting orientation of the aspect sensor metric photography device of measurement apparatus obtains corresponding orientation
Data.
In operation S502, aspect sensor is transmitted bearing data to camera by first data transmission line, with reality
It is synchronous that the bearing data that existing measurement apparatus measurement is obtained shoots obtained image data with camera.
By embodiment of the disclosure, object in real world is shot by camera, formed photo or
Other image datas such as video, by the shooting orientation of aspect sensor metric photography device to obtain corresponding bearing data,
Pass through first data transmission line connection orientation sensor and camera so that can be straight between aspect sensor and camera
Connect and carry out data transmission, it is not necessary to carry out data transmission by other controllers, reached aspect sensor and camera it
Between data can share in time, realize the effect of data syn-chronization.
In accordance with an embodiment of the present disclosure, signal transmission passage includes first data transmission line, and measurement apparatus can include side
Level sensor and processing unit.Processing unit is used to handle the bearing data that aspect sensor is sensed, wherein, processing unit
It is connected with aspect sensor by the second data line, processing unit is connected by first data transmission line with camera.
Data processing method can also include the shooting orientation of aspect sensor metric photography device, obtain corresponding bearing data.Side
Level sensor is transmitted bearing data to processing unit by the second data line.And processing unit is passed by the first data
Defeated line transmits the bearing data after processing to camera, is obtained with realizing that the bearing data after processing is shot with camera
Image data it is synchronous.
Fig. 5 B diagrammatically illustrate the flow chart of the data processing method according to another embodiment of the disclosure.In the embodiment
In, except the corresponding operating including being described above with reference to Fig. 4, this method also includes operation S601~S603, for the letter of description
For the sake of clean, eliminate and operated accordingly in accompanying drawing 4.
As shown in Figure 5 B, this method includes operation S601~S603.
In operation S601, the shooting orientation of aspect sensor metric photography device obtains corresponding bearing data.
In operation S602, aspect sensor is transmitted bearing data to processing unit by the second data line.
In operation S603, the bearing data after processing is transmitted to photography and filled by processing unit by first data transmission line
Put, to realize that the image data that the bearing data after processing and camera shooting are obtained is synchronous.
By embodiment of the disclosure, the orientation of camera is measured using one or more aspect sensors
When, the data format for the bearing data that aspect sensor is sensed is likely difficult to reach the requirement of data transfer.By by orientation
Sensor is connected with processing unit, and processing unit can handle the bearing data that aspect sensor is sensed, to obtain being suitable to number
According to the data format requirement of transmission, so as to reach that data are transmitted in time, the effect of data syn-chronization further, can be realized true
Real world information is preferably integrated with virtual world information, improves Consumer's Experience.
In accordance with an embodiment of the present disclosure, after augmented reality application call, camera device can be notified to obtain image data,
Camera device reads the bearing data that measurement apparatus is measured in real time by I2C buses simultaneously, completes data-frame sync function.Finally
Data are reported into augmented reality application to be handled accordingly.In accordance with an embodiment of the present disclosure, bottom hardware mode solution is passed through
Certainly data synchronization problems between camera device and measurement apparatus.Ensure the good Consumer's Experience of augmented reality application.
Fig. 6 diagrammatically illustrates the block diagram of the data handling system according to another embodiment of the disclosure.
As shown in fig. 6, data handling system 700 includes processor 710, computer-readable recording medium 720, camera
730 and measurement apparatus 740.The data handling system 700 can perform the method described above with reference to Fig. 4~Fig. 5 B.
Specifically, processor 710 can for example include general purpose microprocessor, instruction set processor and/or related chip group
And/or special microprocessor (for example, application specific integrated circuit (ASIC)), etc..Processor 710 can also include being used to cache using
The onboard storage device on way.Processor 710 can be used for control camera 730 and measurement apparatus 740 with perform with reference to Fig. 4~
The either multiple processing of single treatment unit of the different actions of the method flow according to the embodiment of the present disclosure of Fig. 5 B descriptions are single
Member.
Computer-readable recording medium 720, for example, can be that can include, store, transmit, propagate or transmit appointing for instruction
Meaning medium.For example, readable storage medium storing program for executing can include but is not limited to electricity, magnetic, optical, electromagnetic, infrared or semiconductor system, device,
Device or propagation medium.The specific example of readable storage medium storing program for executing includes：Magnetic memory apparatus, such as tape or hard disk (HDD)；Optical storage
Device, such as CD (CD-ROM)；Memory, such as random access memory (RAM) or flash memory；And/or wire/wireless communication chain
Road.
Computer-readable recording medium 720 can include computer program 721, and the computer program 721 can include generation
Code/computer executable instructions, it by processor 710 when being performed so that processor 710 controls camera 730 and measurement to fill
740 are put to realize for example above in conjunction with the method flow described by Fig. 4~Fig. 5 B and its any deformation.
Computer program 721 can be configured with such as computer program code including computer program module.Example
Such as, in the exemplary embodiment, the code in computer program 721 can include one or more program modules, for example including
721A, module 721B ....It should be noted that the dividing mode and number of module are not fixed, those skilled in the art can
To be combined according to actual conditions using suitable program module or program module, when the combination of these program modules is by processor 710
During execution so that processor 710 can control camera 730 and measurement apparatus 740 to realize for example above in conjunction with Fig. 4~figure
Method flow and its any deformation described by 5B.
In accordance with an embodiment of the present disclosure, processor 710 can control camera 730 and measurement apparatus 740, on performing
Method flow and its any deformation of the face with reference to described by Fig. 4~Fig. 5 B.
It will be understood by those skilled in the art that the feature described in each embodiment and/or claim of the disclosure can
To carry out multiple combinations or/or combination, even if such combination or combination are not expressly recited in the disclosure.Especially, exist
In the case of not departing from disclosure spirit or teaching, the feature described in each embodiment and/or claim of the disclosure can
To carry out multiple combinations and/or combination.All these combinations and/or combination each fall within the scope of the present disclosure.
Although the disclosure, art technology has shown and described in the certain exemplary embodiments with reference to the disclosure
Personnel it should be understood that without departing substantially from appended claims and its equivalent restriction spirit and scope of the present disclosure in the case of,
A variety of changes in form and details can be carried out to the disclosure.Therefore, the scope of the present disclosure should not necessarily be limited by above-described embodiment,
But not only should be determined by appended claims, also it is defined by the equivalent of appended claims.
Claims (10)
1. a kind of data handling system, including：
Camera, for being shot to reference object to generate corresponding image data；And
Measurement apparatus, is measured to obtain corresponding bearing data for the shooting orientation to the camera, wherein, institute
Stating has signal transmission passage between measurement apparatus and the camera, the signal transmission passage is used to realize the measurement dress
It is synchronous with the image data that camera shooting is obtained to put the obtained bearing data of measurement.
2. system according to claim 1, wherein：
Signal transmission passage between the measurement apparatus and the camera includes first data transmission line, first number
It is connected to according to transmission line between the measurement apparatus and the camera；And/or
Signal transmission passage between the measurement apparatus and the camera includes wireless transmission link.
3. system according to claim 2, wherein：
The measurement apparatus includes aspect sensor；And
The aspect sensor is connected by the first data transmission line with the camera.
4. system according to claim 2, wherein：
The measurement apparatus includes：
Aspect sensor；And
Processing unit, for handling the bearing data that the aspect sensor is sensed, wherein, the processing unit and the side
Level sensor is connected by the second data line, also, the processing unit by the first data transmission line with it is described
Camera is connected.
5. system according to claim 4, wherein, the system also includes：
3rd data line；
Strobe unit, the transmission route for determining progress data syn-chronization between the measurement apparatus and the camera, institute
Stating transmission route includes：
The aspect sensor carries out the transmission route of data syn-chronization by the 3rd data line and the camera；
And/or
The aspect sensor passes through second data line, the processing unit and the first data transmission line and institute
State the transmission route that camera carries out data syn-chronization.
6. system according to claim 4, wherein, the system also includes：
Control device, is connected between the processing unit and the camera, for controlling the measurement apparatus to described
The shooting orientation of camera is measured, and the bearing data after processing unit processing is transmitted to the photography dress
Put；
Wherein, the measurement apparatus is connected with the control device by the 4th data line, so that the measurement apparatus will
Bearing data after processing is transmitted to the control device.
7. the system according to claim 3 or 6, wherein, second data line, the 3rd data line,
And/or at least one or more in the 4th data line includes I2C buses.
8. a kind of data processing method, including：
Reference object is shot by camera to generate corresponding image data；
The shooting orientation of the camera is measured by measurement apparatus to obtain corresponding bearing data；And
The measurement apparatus measurement is obtained by the signal transmission passage between the measurement apparatus and the camera
It is synchronous that bearing data shoots obtained image data with the camera.
9. method according to claim 8, wherein, the signal transmission passage includes first data transmission line, the side
Method also includes：
The aspect sensor of the measurement apparatus measures the shooting orientation of the camera, obtains corresponding bearing data；With
And
The aspect sensor is transmitted the bearing data to the camera, with reality by the first data transmission line
It is synchronous that the bearing data that the existing measurement apparatus measurement is obtained shoots obtained image data with the camera.
10. method according to claim 8, wherein, the signal transmission passage includes first data transmission line, the survey
Measuring device includes aspect sensor；And processing unit, for handling the bearing data that the aspect sensor is sensed, its
In, the processing unit is connected with the aspect sensor by the second data line, and the processing unit passes through described
One data line is connected with the camera, and methods described also includes：
The aspect sensor measures the shooting orientation of the camera, obtains corresponding bearing data；
The aspect sensor is transmitted the bearing data to the processing unit by second data line；And
The processing unit is transmitted the bearing data after processing to the camera by the first data transmission line, with
Realize that the bearing data after the processing shoots obtained image data with the camera synchronous.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710513366.2A CN107330937B (en) | 2017-06-28 | 2017-06-28 | Data processing system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710513366.2A CN107330937B (en) | 2017-06-28 | 2017-06-28 | Data processing system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107330937A true CN107330937A (en) | 2017-11-07 |
| CN107330937B CN107330937B (en) | 2021-05-18 |
Family
ID=60198962
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710513366.2A Active CN107330937B (en) | 2017-06-28 | 2017-06-28 | Data processing system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107330937B (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101316323A (en) * | 2007-05-31 | 2008-12-03 | 曾建都 | Intelligent camera with image direction |
| US20100085470A1 (en) * | 2008-10-07 | 2010-04-08 | Canon Kabushiki Kaisha | Automatic focusing apparatus |
| CN102334137A (en) * | 2009-02-20 | 2012-01-25 | 株式会社尼康 | Portable information device, image capturing device, and information acquiring system |
| CN202956107U (en) * | 2012-09-13 | 2013-05-29 | 北京同步科技有限公司 | Device used for obtaining gesture data of camera |
| CN103673990A (en) * | 2012-09-13 | 2014-03-26 | 北京同步科技有限公司 | Device and method for obtaining camera posture data |
| CN103685903A (en) * | 2012-09-13 | 2014-03-26 | 北京同步科技有限公司 | Camera attitude data transmission device and camera attitude data transmission method |
| CN104224095A (en) * | 2013-06-21 | 2014-12-24 | 全视技术有限公司 | Image sensor with integrated orientation indicator background |
| CN104484988A (en) * | 2014-11-18 | 2015-04-01 | 浙江大学 | Automatic space structure health monitoring system based on curved-surface wall-climbing robot sensor |
| CN104598028A (en) * | 2015-01-09 | 2015-05-06 | 上海小蚁科技有限公司 | Image pickup device and image pickup method |
| CN105323487A (en) * | 2015-11-20 | 2016-02-10 | 广州亿航智能技术有限公司 | Camera apparatus pointing direction control device |
| CN105627991A (en) * | 2015-12-21 | 2016-06-01 | 武汉大学 | Real-time panoramic stitching method and system for unmanned aerial vehicle images |
| CN106027909A (en) * | 2016-07-05 | 2016-10-12 | 大连海事大学 | System and method for synchronously collecting shipboard videos based on MEMS inertial sensor and camera |
-
2017
- 2017-06-28 CN CN201710513366.2A patent/CN107330937B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101316323A (en) * | 2007-05-31 | 2008-12-03 | 曾建都 | Intelligent camera with image direction |
| US20100085470A1 (en) * | 2008-10-07 | 2010-04-08 | Canon Kabushiki Kaisha | Automatic focusing apparatus |
| CN102334137A (en) * | 2009-02-20 | 2012-01-25 | 株式会社尼康 | Portable information device, image capturing device, and information acquiring system |
| CN202956107U (en) * | 2012-09-13 | 2013-05-29 | 北京同步科技有限公司 | Device used for obtaining gesture data of camera |
| CN103673990A (en) * | 2012-09-13 | 2014-03-26 | 北京同步科技有限公司 | Device and method for obtaining camera posture data |
| CN103685903A (en) * | 2012-09-13 | 2014-03-26 | 北京同步科技有限公司 | Camera attitude data transmission device and camera attitude data transmission method |
| CN104224095A (en) * | 2013-06-21 | 2014-12-24 | 全视技术有限公司 | Image sensor with integrated orientation indicator background |
| CN104484988A (en) * | 2014-11-18 | 2015-04-01 | 浙江大学 | Automatic space structure health monitoring system based on curved-surface wall-climbing robot sensor |
| CN104598028A (en) * | 2015-01-09 | 2015-05-06 | 上海小蚁科技有限公司 | Image pickup device and image pickup method |
| CN105323487A (en) * | 2015-11-20 | 2016-02-10 | 广州亿航智能技术有限公司 | Camera apparatus pointing direction control device |
| CN105627991A (en) * | 2015-12-21 | 2016-06-01 | 武汉大学 | Real-time panoramic stitching method and system for unmanned aerial vehicle images |
| CN106027909A (en) * | 2016-07-05 | 2016-10-12 | 大连海事大学 | System and method for synchronously collecting shipboard videos based on MEMS inertial sensor and camera |
Non-Patent Citations (1)
| Title |
|---|
| 唐丽玉 等: "视频图像中监控目标的空间定位方法", 《福州大学学报( 自然科学版)》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107330937B (en) | 2021-05-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11886633B2 (en) | Virtual object display interface between a wearable device and a mobile device | |
| US20210366449A1 (en) | Computer vision and mapping for audio applications | |
| EP3673345B1 (en) | System and method for distributed device tracking | |
| CN112527102B (en) | Head-mounted all-in-one machine system and 6DoF tracking method and device thereof | |
| US11055048B2 (en) | Techniques for establishing positional relationship(s) between information processing apparatuses | |
| CN109712224A (en) | Rendering method, device and the smart machine of virtual scene | |
| CN103677259B (en) | For guiding the method for controller, multimedia device and its target tracker | |
| CN105452994A (en) | Concurrent optimal viewing of virtual objects | |
| KR20150093831A (en) | Direct interaction system for mixed reality environments | |
| CN105125160B (en) | Oral cavity endoscope detecting system and detecting method thereof | |
| US11100713B2 (en) | System and method for aligning virtual objects on peripheral devices in low-cost augmented reality/virtual reality slip-in systems | |
| KR20180002534A (en) | External imaging system, external imaging method, external imaging program | |
| JP6447515B2 (en) | Information processing apparatus, recording medium, and information processing method | |
| US20190114803A1 (en) | Locating method, locator, and locating system for head-mounted display | |
| US20240069339A1 (en) | Head mounted display and information processing method | |
| TW201814441A (en) | Processing method and electronic device for displaying video corresponding to physical object | |
| US20240031678A1 (en) | Pose tracking for rolling shutter camera | |
| KR20220070485A (en) | Automated video capture and compositing system | |
| US10881937B2 (en) | Image processing apparatus, analysis system, and method for processing images | |
| US9805695B2 (en) | Display apparatus, storage medium having stored in information processing program, information processing apparatus, information processing system, and image display method | |
| CN109076101A (en) | Cloud platform control method, equipment and computer readable storage medium | |
| KR20190038296A (en) | Image display system, image display method, and image display program | |
| US20150352438A1 (en) | Information processing system, non-transitory computer-readable storage medium having stored therein information processing program, information processing apparatus, and information processing method | |
| CN107330937A (en) | Data handling system and method | |
| CN107255812A (en) | Speed-measuring method, mobile terminal and storage medium based on 3D technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |