CN104395903A - Enhancing captured data - Google Patents

Enhancing captured data Download PDF

Info

Publication number
CN104395903A
CN104395903A CN201380032202.8A CN201380032202A CN104395903A CN 104395903 A CN104395903 A CN 104395903A CN 201380032202 A CN201380032202 A CN 201380032202A CN 104395903 A CN104395903 A CN 104395903A
Authority
CN
China
Prior art keywords
data
captured
additional elements
module
link
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201380032202.8A
Other languages
Chinese (zh)
Inventor
H·本克
P·H·迪茨
S·G·拉塔
K·盖斯纳
S·N·巴思彻
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Corp filed Critical Microsoft Corp
Publication of CN104395903A publication Critical patent/CN104395903A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/29Geographical information databases
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B29/00Maps; Plans; Charts; Diagrams, e.g. route diagram
    • G09B29/10Map spot or coordinate position indicators; Map reading aids

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Remote Sensing (AREA)
  • Library & Information Science (AREA)
  • Mathematical Physics (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Television Signal Processing For Recording (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Processing Or Creating Images (AREA)
  • Studio Devices (AREA)

Abstract

Captured data is obtained, including various types of captured or recorded data (e.g., image data, audio data, video data, etc.) and/or metadata describing various aspects of the capture device and/or the manner in which the data is captured. One or more elements of the captured data that can be replaced by one or more substitute elements are determined, the replaceable elements are removed from the captured data, and links to the substitute elements are associated with the captured data. Links to additional elements to enhance the captured data are also associated with the captured data. Enhanced content can subsequently be constructed based on the captured data as well as the links to the substitute elements and additional elements.

Description

Strengthen the data captured
Background
Digital camera be can find in various dissimilar equipment now, Special digital camera, cell phone, computing machine, game console etc. comprised.This wide usability of digital camera allows user to take a large amount of digital photo, but still has problems.Such problem is the simple image capture device that current digital camera normally has basic function.This may cause restriction to user, because user only can catch the digital photo as snapshot when special scenes.
General introduction
This general introduction is provided to be to introduce the conceptual choice that will further describe in the following specific embodiments in simplified form.This general introduction is not intended to the key feature or the essential feature that identify claimed subject, is not intended to the scope for limiting claimed subject yet.
According to one or more aspect, obtain the data captured about environment.At least partly based on captured data, determine one or more additional elements, and be associated being added to the link of this one or more additional elements with captured data.The content constructing enhancing at least partially of data making it possible to use this one or more additional elements and capture.
According to one or more aspect, judge that whether the photograph element of photo is replaceable, comprise the interchangeable photograph element of mark and one or more alternative photograph element.Remove interchangeable photograph element from photo, and add the one or more links to this one or more alternative photograph element, generate compressed photo.The linking of additional elements be associated with replaceable photograph element or alternative photograph element is also added.Make it possible to use compressed photo and fetch structure enhancing photo to the chain of these one or more alternative photograph elements and this additional elements.
Accompanying drawing is sketched
In whole accompanying drawing, use identical Reference numeral to indicate identical feature.
Fig. 1 illustrates that the realization according to one or more embodiment strengthens the example system of the data captured.
Fig. 2 illustrates the sample data enhancing system according to one or more embodiment.
Fig. 3 is the process flow diagram of the instantiation procedure for strengthening captured data illustrated according to one or more embodiment.
Fig. 4 is the process flow diagram of another instantiation procedure for strengthening captured data illustrated according to one or more embodiment.
Fig. 5 illustrates that the be configured to realization according to one or more embodiment strengthens the Example Computing Device of the data captured.
Describe in detail
The data strengthening and capture are discussed herein.Obtain the data that capture, these data can comprise various types of recorded data (such as, view data, voice data, video data etc.) and/or describe the metadata of the mode that the various aspects of capture device and/or data are recorded.Determine the one or more elements can replaced by one or more substitute element in recorded data.Remove replaceable element from recorded data, and make to be associated with captured data to the link of substitute element.Also the link to being used for strengthening the additional elements of data captured is made to be associated with captured data.The content constructing and strengthen can be fetched subsequently based on recorded data and to the chain of substitute element and additional elements.
Fig. 1 illustrates that the realization according to one or more embodiment strengthens the example system 100 of the data captured.System 100 comprises seizure data and data is supplied to one or more capture devices 102 of one or more playback apparatus 104.Playback apparatus 104 communicates with mass-rent (crowd sourcing) data, services 106 via network 108.Network 108 can be various different networks, comprises the Internet, LAN (Local Area Network) (LAN), public telephone network, Intranet, other public and/or proprietary networks, their combination etc.One or more capture device 102 also optionally communicates with mass-rent data, services 106 and/or one or more playback apparatus 104 via network 108.Although be illustrated as service separately, it should be noted that, specific equipment not only can be capture device 102 but also can be playback apparatus 104.
Capture device 102 catches the data about specific environment, and this environment is also referred to as the environment be associated with caught data.Relevant to caught data or refer to the ambient conditions of the capture device 102 when data are captured for its environment catching data.Environment can be such as in buildings, outside building, in concert place, in sports tournament place, in party place etc.Each capture device 102 can be to catch about any one in the various dissimilar equipment of the data of environment, such as camera or video recorder, flat board or notebook, honeycomb or other wireless telephone, game console, vehicular computer, exclusive data capture device (providing seldom (if having) additional function except seizure data) etc.Different equipment in capture device 102 can be the equipment of identical or different type.
Catch data and refer to the data and/or metadata that record about environment.Record the feature referring to record or sensed environmental itself about the data of environment.About any one in the various data of environment or to be multiplely recorded, such as static image data, video data, voice data, its combination etc.Such as, capture device 102 can record the audio frequency etc. sensed in the still image (such as, photo) of specific environment, specific environment.
Record the metadata of the other side referring to each side of record description capture device 102, mode that data are captured and/or environment about the metadata of environment.The visual angle of capture device or direction (such as, being determined by other orientation assemblies of compass or capture device) when this metadata data that can be included in about environment are recorded.The geographic position of capture device when this metadata data that also can comprise about environment are recorded (therefore and environment), the geographic position such as determined by other positioning component of GLONASS (Global Navigation Satellite System) (GNSS) or capture device.This metadata also can comprise the date and/or time that the data about environment are recorded.Capture device 102 is while the data about environment are recorded by equipment 102 when (or within threshold time amount that the data about environment are recorded by equipment 102) record metadata wherein, and this metadata is also referred to as and is associated with recorded data.
In one or more embodiments, only the record just performing the geographic position to capture device 102 after user agrees to do like this is being received.This user agrees to it can is select to agree to, wherein user takes affirmative action to be recorded to ask geographic position.Or it can be select not agree to that this user agrees to, wherein user takes affirmative action not to be recorded to ask geographic position.If this user does not select not carry out this geographic position record, so it is user's implied consent that geographic position is recorded.Also can show privacy notice to user, how be kept secret to the geographic position that user interpretation records.And, it should be noted that, the record in the geographic position of equipment is not needed and does not usually comprise any personal information identifying specific user.Therefore, although the geographic position of specific user can be recorded, the instruction of this specific user is not recorded.
In one or more embodiments, the metadata of the other side of the various aspects of capture device 102 record description capture device, mode that data are captured and/or environment, but do not catch or record other data about environment.Such as, capture device 102 can record the geographic position (and date of being recorded of optional metadata and/or time) of the visual angle of capture device or direction and capture device, but does not record any still image, the video and/or audio of environment.Therefore, capture device 102 only can record the position (and optionally visual angle or direction, date and/or time etc.) of capture device, and the technology of these data that can be captured by following enhancing uses.
Playback apparatus 104 is the equipment of the data captured that playback uses the techniques described herein to strengthen.The data captured are by being enhanced with the element or part of the link of substitute element or part being replaced to the data captured.The data captured also are enhanced by adding to fetch the chain of one or more additional elements.Replace element or part by substitute element or part and/or add link to one or more additional elements, making it possible to or allow to construct based on captured data the content of enhancing.These technology for strengthening captured data more discuss in detail following.
Each playback apparatus 104 can be various different equipment, such as desk-top computer, server computer, on knee or net book computing machine, flat board or notebook, movement station, amusement equipment, the Set Top Box being coupled to display device communicatedly, televisor or other display equipment, honeycomb fashion or other wireless telephones, game console, truck-mounted computer etc.Thus, the scope of playback apparatus 104 can from having the wholly-owned source device (as personal computer, game console) of sufficient memory and processor resource to the low-resource equipment (as conventional set-top box, televisor) with finite memory and/or process resource.Different playback apparatus 104 can be identical and/or dissimilar equipment.
The metadata that capture device 102 provides captured data to one or more playback apparatus 104 and records.Or the data captured can playback on capture device, and in this case, capture device 102 is also playback apparatus 104.The metadata that capture device 102 can provide captured data to playback apparatus and record according to various mode, such as via network 108, via another link or connection (such as, wired or wireless connection, such as USB (universal serial bus) (USB) or Wireless USB connect), via removable memory equipment (such as, remove from capture device 102 and insert the flash memory device of playback apparatus 104) or other memory device etc.
Mass-rent data, services 106 safeguards the data being used to strengthen the data captured.In one or more embodiments, the data that capture device 102 captures are provided to mass-rent data, services 106.Additionally or alternatively, the data for strengthening captured data can be supplied to service 106 from other source.Such as, data acquisition or storehouse can be provided to service 106 from each source.It is because service 106 relies on the data that receive from multiple source but not data from single source strengthen captured data that service 106 is called as mass-rent service.
Use in various dissimilar equipment one or more to realize mass-rent service 106.Such as, serve 106 can use above in conjunction with playback apparatus 104 discuss various types of equipment in any one realize.Service 106 can use in identical and/or dissimilar equipment one or more realize.
Fig. 2 illustrates the sample data enhancing system 200 according to one or more embodiment.System 200 comprises environment capture module 202, link insert module 204, mass-rent data module 206 and playback module 208.Although figure 2 illustrates specific module, it should be understood that and can comprise additional module in data enhancement system 200.In addition, it should be noted that the function of the multiple modules shown in data enhancement system 200 can be combined into individual module, and/or the function of the one or more modules shown in data enhancement system 200 can be broken down into multiple module.
Module 202-208 can be realized by one or more equipment.In one or more embodiments, the equipment that each freedom of module 202-208 is different realizes.Or, can realize in module 202-208 in same equipment at least partly two or more.
Environment capture module 202 is included in capture device, in the capture device 102 of such as Fig. 1, and catches the data about environment.The data 212 captured can be the various types of data about environment and/or metadata that can be captured as mentioned above, are provided to link insert module 204.Link insert module 204 can be included in the equipment identical with environment capture module 202, or is alternatively included in different equipment.Captured data 212 can be supplied to link insert module 204 via various mode by capture module 202, such as when the interface of calling module 204, captured data 212 are comprised as parameter, captured data 212 are stored in the addressable position of module 204, send Email or use other messaging protocol that captured data 212 are transferred to module 204 etc.
Link insert module 204 identifies the element can replaced by the element from other data be stored in data storage 210 in the data 212 captured.Module 204 in captured data 212 is designated to the element (being also referred to as replaceable element) can replaced by the element from other data, link insert module 204 removes the element that can be replaced from captured data 212, and adds (being associated with captured data 212) and align linking of the substitute element of the element that replacement identifies.Dissimilar element can be identified based on the type of captured data, if the data such as captured 212 comprise photograph or view data, identify photograph element, if the data captured 212 comprise voice data, identification audio element etc.
Data store 210 and safeguard the data being used to strengthen the data captured, and can be realized by the mass-rent data, services 106 of Fig. 1.The data be included in data storage 210 can obtain from each provenance, the various capture devices 102 of such as Fig. 1, other data acquisition or storehouse etc.
The element (being also referred to as part) of same or analogous the captured data 212 of data that link insert module 204 is stored in 210 by mark and data determines the element can replaced by the element from other data in captured data 212.These elements can use for execution pattern coupling and/or object matching various different openly can with and/or special technology in identify arbitrarily.Object in the data 212 captured or pattern can use such technology to identify, and can store other data that 210 comprise same or similar object or pattern by identification data.Such as, if the data captured 212 are photos, then the buildings in photo or terrestrial reference are identified by module 204, and other photos one or more that data storage 210 comprises identical buildings or terrestrial reference also can be identified.
Pattern match and/or object matching can consider the recorded various factors from being included in captured data 212, the color in such as image center line and vertex position, image, the acoustic pattern etc. in audio frequency.Pattern match and/or object matching also can consider the various factors from the metadata be included in captured data 212.Such as, the geographic position of the equipment catching data can be comprised from these factors of metadata, date when being captured of the visual angle of equipment equipment when catching data or direction, data and/or time etc.
Link insert module 204 in caught data 212 is designated to the element can replaced by the element from other data, link insert module 204 removes the element identified that can be replaced from captured data 212.This replaceable element can remove from captured data 212 in different ways.In one or more embodiments, the data for identified element are replaced by certain other data (usually can compress with high compression ratio), such as a succession of complete " 0 " bit value or complete " 1 " bit value.Such as, if an element of photo (data 212 captured) is removed, then in the data of photo, for data usable levels " 0 " or " 1 " replacement of pixel included in this element.In other embodiments, table or other record of the element that mark removes and relevant position in the data thereof can be maintained, and can be deleted simply for the data of identified element.Such as, if an element of photo (data 212 captured) is removed, which pixel then in identification photograph corresponds to the table of this element or other record can be maintained, and in the data of this photo, the data for the pixel corresponding to this element can be deleted simply.
Connect to captured data 212 medium chain each element that insert module 204 removes, the link of the substitute element aligning the element that replacement identifies is added to and is associated with captured data 212 by link insert module 204.Comprise mark substitute element to the link of substitute element where be stored in and/or how can retrieve the various information of substitute element, allow substitute element to be retrieved subsequently, more discuss in detail as follows.
In one or more embodiments, substitute element is stored as its oneself individual data (such as, its oneself file), and this individual data of link instruction is stored in data stores where in 210.Instruction individual data being stored in where can adopt different forms, the position etc. in such as file path name, universal resource indicator (URI), database.Individual data can differently generate, such as by another equipment or service, by link insert module 204 (such as, in response to identifying the element can replaced by substitute element, this substitute element can be saved as independent file by module 204).
In other embodiments, substitute element is stored as a part for other data (such as, be included as the part of file storing other data), and these other data of link instruction are stored in data stores where in 210 and this substitute element and be stored in both where in these other data.The instruction these other data being stored in where can adopt different forms, the position etc. in such as file path name, URI, database.The instruction this substitute element being stored in the where in other data can adopt different forms, such as particular data scope, the data etc. that are associated with specific pixel.
Instruction also can record the where that replaceable element is arranged in captured data 212.Different forms can be adopted, such as particular data scope, the data etc. that are associated with specific pixel to the instruction of the where that this replaceable element is stored in captured data 212.Safeguarding this instruction permission interpolation substitute element when generating the content strengthened replaceable element being arranged in the where of captured data 212, more discussing in detail as follows.Differently can store the instruction of the where of replaceable element in captured data 212, such as be stored as a part for the link to substitute element, to be stored in the additional data be associated with captured data 212 medium.
The pattern match and/or object matching technique that it should be understood that for identifying the element that available substitute element is replaced in captured data 212 can select the substitute element similar in appearance to the element identified in captured data 212.Substitute element similar in appearance to identified element refers to incomplete same with identified element but is less than other element of threshold zone with the difference of identified element.The difference of this threshold value can differently be determined, such as there is identical at least threshold portion (such as, in photo, at least the pixel of threshold number is identical value), there is at least threshold portion in the threshold quantity of identified element (such as, in photo, at least the pixel of threshold number is in threshold quantity each other), there is the mark generated be in each other in threshold value, etc.
In one or more embodiments, wherein replaceable element and substitute element incomplete same when, link insert module 204 also record the change data of the difference indicated between replaceable element and substitute element.This change data can differently record.Such as, if the data captured 212 are photos, then change the difference that data can be the values of the respective pixel of replaceable element and substitute element.This change data can store in different ways, be such as stored as a part for the link to substitute element, be stored in the additional data that is associated with captured data 212 in etc.
Or, wherein replaceable element and substitute element incomplete same when, link insert module 204 does not record change data about the difference between replaceable element and substitute element.Therefore, link the element of insert module 204 usable image other view (view that the scribble such as, wherein put on is removed, wherein stand in terrestrial reference before the view etc. that is removed of people) replace this element.User interface is optionally presented by link insert module 204, and which in views allows module 204 to receive the multiple of marker element may will be used as user's input of the substitute element of replaceable element.
Link insert module 204 provides the data 214 of link to playback module 208.The data 214 of link are the data 212 captured removing replaceable element.In one or more embodiments, the data 214 of link also comprise (such as, metadata as being associated) to the link of substitute element of replacing replaceable element, and optionally comprise other additional data be associated with captured data 212.Therefore, in such embodiments, the data 214 of link comprise captured data 212 (element that removing removes) and the link (and other additional data be optionally associated with captured data 212) to substitute element.
Or, replace comprising linking substitute element and/or other additional data of being associated with captured data 212 in the data 214 of link, associating and can safeguard according to alternate manner between the data 214 of link and link and/or other additional data of being associated with captured data.In one or more embodiments, link and/or other additional data of being associated with captured data 212 are maintained in the addressable table of playback module 208 or during other records.Link and/or other additional data be associated with captured data 212 differently can be identified as and be associated with captured data 212, such as based on captured data 212 identifier (such as, distributed by capture device, itself generate (such as, based on the hashed value that captured data 212 generate) etc. based on captured data 212).Link and/or other additional data of being associated with captured data 212 can be stored in data and store in 210, or alternatively as a part for another service or module, and can be accessed to generate enhancing content, more discuss in detail as following.
It should be understood that link insert module 204 can identify multiple elements that in captured data 212, available different substitute element is replaced.Under such a condition, to each in multiple identified element, module 204 removes identified element from captured data 212, and adds the link aligning the substitute element of this element that replacement identifies.
It will also be appreciated that be linked to substitute element can have the resolution different from the element be replaced.Such as, if the data captured 212 are the photos with specified resolution, then substitute element can be included in the photo with more high resolving power (such as, per square inch more pixels).Therefore, substitute element can have disabled additional detail in the institute's marker element be replaced.This additional detail can such as allow user to amplify in substitute element when checking and strengthen content subsequently, and sees disabled details (such as, text, people, illustration etc.) in the institute's marker element be replaced.
Link insert module 204 also can add the link to one or more additional elements to the data 214 linked.In one or more embodiments, module 204 is except removing replaceable element and adding the link also added except the link of substitute element one or more additional elements.In other embodiments, module 204 is added the link of one or more additional elements but not the link removing replaceable element and add substitute element.Therefore, in certain embodiments, system 200 replaces the element of the data captured without substitute element.
It can be link data being stored to the data in 210 to the link of one or more additional elements, and these links can identify additional elements is stored in where and/or how additional elements can be retrieved according to various mode, similar in appearance to the link of above-mentioned substitute element.These can be included as the metadata be associated with the data 214 linked to the link of one or more additional elements, or are otherwise associated with the data 214 linked, similar in appearance to the above-mentioned link to substitute element.
To the link of one or more additional elements by adding various types of data to strengthen captured data to captured data 212.One or more additional elements can be the data identical from captured data 212 type and/or the data different with captured data 212 type.
In one or more embodiments, one or more additional elements comprises the element of the data identical with captured data 212 type.Such as, if the data captured 212 are image (photos), then one or more additional elements comprises view data.Link insert module 204 can determine the additional elements that will comprise according to various mode.In one or more embodiments, module 204 uses various pattern match and/or object matching technique to identify in captured data 212 (and/or linking the substitute element be associated with captured data 212) the same or analogous element of data stored with data in 210.This mark to storing the same or analogous element of data in 210 with data can perform according to the same way identifying as mentioned above the element can replaced by the element from other other data in the data captured.Because additional elements is that these additional elements are also referred to as and are associated with the element of captured data and/or substitute element based on captured element and/or to the link identification of the substitute element be associated with captured data 212.
The additional elements that type is identical can be the element comprising element more data than identified or details.Such as, if the data captured 212 comprise the photo of specific landmark as identified element, then additional elements can be to provide the photo of the additional detail about same terrestrial reference.Link insert module 204 differently can determine to comprise the additional elements of element more data than identified or details.In one or more embodiments, module 204 is determined to comprise than the more data of identified element or details with additional elements included in the data caught higher than the resolution (such as, for more per square inch pixels of view data, the higher sample frequency etc. to voice data) of identified element.In other embodiments, module 204 determines the element resolution of identified element and additional elements.The resolution of element has referred to how many data or details is included in (such as, how many pixels, data byte number etc.) in element.Module 204 is determined if additional elements has the element resolution higher than identified element, then additional elements comprises than the more data of identified element or details.
It should be understood that link insert module 204 can determine the multiple additional elements had than the more data of same identified element or details.Under these circumstances, module 204 can comprise the link to one of multiple additional elements in the data 214 linked, or the link to the multiple elements (such as, each element) in multiple additional elements.
Link insert module 204 can additionally or alternatively according to alternate manner determine will comprise one or more additional elements of data identical with captured data 212 type.In one or more additional embodiment, link insert module 204 determines one or more additional elements that will be included in the data 214 of link based on the metadata of captured data 212.This metadata can comprise various information, the date that the such as geographic position of above-mentioned capture device, the visual angle of capture device or direction and data are captured and/or time.Data store 210 data comprised and also comprise the metadata be associated, and it can comprise the information identical with the metadata that captured data 212 are associated.Such as, data store the metadata be associated of 210 data that comprise can have the geographic position of equipment when data are captured that mark catches data, the visual angle of equipment when data are captured catching data or direction, data are captured date and/or time etc.
Link insert module 204 identification data stores the data in 210 with the metadata be associated of the metadata of the data 212 that coupling captures.If the information in metadata is identical or each other within threshold quantity, then meta data match.Such as, if the metadata of the data captured 212 comprises the geographic position of capture device, and store with data the metadata that the data in 210 are associated and comprise geographic position, if the geographic position then in two metadata is identical or each other at threshold distance (such as, 10 meters, 50 meters etc.) within, then these two meta data match.As another example, if the metadata of the data captured 212 also comprises the direction of capture device, and store with data the metadata that the data in 210 are associated and comprise direction, if the geographic position then in two metadata is identical or each other within threshold distance and direction is identical or each other in threshold quantity (such as, 3 degree, 10 degree etc.) within, then these two meta data match.
Therefore, link insert module 204 can store the additional elements strengthening the data 212 captured in 210, even if this additional elements is not element same or analogous with the element in captured data 212 by identification data.The audio frequency etc. that the visual field of these additional elements such as easily extensible image or video, expansion capture.Such as, if the data captured 212 are images of capturing of specific time in specific geographic position and in a day, wherein capture device points to specific direction, then additional elements can be not included in captured data 212 but same from this (or near) geographic position catch, by point to identical (or similar) direction the environment that equipment catches and (or similar) time identical one day catches extention (such as, when catching image capture device the visual field outside people, buildings, scene etc.).Therefore, even if the data captured 212 do not comprise these extentions of environment, these parts are still included in the data 214 of link.
In one or more embodiments, one or more additional elements comprises the element of the data different from captured data 212 type.Such as, if the data captured 212 are image (photos), then one or more additional elements can comprise voice data, video data etc.These dissimilar data can be the data of any type that can be caught by capture device (such as, the capture device 102 of Fig. 1) or the data of alternatively other type.Such as, one or more additional elements can be the data (such as, encyclopaedical entry or other written description) of text, the data etc. of drawing type.One or more additional elements also can comprise the data of the type except those data types that capture device is supported.Such as, if the data captured 212 are caught by the equipment of not recording audio data, then one or more additional elements can comprise voice data.
Link insert module 204 can be determined to be included in the additional elements in the data 214 of link according to various mode.In one or more embodiments, link insert module 24 and store based on the metadata be associated with captured data 212 with data the additional elements that metadata that the data in 210 are associated determines to be included in the different types of data in the data 214 linked.The data of the associated metadata that the metadata had in link insert module 204 identification data storage 210 and be associated with captured data 212 matches, be similar to above about determining the additional elements with captured data 212 same data type, although additional elements is the data dissimilar with captured data 212.
Therefore, link insert module 204 and store by providing the type of the data be not included in captured data 212 to carry out identification data the additional elements strengthening the data 212 captured in 210.Such as, if the data captured 212 are the images caught in specific geographic position and at the special time of specific a day, but then additional elements can be the data (such as, voice data) of the addition type not being included in this environment captured in identical (or similar) time on the same day same from this (or near) geographic position in captured data 212.Therefore, even if the data captured 212 do not comprise the data of these addition type, these data are still included in the data 214 of link.
Link insert module 204 also can according to except using the metadata of data 212 that captures or the alternate manner of the metadata of the data 212 replacing use to capture determine the additional elements of the different types of data that will be included in the data 214 of link.In one or more embodiments, insert module 24 determines to be included in the different types of data in the data 214 linked additional elements based on captured data 212 (or linking the substitute element be associated with captured data 212) is linked.Such as, module 204 can use various pattern match and/or object matching technique to identify the element-specific of captured data 212 (or the link to substitute element), such as specific landmark, particular individual etc.These technology also can be used for identifying various general context type, such as concert, sports tournament etc.Such as based on data itself or based on to being included in the instruction storing the element identified in metadata that the data in 210 are associated or general context type with data, the element identified or the general context type that store the data in 210 for data also can be identified.Because additional elements is that these additional elements are also referred to as and are associated with captured data and/or substitute element based on captured element and/or to the link identification of the substitute element be associated with captured data 212.
These various pattern match and/or object matching technique can be used for (store data itself in 210 based on data or store with data the metadata that the data in 210 are associated), and identification data stores the element-specific of the data in 210, and links insert module 204 and identification data storage 210 can comprise the data of identical element-specific.Such as, module 204 can determine the specific environment type of captured data 212 (such as, the view data of sports tournament), and the data (such as, the voice data of sports tournament) in data storage 210 with other type of this equivalent environment type are designated additional elements.As another example, module 204 can determine captured data 212 (such as, image and/or video data) specific landmark, and data are stored in 210 the data (such as, text describes) with other type of this identical specific landmark and are designated additional elements.
It should be understood that the additional elements determined by link insert module 204 can be each several part or other data entirety of other data.Such as, the data 212 captured can be image or video, and additional elements can be each several part of other image, video and/or audio, or can be alternatively other image, video and/or audio entirety.Additional elements can by module 204 according to above-mentioned different modes, determine based on the metadata be associated with captured data 212, data captured 212 itself and/or substitute element.Such as, the one or more image identifications before module 204 time that captured data 212 can be captured in threshold time amount (such as, 15 seconds) are additional data.
Also will be appreciated that, environment capture module 202 can catch the various aspects of description capture device (such as, the geographic position of equipment, the direction of equipment or visual angle etc.) metadata, but other data any (such as, do not catch image, do not catch audio frequency, do not catch video etc.) do not recorded about environment.Capture module 202 therefore can be included in not used for the feature of sensitive context environmental sensor (such as, do not record the sensor of image in environment or audio frequency) equipment in, or be included in record metadata but do not use the environmental sensor for the feature of sensitive context to record in the equipment about the data of environment.But based on metadata, link insert module 204 can determine one or more additional elements, thus adds the data 214 of link to such as image, audio frequency, video.Therefore, capture device can not comprise image capture assemblies, not comprise audio capture assembly etc., and the metadata (such as, the geographic position of equipment and direction or visual angle) of the only each side of record description capture device.As mentioned above, the view data in data storage 210 and/or voice data can be identified as additional elements based on metadata, and can be added to the data 214 of link by module 204 to the link of additional elements.
May occur that captured data 212 comprise the situation of polytype data (such as, video data and voice data).Link insert module 204 is optionally by determining that substitute element and/or additional elements replace the data of a type in these types.Such as, the data (such as, view data or video data) of a type can be used to as captured Data Identification specific environment type, and can identify the additional elements (such as, voice data) with equivalent environment type.Module 204 can by the data chain of additional elements being fetched to respective type in data 212 that replacement captures.Therefore, such as, in the data 212 captured, the data of this type (such as, view data or video data) can be retained in the data 214 of link, and the available chain to additional elements of data (such as, voice data) of other type fetches replacement in the data 212 captured.
The data 214 of link are provided to playback module 208.The data 214 of link can be supplied to playback module 208 via various mode by link insert module 204, such as when the interface of calling module 208, data 214 are comprised as parameter, data 214 are stored in the addressable position of module 208, send Email or use other messaging protocol that data 214 are transferred to module 208 etc.Playback module 208 asks the element of link in data 214 to mass-rent data module 206.As mentioned above, be stored in where and/or substitute (and/or additional elements) can how to be retrieved by fetching mark alternative (and/or additional elements) to the chain of element.Mass-rent data module 206 stores 210 links of acquisition to element from data, and will be supplied to playback module 208 to the link of element as enhancing data 216.
Playback module 208 receives and strengthens data 216, and enhancing data 216 are combined with the data 214 linked the content 218 generating or construct enhancing.Data 214 and 216 differently can be combined based on the type strengthening the element that data 216 comprise.Such as, substitute element (in the position of replaceable element in captured data 212) can be added to data 214.As another example, additional elements can be added to data 214.Such as, photo can be enhanced to comprise the extention be not included in captured data 212, voice data can be added to view data, the voice data captured can be replaced with other voice data, and the metadata do not had about other data captured of environment captured can be enhanced to comprise audio frequency and/or video data etc.Playback module 208 can playback (such as, display or otherwise present) content 218 that strengthens, or alternatively other action (such as, the content 218 of enhancing be stored in particular storage device, by the content 218 of enhancing be sent to another equipment or module etc.) is taked to the content 218 strengthened.
Fig. 3 shows the process flow diagram of the instantiation procedure 300 for strengthening captured data according to one or more embodiment.Process 300 is by one or more module, the method for link insert module 204 realization of such as Fig. 2 or scheme, and can realize with software, firmware, hardware or its combination.Process 300 is illustrated as set, and is not limited only to the order of the shown operation for performing various action.Process 300 is the instantiation procedures for strengthening captured data; With reference to different accompanying drawing, include the additional discussion for strengthening captured data herein.
In process 300, obtain the data (action 302) captured about environment.The data captured can be captured or be provided to one or more modules of implementation procedure 300 according to various mode, as mentioned above.
Determine one or more additional elements (action 304).As mentioned above, the one or more additional elements is determined based on captured data.Optionally receive the user's input (such as, instruction is used for identifying user's input of the factor of additional elements or technology, user's input of type of the data of instruction additional elements, user to the selection etc. of additional elements one or more in multiple additional elements) promoting to determine one or more additional elements.
Can be added to be associated with captured data (action 306) one or more links of one or more additional elements.As mentioned above, the one or more link can be added according to various different mode.
The content (action 308) constructing enhancing at least partially of data making it possible to use this one or more additional elements and capture.To the content that the link of one or more additional elements allows structure to strengthen.As mentioned above, this structure comprises the one or more additional elements of combination and the data that capture at least partially.
Fig. 4 is the process flow diagram of another instantiation procedure 400 for strengthening captured data illustrated according to one or more embodiment.Process 400 is by one or more module, the method for link insert module 204 realization of such as Fig. 2 or scheme, and can realize with software, firmware, hardware or its combination.Process 400 is illustrated as set, and is not limited only to the order of the shown operation for performing various action.Process 400 is the instantiation procedures for strengthening captured data; With reference to different accompanying drawing, include the additional discussion of the data that enhancing captures herein.
In process 400, obtain the data (action 402) captured about environment.The data captured can be captured or be provided to the one or more modules according to various mode implementation procedure 400, as mentioned above.
Make in captured data the judgement (action 404) whether having one or more element can replace by one or more substitute element.As mentioned above, this judgement comprises the one or more replaceable element of mark and one or more substitute element.
One or more identified, replaceable element (action 406) is removed to generate compressed photo from captured data.As mentioned above, these replaceable elements can differently be removed.
Add the one or more links (action 408) to one or more substitute element.As mentioned above, the one or more link is added to and is associated with captured data, and can add according to various different modes.Optionally receive the user's input (such as, indicating user's input of the factor that will be used for identifying substitute element or technology, user to the selection etc. of one of multiple substitute element) promoting to determine one or more substitute element.
Also determine one or more additional elements (action 410).As mentioned above, the one or more additional elements is determined based on captured data (and/or substitute element), and is associated with replaceable element and/or substitute element.Optionally receive the user's input (such as, instruction is used for identifying user's input of the factor of additional elements or technology, user's input of type of the data of instruction additional elements, user to the selection etc. of element one or more in multiple additional elements) promoting to determine one or more additional elements.
Add the one or more links (action 412) to one or more additional elements.As mentioned above, the one or more link is added to and is associated with captured data, and can add according to various different modes.Photo is such as because removing replaceable element from photo and being linked the link of additional elements strengthening photo but not additional elements itself is included in photo and is compressed.
Make it possible to the content (action 414) using the compressed data captured and one or more chain that is alternative and additional elements is fetched to structure enhancing.Allow to construct the content strengthened to the link of one or more substitute element and/or one or more additional elements.As mentioned above, this structure comprises combination one or more additional elements, substitute element and the compressed data captured.
The various use sight of technical support of the data that the enhancing described in text captures.Such as, user can take the photograph of various terrestrial reference, the artwork, landscape etc.Then each several part of its photograph can be replaced with each several part of other more high-resolution photograph of same terrestrial reference, the artwork, landscape etc., provides the photograph than the resolution high (and the resolution can may taken than his or her camera is high) captured by him or she to user.User, therefore, it is possible to see additional details, optionally can amplify to see otherwise sightless people, works, design etc. in photograph captured by him or she in each several part of photograph.Voice data also can be added to photograph, allows the plays back audio when photograph is shown subsequently.Therefore, the voice data corresponding with this terrestrial reference, the artwork, landscape etc. can be presented to user, even if user does not catch such audio frequency with his or her photograph.
Although be photo with reference to the data captured and include various discussion in this article, it should be understood that technology discussed in this article also can be used for the data captured of other type various, such as video data.Video data can be regarded as sequence into frame or array, and each frame is treated as a photo as herein described.Technology discussed in this article can be applied to multiple (such as, each frame) in the frame in sequence or array.To the particular frame in video, one or more substitute element can be from the element of other photo or video and/or from the element in other frame of same video.Therefore, the difference between replacing based on the subsequent frame in key frame and key frame and video carrys out compressed video, video by with in other frame in video or the unit that fetches in each frame replacing video of the chain of the substitute element in other place usually compressed.
There is discussed herein performed by each module such as transmission, receive, provide, record, store, generate, each action such as acquisition.The particular module of a certain action of the execution discussed herein comprise this particular module itself perform this action or alternatively this particular module call or access another assembly of performing this action or module (or combine with this particular module perform this action) with other modes.Thus, the particular module performing a certain action comprises this particular module itself and performs this action or this particular module calls or another module of otherwise accessing performs this action.
Fig. 5 illustrates that the be configured to realization according to one or more embodiment strengthens the Example Computing Device 500 of the data captured.Computing equipment 500 can be the computing equipment 102 or 104 of such as Fig. 1, and the mass-rent data, services 106 realizing Fig. 1 at least partially, realizes one or more module 202-208 etc. of Fig. 2.
One or more I/O interfaces 506 that shown computing equipment 500 comprises disposal system 502, one or more computer-readable medium 504 and is coupled with communicating with one another.Although do not illustrate, computing equipment 500 can comprise system bus or further by other data coupled to each other for various assembly and command transfer system.System bus can comprise any one or combination in different bus architectures, such as memory bus or Memory Controller, peripheral bus, USB (universal serial bus) and/or utilize the processor of any one in various bus architecture or local bus.Also contemplate other example various, such as control and data line.
Disposal system 502 represents the function using hardware to perform one or more operation.Therefore, disposal system 502 is shown as including the hardware element 508 that can be configured to processor, functional block etc.This can be included in as the realization in the hardware of special IC or other logical device of using one or more semiconductor to form.Hardware element 508 is by forming their material or the restriction for the treatment of mechanism that wherein uses.Such as, processor can be made up of semiconductor and/or transistor (such as, electronic integrated circuit (IC)).In this context, processor executable can be the instruction that can perform electronically.
Computer-readable medium 504 is shown as including storer/storage 510.Storer/storage 510 represents the storer/memory capacity be associated with one or more computer-readable medium.Storer/storage 510 can comprise Volatile media (such as random access memory (RAM)) and/or non-volatile media (such as ROM (read-only memory) (ROM), flash memory, CD, disk etc.).Storer/storage 510 can comprise mounting medium (such as, RAM, ROM, fixed disk drive etc.) and removable medium (such as flash memory, removable hard disk drive, CD etc.).The various modes that computer-readable medium 504 can further describe below configure.
Input/output interface 506 represents the function allowing user to computing equipment 500 input command and information, and allows to use various input-output apparatus to present information to user and/or other assemblies or equipment.The example of input equipment comprises keyboard, cursor control device (such as, mouse), microphone (such as, for voice or other Audiotex as), scanner, touch function (such as, capacitive or be configured to detect other sensor of physical touch), camera (such as, can adopt as seen or the nonvisible wavelength of such as infrared frequency be posture by the mobility detect not relating to touch), etc.The example of output device comprises display device (such as, monitor or projector), loudspeaker, printer, network interface card, haptic response apparatus, etc.Therefore, computing equipment 500 can be configured to support user interactions according to various mode.
Computing equipment 500 also comprises captured data enhancement system 520.The enhancing system 520 of the data captured is provided for the various functions of the data that enhancing captures, and comprises seizure data, inserts link, the content of structure enhancing is for playback and/or provide mass-rent data, as mentioned above.The enhancing system 520 of the data captured can be such as one or more module 202-208 of Fig. 2.
In the general context of software, hardware element or program module, various technology can be described herein.Generally speaking, this module comprises the routine, program, object, element, assembly, data structure etc. that perform particular task or realize particular abstract data type.Term used herein " module ", " function " and " assembly " generally represent software, firmware, hardware or its combination.Each feature of technology described herein is that platform has nothing to do, thus means that this technology can realize on the various commercial computing platforms with various processor.
Transmit on the computer-readable medium that described module and the realization of technology can be stored in certain form or by the computer-readable medium of certain form.Computer-readable medium can comprise the various media can accessed by computing equipment 500.Exemplarily unrestricted, computer-readable medium can comprise " computer-readable recording medium " and " computer-readable signal media ".
Computer-readable recording medium can refer to relative to only Signal transmissions, carrier wave or signal itself, enables the medium to the lasting of information and/or non-transient storage and/or equipment.Thus, computer-readable recording medium refers to non-signal bearing medium.Computer-readable recording medium comprises being suitable for storing the hardware of such as volatibility that method or technology as computer-readable instruction, data structure, program module, logic element/circuit or other data etc. realize and non-volatile, removable and irremovable medium and/or memory device.The example of this computer-readable recording medium includes but not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical storage, hard disk, tape cassete, tape, disk storage or other magnetic storage apparatus or be applicable to and store information needed can by other memory device of computer access, tangible medium or goods.
" computer-readable signal media " can refer to be configured to such as via the signal bearing medium of network to the hardware transport instruction of computing equipment 500.Signal media embodies computer-readable instruction, data structure, program module or other data by modulated message signal such as such as carrier wave, data-signal or other transmission mechanisms usually.Signal media also comprises any information-delivery media.Term " modulated message signal " refers to and makes arrange in the mode of coded message in the signal or change the signal of one or more characteristic.Exemplarily unrestricted, communication media comprises wire medium, such as cable network or directly connection, and wireless medium, such as acoustics, RF, infrared ray and other wireless mediums.
Describe as previously described, hardware element 508 and computer-readable medium 504 be represent realize in the form of hardware instruction, module, programmable device logic and/or institute's fixed equipment logic, it can be adopted at least some aspect that realize technology described herein by some embodiment.Hardware element 508 can comprise integrated circuit or SOC (system on a chip), application specific integrated circuit (ASIC), field programmable gate array (FPGA), CPLD (CPLD), and with the assembly that silicon or other hardware device realize.In this context, hardware element can serve as treatment facility, the program task that the instruction that the execution of this treatment facility is embodied by this hardware element and the hardware device (such as previously described computer-readable recording medium) for storing the instruction supplying execution, module and/or logic define.
Combination above also may be utilized to realize various technology described here.Therefore, software, hardware, or module and other program modules can be implemented as one or more instruction and/or the logic that realizes on the computer-readable recording medium of certain form and/or by one or more hardware element 508.Computing equipment 500 can be configured to the function realizing specific instruction and/or correspond to software and/or hardware module.Therefore, the realization that can be the module of software by computing equipment 500 execution can complete with hardware at least partly, such as, by using the hardware element 508 of computer-readable recording medium and/or disposal system.Instruction and/or function can be one or more goods (such as, one or more computing equipment 500 and/or disposal system 502) can perform/exercisable, to realize technology described herein, module, and example.
Although describe this theme with architectural feature and/or the special language of method action, be appreciated that subject matter defined in the appended claims is not necessarily limited to above-mentioned specific features or action.On the contrary, above-mentioned specific features and action are as disclosed in the exemplary forms realizing claim.

Claims (10)

1. one or more computer-readable storage medium it storing multiple instruction, described instruction makes described one or more processor perform following action when the one or more processors by equipment perform, comprising:
Obtain the data captured about environment;
At least in part based on caught data, determine one or more additional elements:
Be associated being added to one or more links of described one or more additional elements with captured data; And
Make it possible to the content constructing enhancing at least partially of data using described one or more additional elements and capture.
2. one or more computer-readable storage medium as claimed in claim 1, it is characterized in that, the data captured comprise the metadata in geographic position describing and works as described equipment when captured data are caught by an equipment, but the image that catches not included in described geographical location of the data captured or audio frequency.
3. one or more computer-readable storage medium as claimed in claim 2, is characterized in that, described one or more additional elements comprises the image captured in described geographical location by another equipment.
4. one or more computer-readable recording medium as claimed in claim 1, is characterized in that, also comprise:
Identify the one or more elements in the data captured; And
Described determine to comprise determine described one or more additional elements based on identified one or more elements.
5. the compression scheme of photo for strengthening, comprising:
Determine whether a photo has photograph element to be interchangeable, comprise the described interchangeable photograph element of mark and one or more alternative photograph element;
Remove described interchangeable photograph element to generate compressed photo;
Add the one or more links to described one or more alternative photograph element;
Add linking the additional elements be associated with described interchangeable photograph element or described alternative photograph element; And
Make it possible to use described compressed photo and fetch to the chain of described one or more alternative photograph elements and described additional elements the photo constructing described enhancing.
6. compression scheme as claimed in claim 5, is characterized in that, describedly determines to comprise:
Identify the described replaceable picture element taken; And
Identical with alternative photograph element or there is the difference being less than threshold value in response to described interchangeable photograph element, determine that described interchangeable photograph element is interchangeable.
7. compression scheme as claimed in claim 5, it is characterized in that, the one or more links of described interpolation to described one or more alternative photograph element also comprise, to each interchangeable element, store the change data of the difference between the described interchangeable photograph element of instruction and described alternative photograph element.
8. compression scheme as claimed in claim 5, it is characterized in that, described alternative photograph element comprises the resolution higher than described interchangeable photograph element.
9. compression scheme as claimed in claim 5, it is characterized in that, described additional elements expands the visual field of described photo.
10. compression scheme as claimed in claim 5, it is characterized in that, described additional elements comprises the data different from picture data type.
CN201380032202.8A 2012-06-18 2013-06-04 Enhancing captured data Pending CN104395903A (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/526,033 US20130335594A1 (en) 2012-06-18 2012-06-18 Enhancing captured data
US13/526,033 2012-06-18
PCT/US2013/044181 WO2013191899A1 (en) 2012-06-18 2013-06-04 Enhancing captured data

Publications (1)

Publication Number Publication Date
CN104395903A true CN104395903A (en) 2015-03-04

Family

ID=48628950

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201380032202.8A Pending CN104395903A (en) 2012-06-18 2013-06-04 Enhancing captured data

Country Status (7)

Country Link
US (1) US20130335594A1 (en)
EP (1) EP2862103A1 (en)
JP (1) JP6300792B2 (en)
KR (1) KR20150023406A (en)
CN (1) CN104395903A (en)
TW (1) TWI591575B (en)
WO (1) WO2013191899A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106375547A (en) * 2015-07-20 2017-02-01 Lg电子株式会社 Terminal device and controlling method thereof
CN111163138A (en) * 2019-12-18 2020-05-15 北京智明星通科技股份有限公司 Method, device and server for reducing network load during game

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9058375B2 (en) * 2013-10-09 2015-06-16 Smart Screen Networks, Inc. Systems and methods for adding descriptive metadata to digital content
TWI509426B (en) * 2014-09-17 2015-11-21 Prophetstor Data Services Inc System for achieving non-interruptive data reconstruction
US10379497B2 (en) * 2015-03-07 2019-08-13 Apple Inc. Obtaining and displaying time-related data on an electronic watch
US10175866B2 (en) 2015-06-05 2019-01-08 Apple Inc. Providing complications on an electronic watch
US11327640B2 (en) 2015-06-05 2022-05-10 Apple Inc. Providing complications on an electronic device
US10572571B2 (en) 2015-06-05 2020-02-25 Apple Inc. API for specifying display of complication on an electronic watch
US20210279766A1 (en) * 2020-03-04 2021-09-09 Peter Garrett Computer-Based System and Method for Providing an Augmented Reality Interface at Real-World Music Festivals

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006119576A1 (en) * 2005-05-13 2006-11-16 Capture-Cam Ip Pty Ltd Method and system for transmitting video to a mobile terminal
CN101021945A (en) * 2007-03-23 2007-08-22 北京中星微电子有限公司 Image composing method and device
CN101316326A (en) * 2007-06-01 2008-12-03 株式会社其恩斯 Magnification observation apparatus and method for photographing magnified image
CN101510958A (en) * 2008-02-14 2009-08-19 富士胶片株式会社 Image processing apparatus, image processing method and imaging apparatus
US20100159965A1 (en) * 2008-12-23 2010-06-24 At&T Mobility Ii Llc Scalable message fidelity
CN102411615A (en) * 2010-10-31 2012-04-11 微软公司 Identifying Physical Locations Of Entities

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7859551B2 (en) * 1993-10-15 2010-12-28 Bulman Richard L Object customization and presentation system
WO2001052178A1 (en) * 2000-01-13 2001-07-19 Digimarc Corporation Authenticating metadata and embedding metadata in watermarks of media signals
GB2372165A (en) * 2001-02-10 2002-08-14 Hewlett Packard Co A method of selectively storing images
US7042470B2 (en) * 2001-03-05 2006-05-09 Digimarc Corporation Using embedded steganographic identifiers in segmented areas of geographic images and characteristics corresponding to imagery data derived from aerial platforms
US7444656B2 (en) * 2001-08-02 2008-10-28 Intellocity Usa, Inc. Post production visual enhancement rendering
US20040012601A1 (en) * 2002-07-18 2004-01-22 Sang Henry W. Method and system for displaying a first image as a second image
JP4294592B2 (en) * 2002-10-28 2009-07-15 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Apparatus and method for replacing media content item
US7185284B2 (en) * 2002-12-20 2007-02-27 Motorola, Inc. Method and apparatus for providing a hyperlink indication on a display for an image in a web page
US20060139475A1 (en) * 2004-12-23 2006-06-29 Esch John W Multiple field of view camera arrays
US7512262B2 (en) * 2005-02-25 2009-03-31 Microsoft Corporation Stereo-based image processing
JP5162928B2 (en) * 2007-03-12 2013-03-13 ソニー株式会社 Image processing apparatus, image processing method, and image processing system
US7973655B2 (en) * 2007-11-27 2011-07-05 Yahoo! Inc. Mobile device tracking and location awareness
US20090193021A1 (en) * 2008-01-29 2009-07-30 Gupta Vikram M Camera system and method for picture sharing based on camera perspective
US8122468B2 (en) * 2008-11-07 2012-02-21 At&T Intellectual Property I, L.P. System and method for dynamically constructing audio in a video program
FR2948760A1 (en) * 2009-07-31 2011-02-04 Trading Corp Consulting Cartographic method for obtaining digital cartographic representation of geographical area of e.g. company, during over flight of geographical area by helicopter, involves inserting link in position corresponding to geo-localization data
US9241185B2 (en) * 2009-09-30 2016-01-19 At&T Intellectual Property I, L.P. Apparatus and method for media detection and replacement
CN102063610B (en) * 2009-11-13 2013-08-28 鸿富锦精密工业(深圳)有限公司 Image identification system and method thereof
EP2389004B1 (en) * 2010-05-20 2013-07-24 Sony Computer Entertainment Europe Ltd. 3D camera and imaging method
US9336240B2 (en) * 2011-07-15 2016-05-10 Apple Inc. Geo-tagging digital images

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006119576A1 (en) * 2005-05-13 2006-11-16 Capture-Cam Ip Pty Ltd Method and system for transmitting video to a mobile terminal
CN101021945A (en) * 2007-03-23 2007-08-22 北京中星微电子有限公司 Image composing method and device
CN101316326A (en) * 2007-06-01 2008-12-03 株式会社其恩斯 Magnification observation apparatus and method for photographing magnified image
CN101510958A (en) * 2008-02-14 2009-08-19 富士胶片株式会社 Image processing apparatus, image processing method and imaging apparatus
US20100159965A1 (en) * 2008-12-23 2010-06-24 At&T Mobility Ii Llc Scalable message fidelity
CN102411615A (en) * 2010-10-31 2012-04-11 微软公司 Identifying Physical Locations Of Entities

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106375547A (en) * 2015-07-20 2017-02-01 Lg电子株式会社 Terminal device and controlling method thereof
US10321090B2 (en) 2015-07-20 2019-06-11 Lg Electronics Inc. Terminal device and controlling method thereof
CN111163138A (en) * 2019-12-18 2020-05-15 北京智明星通科技股份有限公司 Method, device and server for reducing network load during game
CN111163138B (en) * 2019-12-18 2022-04-12 北京智明星通科技股份有限公司 Method, device and server for reducing network load during game

Also Published As

Publication number Publication date
JP2015523018A (en) 2015-08-06
KR20150023406A (en) 2015-03-05
US20130335594A1 (en) 2013-12-19
WO2013191899A1 (en) 2013-12-27
EP2862103A1 (en) 2015-04-22
JP6300792B2 (en) 2018-03-28
TW201407533A (en) 2014-02-16
TWI591575B (en) 2017-07-11

Similar Documents

Publication Publication Date Title
CN104395903A (en) Enhancing captured data
JP4676852B2 (en) Content transmission device
JP6223534B2 (en) Imaging device, imaging method, and imaging control program
JP7420126B2 (en) System, management system, image management method, and program
CN107733769B (en) Method and device for displaying user information
CN106339745A (en) Memory Device Performing Wireless Communication, Information Processing System, And Non-Transitory Computer Readable Recording Medium
JP2007235239A (en) Image processing apparatus, image display apparatus and image processing method
JP2004282708A (en) Print producing apparatus and method, and information detecting apparatus, method and program
US20160134804A1 (en) Image capture methods and systems
JP6268904B2 (en) Image processing apparatus, image processing method, and image processing program
US9086723B2 (en) Image processing apparatus and control method for determining and associating private information with an image
US20150106957A1 (en) Methods, systems, and devices for facilitating viable distribution of data collected by wearable computation
JP6999920B2 (en) Image processing system and image processing equipment
JP2015136084A (en) Data transmission apparatus, information processing apparatus, data transmission program, and data transmission method
JP5924474B2 (en) Portable electronic device, its control method and program
JP2010056894A (en) Video information management system
JP5743017B2 (en) Image management apparatus and program
CN106454210B (en) Driving record image processing method and system
JP2012089928A (en) Image processing device and image processing method
JP2013065165A (en) Image display method and device, image display program, and image display system
CN107038090A (en) Selection includes the method and electronic equipment, system, computer program product and computer-readable recording medium of the content of audio-visual data
CN113361332A (en) Video data acquisition processing method and device
KR20120080379A (en) Method and apparatus of annotating in a digital camera
JP2009016927A (en) Intercom system
JP6089515B2 (en) Image processing apparatus, image processing method, and program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20171020

Address after: Washington State

Applicant after: Micro soft technique license Co., Ltd

Address before: Washington State

Applicant before: Microsoft Corp.

RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20150304