KR20060130647A - Methods and apparatuses for formatting and displaying content - Google Patents

Abstract

In one embodiment, the methods and apparatuses for formatting and displaying content capture an image with a device; detect an image parameters related to the image; store the image parameters such that the image parameters are available for access at a later time; and display the image in a display location based on at least one of the image parameters.

Description

METHODS AND APPARATUSES FOR FORMATTING AND DISPLAYING CONTENT}

The present invention generally relates to formatting and displaying content, and more particularly, to synchronizing and identifying content based on the location of the content.

The content used by the user is increasing rapidly. Such content typically includes video tracks, graphic pictures, photographs, and the like. In many cases, the content used by the user is stored without fully realizing the relationship between each part of the content.

For example, an image is typically captured paying attention to the visual quality of the image. Unfortunately, additional unique information about each picture depicting the environment of the picture is not captured.

Managing this increasing amount of content is a challenge for the majority of users. As the amount of content increases, it becomes more difficult to track additional unique information related to the environment of each picture.

Summary of the Invention

In one embodiment, a method and apparatus for formatting and displaying content includes capturing images with a device, detecting image parameters associated with the image, storing the image parameters so that the image parameters are available for later access, and the image parameters. Displaying an image at a display location based on at least one of the following.

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate and describe one embodiment of a method and apparatus for synchronizing and identifying content.

1 illustrates an environment in which a method and apparatus for formatting and displaying content are implemented.

2 is a simplified block diagram illustrating one embodiment in which a method and apparatus for formatting and displaying content are implemented.

3 is a simplified block diagram illustrating a system according to one embodiment of a method and apparatus for formatting and displaying content.

4 is an exemplary record for use with a method and apparatus for formatting and displaying content.

5A is a data structure according to one embodiment of a method and apparatus for formatting and displaying content.

5B is a data structure according to another embodiment of a method and apparatus for formatting and displaying content.

6 is a flow chart according to one embodiment of a method and apparatus for formatting and displaying content.

7 is a flow chart according to one embodiment of a method and apparatus for formatting and displaying content.

8 is a flow chart according to one embodiment of a method and apparatus for formatting and displaying content.

9 is an illustrative diagram illustrating one embodiment of a method and apparatus for formatting and displaying content.

DETAILED DESCRIPTION The following detailed description of methods and apparatus for formatting and displaying content refers to the accompanying drawings. The detailed description is not intended to limit the methods and apparatus for formatting and displaying content. Instead, the scope of methods and apparatus for formatting and displaying content is defined by the appended claims and their equivalents. Those skilled in the art will appreciate that many different embodiments are possible in accordance with the present invention.

"Content" includes data such as pictures, videos, graphics, etc., which are implemented in digital or analog electronic form.

By "electronic device" is meant to include devices such as video cameras, still picture cameras, cellular phones with image capture modules, PDAs with image capture modules and image capture devices.

1 is a diagram illustrating an environment in which a method and apparatus for formatting and displaying content are implemented. The environment may include electronic device 110 (eg, a computing platform configured to operate as a client device such as a computer, PDA, digital camera, video camera), user interface 115, network 120 (eg, local area network, home network). , The Internet), and a server 130 (eg, a computing platform configured to operate as a server).

In one embodiment, one or more user interface 115 components are keypads and video display screen input / output interfaces in the same housing, such as electronic device 110 (eg, PDA electronics (eg, Clie® manufactured by Sony Corporation, etc.). It is integrated with In another embodiment, one or more user interface 115 components (eg, keyboard, pointing device (mouse, trackball, etc.), microphone, speaker, display, camera) are physically separated from electronic device 110, as conventionally Coupled to electronic device 110. The user uses the interface 115 to access and control content and applications stored on the electronic device 110, the server 130, or a remote storage device (not shown) coupled via the network 120.

According to the present invention, an embodiment of formatting and displaying content in the following is executed by an electronic processor in the electronic device 110, the server 130, or processors operating together in the electronic device 110 and the server 130. Is executed by Although server 130 is shown in FIG. 1 as a single computing platform, in other cases two or more are shown as interconnected computing platforms that act as servers.

A method and apparatus for formatting and displaying content is shown in connection with an exemplary embodiment of an application in which an image is displayed in a particular format and location based on parameters associated with the image. In one embodiment, the image is used via electronic device 110 and network 120. In another embodiment, the image is formatted and displayed by an application located within server 130 and / or electronic device 110.

In one embodiment, a method and apparatus for formatting and displaying content automatically creates a record associated with the picture. In one example, the information in the record is automatically completed by a method and apparatus for formatting and displaying the content based on a pre-stored record associated with the corresponding picture.

2 is a simplified diagram illustrating an example architecture in which a method and apparatus for formatting and displaying content are implemented. An example architecture includes a plurality of electronic devices 110, server device 130, and a network 120 that connects the electronic devices 110 to the server 130 and to each electronic device 110. The plurality of electronic devices 110 are each configured to include a computer readable medium 209, such as RAM, coupled to the electronic processor 208. Processor 208 executes program instructions stored on computer readable medium 209. The unique user operates each electronic device 110 via the interface 115 as described with reference to FIG. 1.

Server device 130 includes a processor 211 coupled to computer readable medium 212. In one embodiment, server device 130 is coupled to, but is not limited to, one or more external or internal devices, such as a second data storage element, such as database 240.

In one example, processors 208 and 211 are manufactured by Intel Corporation of Santa Clara, California. In other examples, other microprocessors are also used.

The plurality of client devices 110 and server 130 include instructions for customized applications that format and display content. In one embodiment, the plurality of computer-readable media 209 and 212 include partially customized applications. Additionally, the plurality of client devices 110 and server 130 are configured to receive and send electronic messages for use with customized applications. Similarly, network 120 is configured to send an electronic message for use with a customized application.

One or more user applications are stored in memory 209, memory 211, or a single user application is partially stored in one memory 209 and partially memory 211. In one example, the stored user application can be customized based on formatting and displaying content as determined using the embodiments described below, regardless of the storage location.

3 illustrates an embodiment of a format and display system 300. In one embodiment, system 300 is implemented within server 130. In another embodiment, system 300 is implemented within electronic device 110. In another embodiment, system 300 is implemented in both electronic device 110 and server 130.

In one embodiment, system 300 includes a render module 310, a location module 320, a storage module 330, an interface module 340, a control module 350, and a capture module.

In one embodiment, the control module 350 communicates with the render module 310, the location module 320, the storage module 330, the interface module 340, and the capture module 360. In one embodiment, the control module 350 coordinates communications between tasks, request and render modules 310, location modules 320, storage modules 330, interface modules 340, and capture modules 360. do.

In one embodiment, the render module 310 displays an image based on the image data and location data. In another embodiment, the render module 310 displays a plurality of images based on the image data and location data of each image. In one embodiment, image data is identified by the capture module 360. In one embodiment, the image data is in the form of a JPEG file. In another example, the image data is in the form of a RAW file. In another example, the image data is in the form of a TIFF file.

In one embodiment, location data is identified by location module 320. In one example, location data represents a specific location of a device, such as a street address of the device. In another example, location data also indicates a device's location orientation, such as horizontal lines, line of sight, and the like. In another embodiment, the location also represents an image location viewed through the viewfinder or device, such as an area captured by the viewfinder, a zoom of the lens, and the like.

In one embodiment, location module 320 processes location data. In one embodiment, the location data includes general purpose location data that provides a broad location of the device on the street by street granularity. In another embodiment, the location data includes image location data that provides specific location data viewed through the device's viewfinder.

In one embodiment, general purpose location data is collected by a global positioning system (GPS). In this embodiment, the GPS system can detect the location of the device and locate the device. In another embodiment, general purpose location data is collected by a plurality of cellular phone receivers that can provide a location of the device.

In one embodiment, the image location data is supplied by at least one sensor in the device that provides the direction the viewfinder is facing and the amount of information that appears in the viewfinder. In one example, the device senses the direction of the viewfinder and displays this direction through coordinates adjusted according to the true north direction. In another example, the device senses the current focal length of the device and determines the amount of information available by the viewfinder.

In one embodiment, location module 320 supplies general location data and image location data associated with a particular image for system 300.

In one embodiment, the storage module 330 stores a record that includes location data associated with the particular content. In another embodiment, the storage module 330 also stores certain content associated with the record.

In one embodiment, the interface module 340 receives a request for a particular function from one of the electronic devices 110. For example, in one example, the electronic device requests content from another device via system 300. In another embodiment, the interface module 340 receives a request from a user of the device. In another embodiment, the interface module 340 displays the information included in the record associated with the content.

In one embodiment, capture module 360 identifies the particular image used by system 300. In one embodiment, capture module 320 identifies a particular image. In another embodiment, capture module 320 processes a particular image captured by the device.

The system 300 of FIG. 3 is shown for illustrative purposes and is only one embodiment of a method and apparatus for formatting and displaying content. Additional modules may be added to the system 300 without departing from the scope of methods and apparatus for formatting and displaying content. Similarly, modules may be combined or removed without departing from the scope of methods and apparatus for formatting and displaying content.

4 shows an example record 400 for use in system 300. Record 400 is associated with specific content. In some embodiments, record 400 includes device general location field 410, horizontal orientation field 420 of image, vertical orientation field 430 of image, viewing angle field 440, associated image field 450, The common reference point field 460, the image identification field 470, and the distance field 480 of the object.

In one embodiment, the device's universal location field 410 represents the device's location while capturing the corresponding image. In one embodiment, the location of the device is expressed in geographic coordinates such as minutes and seconds. In another embodiment, the location of the device is represented by a street address or attraction.

In one embodiment, the horizontal orientation field 420 of the image represents the horizontal orientation of the corresponding image. In one embodiment, the horizontal orientation is represented by degrees from the true north direction.

In one embodiment, the vertical orientation field 430 of the image represents the vertical orientation of the corresponding image. In one embodiment, the vertical direction is represented by degrees from the horizontal line.

In one embodiment, the viewing angle field 440 represents the entire image area captured within the corresponding image. For example, the viewing angle is represented by the zoom or magnification in one embodiment.

In one embodiment, the device's universal location field 410, the horizontal orientation field 420 of the image, the vertical orientation field 430 of the image, and the viewing angle field 440 are captured by the device while capturing the corresponding image. do. In combination, the parameters associated with the device's universal location field 410, the horizontal orientation field 420 of the image, the vertical orientation field 430 of the image, and the viewing angle field 440 may be other images with similar parameters recorded. In comparison with this, the corresponding image can be sufficiently described.

In one embodiment, the associated picture field 450 displays at least one other picture associated with the picture associated with the record 400. For example, another picture having a device's location field 410 similar to the device's location for this particular picture is considered an associated picture. In one embodiment, the associated picture has a different horizontal orientation or different vertical orientation from a particular image. In another embodiment, the associated picture has a viewing angle from the particular picture.

In one embodiment, common reference point 460 identifies common reference locations for the plurality of pictures. In one embodiment, the common reference location is calculated from the device. In another embodiment, a common reference location is calculated from each corresponding picture.

In one embodiment, the picture identification field 470 identifies a picture. In one example, picture identification field 470 includes a descriptive title for a particular picture. In another example, image identification field 470 includes a unique identification corresponding to a particular image.

In one embodiment, the distance field 480 of the object identifies the distance between the device capturing the image and the object of the image. In one embodiment, this distance is calculated from the focus mechanism in the device.

5A shows a record 400, a corresponding picture, and a data structure for use in the system 300. The data structure includes a record table 500 and an image table 510. In one embodiment, record table 500 is stored in storage module 330. In another embodiment, the image table 510 is stored in the storage module 330.

In one embodiment, record table 500 includes record 515 and record 525 similar to record 400. In one embodiment, the image table 510 includes an image 520 and an image 530. In one example, record 515 corresponds to picture 520 and record 525 corresponds to picture 530. Although the picture and the corresponding record are stored separately in this embodiment, the picture and the corresponding record are configured to be logically linked to each other so that the corresponding record can be identified when one of the pictures is used.

5B shows a record 400, a corresponding picture, and a data structure 550 for use with the system 300. In one embodiment, data structure 550 includes a record 560 associated with the corresponding image 570. In this embodiment, both the picture and the corresponding record are combined with each other so that the record becomes available without further action when the picture is used.

6, 7, and 8 are one embodiment of a method and apparatus for formatting and displaying content. Blocks in the flowcharts may be performed in different sequences without departing from the spirit and methods of synchronizing and tracking content. In addition, blocks may be removed, added, or combined without departing from the spirit and methods of synchronizing and tracking content.

6 illustrates capturing an image and location information corresponding to the image, according to one embodiment of the invention. At block 610, an electronic device that captures an image is identified. In one embodiment, a particular electronic device is identified by a user. In one embodiment, the electronic device is a digital camera, a video camera, a personal digital device with an image capture module, a cellular phone with an integrated camera, or the like.

At block 620, the location of the electronic device is detected. In one embodiment, the location of the device is stored in the general location field 410 of the device.

At block 630, an image is captured by the electronic device.

At block 640, image information corresponding to the image captured at block 630 is detected. In one embodiment, the image information includes the horizontal orientation of the image, the vertical orientation of the image, the viewing angle, and / or the distance from the object. In one embodiment, the horizontal orientation of the image, the vertical orientation of the image, and the viewing angle are recorded in the horizontal orientation field 420 of the image, the vertical orientation field 430 of the image, and the viewing angle field 440, respectively.

At block 650, the image is stored. In one embodiment, the image is stored in storage module 330. In one example, the image is stored in the table shown in FIG. 5A. In another example, the image is stored independently as shown in FIG. 5B.

At block 660, device location and image information is stored. In one embodiment, device location and image information is stored in storage module 330. In one embodiment, the device location and picture information is stored in a table and linked to the corresponding picture as shown in FIG. 5A. In another example, device location and image information is stored in association with the corresponding image as shown in FIG. 5B.

7 shows displaying an image in accordance with one embodiment of the present invention. At block 710, a particular picture is identified. In one embodiment, the particular picture is identified via the picture identification field 470.

At block 720, image information corresponding to a particular image is detected. In one embodiment, the image information includes a horizontal orientation of the image, a vertical orientation of the image, and / or a viewing angle. In one embodiment, the horizontal orientation of the image, the vertical orientation of the image, and the viewing angle are recorded in the horizontal orientation field 420 of the image, the vertical orientation field 430 of the image, and the viewing angle field 440, respectively.

In one embodiment, picture information is detected via a record 400 corresponding to a particular picture.

At block 730, location information of the device is detected. In one embodiment, the location of the device corresponds to the location when a particular image is captured by the device. In one embodiment, location information is found in record 400.

At block 740, an available display device is detected. In one embodiment, one display device is detected. In another embodiment, a plurality of display devices is detected. In one embodiment, the display device is coupled to the render module 310.

In one embodiment, the display device is a display screen configured to visually display an image on the display screen. In another embodiment, the display device is a printer device configured to generate printed material on a tangible medium.

At block 750, an area is selected to display a particular picture on the display device. In one embodiment, the area is selected based on the location information of the device. In another embodiment, the area is selected based on the image information.

At block 760, the image is displayed within a selected area on the display device. In one embodiment, in the case of one display screen, the image is displayed in a selected area on one display screen based on the image information and / or device location. For example, the lower right corner of the display screen is used to display based on the picture information for the identified picture.

In another embodiment, in the case of a plurality of display screens, an image is displayed on a particular display screen based on the image information and / or device location. For example, in two displays located next to each other, a display located on the left side is used to display an image identified based on the image information.

In another embodiment, in the case of tangible media having a printer device, an image is displayed in a selected area on the tangible media based on the image information and / or device location. For example, the lower right corner of the tangible medium is used to display based on the image information for the identified image.

8 shows displaying an image according to another embodiment of the present invention. At block 810, the associated picture is identified. In one embodiment, the associated picture is determined based on the proximity of the location information of the device when capturing each individual picture. In one example, the proximity of the device location can be customized to determine a threshold for identifying the associated picture.

In another embodiment, the user identifies the associated picture.

At block 820, picture information corresponding to each associated picture is detected. In one embodiment, the image information includes the horizontal orientation of the image, the vertical orientation of the image, and / or the viewing angle. In one embodiment, the horizontal orientation of the image, the vertical orientation of the image, and the viewing angle are recorded in the horizontal orientation field 420 of the image, the vertical orientation field 430 of the image, and the viewing angle field 440, respectively.

In one embodiment, picture information is detected through a record 400 corresponding to a particular picture.

At block 830, an available display device is detected. In one embodiment, one display device is detected. In another embodiment, a plurality of display devices is detected. In one embodiment, the display device is coupled to the render module 310.

In one embodiment, the display device is a display screen configured to visually display an image on the display screen. In another embodiment, the display device is a printer device configured to generate printed material on a tangible medium.

At block 840, the first associated picture is displayed in a first area within the display device. In one embodiment, the picture information corresponding to the first associated picture determines the first area. In another embodiment, the picture information of the first associated picture determines which display device should be selected to display the first related picture.

At block 850, a second associated picture is displayed in a second area within the display device. In one embodiment, the picture information corresponding to the second associated picture determines the second area. In another embodiment, the picture information of the second associated picture determines which display device should be selected to display the second related picture.

In one embodiment, the first associated picture and the second associated picture are displayed in relation to each other based on comparing image information for both the first associated picture and the second associated picture. For example, if the first associated picture is captured in the horizontal orientation with respect to the right side of the second associated picture, the first associated picture is displayed with respect to the right side of the second associated picture.

In another embodiment, the first associated picture and the second associated picture are displayed in relation to each other based on comparing image information for both the first associated picture and the second associated picture related to the common reference point. For example, if the first associated picture is captured in a vertical orientation above the common reference point and the second associated picture is captured in a vertical orientation below the common reference point, then the first associated picture is displayed above the right side of the second associated picture.

9 is an exemplary diagram illustrating display of an associated image on a plurality of display devices. In one embodiment, the stream 950 of captured images is displayed on the plurality of devices. In this embodiment, the stream 950 of captured pictures includes pictures 960, 970, 980, and 990. Picture 960 is captured before picture 970, picture 970 is captured before picture 980, and picture 980 is captured before picture 990. In one embodiment, each of the images 960, 970, 980, and 990 includes information as shown in the record 400.

In one embodiment, the display device includes display devices 910, 920, 930, and 940 depicted at a location relative to a placeholder 905. In another embodiment, display devices 910, 920, 930, and 940 represent different locations within one display device.

In one embodiment, placeholder 905 represents a camera device that records a stream of captured image 950. In another embodiment, placeholder 950 represents a reference point used by a stream of captured image 950.

In one embodiment, image 960 is displayed on display device 940, image 970 is displayed on display 930, image 980 is displayed on display 910, and image 990 is displayed on the display 920. In this embodiment, the stream 950 of captured images can be captured in any order. In one embodiment, images 960, 970, 980, and 990 are arranged and displayed according to system 300 with respect to placeholder 905. For example, when images 960, 970, 980, and 990 are captured, image 940 is positioned above image 920, image 910 is positioned to the left of image 920, and image 930 is positioned as image ( 920 is located on the right side. Although pictures 960, 970, 980, and 990 are captured in a different order within stream 950 of the captured pictures, they are located on their respective displays based on their location during capture.

The foregoing detailed description of specific embodiments of the invention has been presented for purposes of illustration and description. The invention can be applied to a variety of different applications.

These are not exhaustive or limiting to the invention according to the disclosed embodiments, and naturally many modifications and variations are possible in accordance with the above teachings. The embodiments have been selected and described in order to illustrate the principles of the invention and its practical applications, and thus those skilled in the art can best utilize various embodiments having various modifications suitable for the invention and the particular uses contemplated. . It is intended that the scope of the invention only be limited by the claims appended hereto and their equivalents.

Claims (31)

Capturing an image with the device; Detecting picture parameters associated with the picture; Storing the picture parameters such that the picture parameters are available for later access; And Displaying the picture at a display location based on the picture parameter. The method of claim 1, The device is a camera. The method of claim 1, Storing the image. The method of claim 1, When the image is captured, detecting the location of the device. The method of claim 4, wherein Detecting an associated picture based on a location of the device. The method of claim 5, Detecting the associated picture further comprises comparing a first location of the device corresponding to a first picture with a second location of the device corresponding to a second picture. The method of claim 1, The image is a photograph. The method of claim 1, The picture is one frame in a video sequence. The method of claim 1, The picture parameter is a horizontal orientation of the picture. The method of claim 1, The picture parameter is a vertical orientation of the picture. The method of claim 1, The picture parameter is a viewing angle of the picture. The method of claim 1, The picture parameter is a location of the picture relative to the device. Means for capturing an image with the device; Means for detecting a picture parameter associated with the picture; Means for storing the picture parameter such that the picture parameter is available for later access; And Means for displaying the picture at a display location based on at least one of the picture parameters. Detecting the first image and the second image; Detecting a first picture parameter and a second picture parameter corresponding to each of the first picture and the second picture; Displaying the first image at a first display location based on the first image parameter; And Displaying the second picture at a second display location based on the second picture parameter. The method of claim 14, Storing the first picture parameter and the second picture parameter such that the first picture parameter and the second picture parameter are available for later access. The method of claim 14, Capturing the first image. The method of claim 14, Capturing said first picture parameter. The method of claim 14, Wherein the first display location is displayed on a first display device and the second display location is displayed on a second display device. The method of claim 14, The first display location and the second display location are displayed on a display device. The method of claim 14, And the first display location and the second display location are implemented on a tangible medium. The method of claim 14, Wherein the first picture parameter is a horizontal orientation of the picture. The method of claim 14, And the first picture parameter is a vertical orientation of the picture. The method of claim 14, The first picture parameter is a viewing angle of the picture. The method of claim 14, Selecting the first picture and the second picture based on a first device location and a second device location corresponding to each of the first and second pictures. A location module for capturing picture parameters depicting a picture; A storage module configured to store the picture parameter; And And a render module configured to display the picture at a specific location based on the picture parameter. The method of claim 25, And a capture module configured to record the image. The method of claim 25, The picture comprises one of a frame within a photo and video sequence. The method of claim 25, The location module detects a location of a device while the image is captured. The method of claim 25, The storage module is configured to store a record including the picture parameter, the record corresponding to the picture. The method of claim 25, The storage module is configured to store a synchronization program. Detecting the first image and the second image; Detecting a first picture parameter and a second picture parameter corresponding to each of the first picture and the second picture; Displaying the first image at a first display location based on the first image parameter; And Displaying the second image at a second display location based on the second image parameter Computer-readable media having computer executable instructions for performing a method comprising a.

Images