WO2010055604A1 - 画像処理装置、情報処理装置、画像処理方法、および情報処理方法 - Google Patents
画像処理装置、情報処理装置、画像処理方法、および情報処理方法 Download PDFInfo
- Publication number
- WO2010055604A1 WO2010055604A1 PCT/JP2009/004441 JP2009004441W WO2010055604A1 WO 2010055604 A1 WO2010055604 A1 WO 2010055604A1 JP 2009004441 W JP2009004441 W JP 2009004441W WO 2010055604 A1 WO2010055604 A1 WO 2010055604A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- display
- data
- area
- hierarchical data
- Prior art date
Links
- 238000012545 processing Methods 0.000 title claims description 190
- 230000010365 information processing Effects 0.000 title claims description 41
- 238000003672 processing method Methods 0.000 title claims description 28
- 230000006870 function Effects 0.000 claims description 66
- 238000003860 storage Methods 0.000 claims description 43
- 230000009467 reduction Effects 0.000 claims description 33
- 238000004590 computer program Methods 0.000 claims description 29
- 230000001276 controlling effect Effects 0.000 claims description 12
- 230000000694 effects Effects 0.000 claims description 10
- 230000004044 response Effects 0.000 claims description 10
- 230000008859 change Effects 0.000 claims description 7
- 230000014509 gene expression Effects 0.000 claims description 5
- 238000009877 rendering Methods 0.000 claims description 5
- 230000002596 correlated effect Effects 0.000 claims description 2
- 238000000034 method Methods 0.000 description 77
- 230000008569 process Effects 0.000 description 44
- 239000000872 buffer Substances 0.000 description 36
- 230000007704 transition Effects 0.000 description 16
- 238000012546 transfer Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 10
- 230000000875 corresponding effect Effects 0.000 description 8
- 238000012508 change request Methods 0.000 description 6
- 230000004913 activation Effects 0.000 description 5
- 238000006243 chemical reaction Methods 0.000 description 5
- 230000006835 compression Effects 0.000 description 5
- 238000007906 compression Methods 0.000 description 5
- 230000007246 mechanism Effects 0.000 description 5
- 238000007796 conventional method Methods 0.000 description 4
- 238000012905 input function Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000009826 distribution Methods 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 241000255777 Lepidoptera Species 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000005012 migration Effects 0.000 description 2
- 238000013508 migration Methods 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 238000011946 reduction process Methods 0.000 description 2
- 241001465754 Metazoa Species 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000005562 fading Methods 0.000 description 1
- 238000013467 fragmentation Methods 0.000 description 1
- 238000006062 fragmentation reaction Methods 0.000 description 1
- 230000001771 impaired effect Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000010422 painting Methods 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 230000004043 responsiveness Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04806—Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
Definitions
- the present invention relates to an image processing technique for enlarging / reducing an image displayed on a display, or moving the image vertically and horizontally.
- a technique for enlarging / reducing a display image and moving in the vertical and horizontal directions using tile images having a plurality of resolutions generated from digital images such as high-definition photographs has been proposed.
- an original image size is reduced in a plurality of stages to generate images with different resolutions, and images in each layer are divided into one or a plurality of tile images to represent the original image in a hierarchical structure.
- the image with the lowest resolution is composed of one tile image
- the original image with the highest resolution is composed of the largest number of tile images.
- the image processing apparatus quickly performs enlarged display or reduced display by switching the tile image being used to a tile image of a different hierarchy at the time of enlargement processing or reduction processing of the display image.
- the present invention has been made in view of such a problem, and an object of the present invention is to provide a technique capable of easily displaying desired information while maintaining the quality of information.
- An aspect of the present invention relates to an image processing apparatus.
- This image processing apparatus is an image processing apparatus that displays at least a part of an image on a display, and stores a hierarchical data configured by layering image data of different resolutions in one image in the order of resolution;
- a memory In a virtual space defined by an image plane and a resolution axis, a memory that holds a scenario setting file that specifies an area in hierarchical data, an input information acquisition unit that receives an instruction input related to a change in a display image from a user, And a display image processing unit that guides a display image to an area specified in the scenario setting file when a predetermined instruction is input from the user.
- the image processing method is an image processing method for displaying at least a part of an image on a display, reading image data from a storage device and drawing the image data on a display device, moving a display area in an image currently being displayed, and A step of accepting a display image movement request including enlargement / reduction from a user, and a step of guiding the display image to an area and a resolution set in advance in accordance with the display image movement request.
- An aspect of the present invention relates to an image processing apparatus.
- This image processing apparatus is an image processing apparatus that displays at least a part of an image on a display, and stores a hierarchical data configured by layering image data of different resolutions in one image in the order of resolution; In a virtual space defined by the image plane and the resolution axis, a memory for holding a link setting file in which predetermined areas in different hierarchical data are associated with each other, and a movement request for the display image displayed on the display in the virtual space.
- a display image processing unit that switches a display image to a region of another associated hierarchical data. And butterflies.
- the image processing method is an image processing method for displaying at least a part of an image on a display, reading image data from a storage device and drawing the image data on a display device, moving a display area in an image currently being displayed, and A step of accepting a display image movement request including enlargement / reduction from the user, and when the display image reaches an area and resolution preset in the memory, display in a predetermined area of another image associated with the setting And a step of switching.
- Still another aspect of the present invention relates to the data structure of content.
- This data structure is a virtual space defined by a predetermined area in a plurality of hierarchical data among hierarchical data constituted by layering image data of different resolutions in one image in the order of resolution by an image plane and a resolution axis.
- a plurality of hierarchical data correlated by the link setting file, and attribute information for controlling the viewing of the hierarchical data is characterized by that.
- An aspect of the present invention relates to an image processing apparatus.
- This image processing apparatus is an image processing apparatus that displays at least a part of an image on a display, and stores a hierarchical data configured by layering image data of different resolutions in one image in the order of resolution; While displaying at least two hierarchical data and holding a link setting file in which a display image switching condition between the hierarchical data is set, and displaying an image of a certain hierarchical data, the display image is switched A link determination unit that determines whether or not the link condition file is satisfied, and an image of another hierarchical data associated with the hierarchical data when the link determination unit determines that the switching condition is satisfied And a display image processing unit for switching display images.
- the image processing method is an image processing method for displaying at least a part of an image on a display.
- the image processing method includes a step of reading a plurality of image data associated in advance in a memory from a storage device as a processing target; A step of displaying at least one of them, a step of accepting a display image movement request including a movement and enlargement / reduction of a display area in the currently displayed image, and a condition in which the display image satisfies a preset condition in the memory And switching the display to another image data associated with the image data being displayed.
- An aspect of the present invention relates to an information processing apparatus.
- the information processing apparatus includes an input information acquisition unit that receives input for selecting a plurality of individual images from a user, a setting information registration unit that generates index image data in which the selected plurality of individual images are arranged in a predetermined format,
- the plurality of individual images has a hierarchical data structure formed by layering image data of different resolutions in the order of resolution, and the setting information registration unit includes an area in which the individual images are arranged in the index image, and the area
- the link setting file for switching the data used for rendering the display image from the index image to the individual image is generated and output to the memory by associating with the hierarchical data of the individual image arranged in .
- Another aspect of the present invention relates to an information processing method.
- a step of receiving an input for selecting a plurality of individual images from a user reading the selected plurality of individual images from a storage device, generating index image data arranged in a predetermined format, and storing them in a memory
- a plurality of individual images having a hierarchical data structure formed by layering image data of different resolutions in the order of resolution, and the step of outputting includes an area in which the individual images are arranged in the index image
- a link setting file for switching the data used for rendering the display image from the index image to the individual image, and further outputting the link setting file.
- This data structure includes a plurality of individual image data having a hierarchical data structure formed by layering image data of different resolutions in the order of resolution, index image data in which individual images are arranged in a predetermined format, and an index image A link setting file for associating the area where the individual image is arranged with the hierarchical data of the individual image arranged in the area, and switching the data used for drawing the display image from the index image to the individual image, Characterized by association.
- Still another aspect of the present invention relates to an information processing apparatus.
- This information processing apparatus is a reference for switching a display image in a predetermined area of different hierarchical data in an image processing apparatus that reads and displays hierarchical data configured by hierarchizing image data of different resolution in one image in order of resolution.
- An information processing device that generates a link setting file, a storage device that holds the hierarchical data, a setting image display unit that reads and displays the hierarchical data from the storage device based on a selection input from a user, For each of the plurality of hierarchical data images displayed in the setting image display unit, an input for selecting a region is received from the user, and the coordinates in the virtual space defined by the image plane and the resolution axis for each selected region.
- Setting information for generating the link setting file by identifying each other and associating them with each other Characterized in that it comprises a recording unit.
- the setting information registration unit accepts an input for selecting a plurality of areas from the user for the plurality of hierarchical data associated with the link setting file, and the virtual information is selected for the plurality of selected areas.
- a scenario setting file referred to for switching a display image in a plurality of areas of the plurality of hierarchical data may be further generated by specifying and recording coordinates in a space.
- the setting information registration unit performs pattern matching on images in each region of different hierarchical data selected by the user so that the object in the image is displayed at the same position on the screen.
- the coordinates of each region in the virtual space may be adjusted and then associated with each other.
- the area set in the link setting file may be a rectangle having a predetermined aspect ratio.
- the setting information registration unit determines whether the display image switching is valid when the display image before switching moves in any of the enlargement / reduction directions for each group of associated regions. Further, it may be received and recorded in the link setting file.
- the information processing apparatus may further generate a file including the hierarchical data or information relating to the storage area of the hierarchical data, the link setting file, and the scenario setting file.
- the setting image display unit may display the switching of the display image in a predetermined region of the associated hierarchical data with reference to the generated link setting file.
- the setting information registration unit transmits the generated link setting file to an image processing apparatus connected via a network, and based on response information transmitted from the image processing apparatus, the link setting file It is good also as correcting.
- Still another aspect of the present invention also relates to an information processing apparatus.
- This information processing apparatus is referred to in order to switch a display image in a plurality of areas of hierarchical data in an image processing apparatus that reads and displays hierarchical data configured by hierarchizing image data having different resolutions in a single image in order of resolution.
- An information processing device that generates a scenario setting file, a storage device that holds the hierarchical data, a setting image display unit that reads and displays the hierarchical data from the storage device based on a selection input from a user, and the setting For the hierarchical data displayed in the image display unit, an input for selecting a plurality of areas is received from the user, and the coordinates in the virtual space defined by the image plane and the resolution axis are specified for the selected areas. And a setting information registration unit that generates the scenario setting file by recording. And butterflies.
- the setting information registration unit further receives information related to a display method from a user, associates each area selected by the user in the scenario setting file with information related to the display method of the area, and It may be characterized by recording in a scenario setting file.
- the information processing apparatus may further generate a file including the hierarchical data or information relating to the storage area of the hierarchical data and the scenario setting file.
- the setting image display unit may display the switching of display images in a plurality of recorded areas with reference to the generated scenario setting file.
- the setting information registration unit transmits the generated scenario setting file to an image processing apparatus connected via a network, and based on response information transmitted from the image processing apparatus, the scenario setting file It is good also as correcting.
- the file may further include attribute information for controlling viewing of hierarchical data.
- Still another aspect of the present invention relates to an information processing method.
- This information processing method is used for switching a display image in a predetermined area of different hierarchical data in an image processing apparatus that reads and displays hierarchical data configured by hierarchizing image data of different resolution in one image in order of resolution.
- An information processing method for generating a link setting file, the step of reading out and displaying the hierarchical data from a storage device based on a selection input from a user, and a region for each of the displayed images of the hierarchical data The step of accepting the input to be selected from the user, and for each selected area, the coordinates in the virtual space defined by the image plane and the resolution axis are identified and associated with each other, whereby the link setting file is stored in the memory. And a step of outputting.
- Still another aspect of the present invention relates to a computer program.
- This computer program is referred to in order to switch a display image in a predetermined area of different hierarchical data in an image processing apparatus that reads and displays hierarchical data constituted by layering image data of different resolutions in the order of resolution in one image.
- a computer program for generating a link setting file for a computer wherein the hierarchical data is read from the storage device based on a selection input from a user and displayed, and an area is provided for each of the displayed images of the hierarchical data.
- Still another embodiment of the present invention relates to a recording medium on which a computer program is recorded.
- This recording medium is referred to in order to switch a display image in a predetermined area of different hierarchical data in an image processing apparatus that reads and displays hierarchical data configured by layering image data of different resolutions in the order of resolution in one image.
- a storage medium storing a computer program for causing a computer to generate a link setting file, a function of reading out and displaying the hierarchical data from a storage device based on a selection input from a user, and an image of each of a plurality of displayed hierarchical data
- Rukoto the computer program characterized by Rukoto.
- Still another embodiment of the present invention relates to an image processing apparatus.
- This image processing apparatus is an image processing apparatus that displays at least a part of an image on a display, and stores a hierarchical data configured by layering image data of different resolutions in one image in the order of resolution; A plurality of areas in the hierarchical data in the virtual space defined by the image plane and the resolution axis, a memory holding a scenario setting file in which information related to the display method of the area is set, and the scenario setting file are referred to And a display image processing unit for continuously switching and displaying the plurality of areas by a set display method.
- the memory further holds a link setting file in which predetermined areas in different hierarchical data in the virtual space are associated with each other, and an area specified in the scenario setting file is associated with the link setting file.
- a link setting file in which predetermined areas in different hierarchical data in the virtual space are associated with each other, and an area specified in the scenario setting file is associated with the link setting file.
- the hierarchical data held by the storage device is added with attribute information for controlling viewing of the hierarchical data, and the display image processing unit changes the target hierarchical data when switching display images.
- the attribute information may be read, and the display mode may be changed according to a predetermined rule based on the information.
- Still another aspect of the present invention relates to an image processing method.
- This image processing method is an image processing method for displaying at least a part of an image on a display, and includes image planes and resolutions of hierarchical data configured by layering image data of different resolutions in one image in the order of resolution.
- a plurality of areas in the hierarchical data and a step of reading a scenario setting file in which information relating to the display method of the area is set are read from the memory, and the scenario setting file is referred to and set A step of continuously switching and displaying the plurality of regions by the displayed method.
- Still another aspect of the present invention relates to a computer program.
- This computer program is a computer program that causes a computer to realize a function of displaying at least a part of an image on a display.
- the hierarchical data configured by layering image data of different resolutions in one image in the order of resolution
- a function for reading out from a memory a scenario setting file in which a plurality of areas in the hierarchical data in the virtual space defined by the image plane and the resolution axis and information relating to the display method of the area are set, and the scenario setting file , And a function of continuously switching and displaying the plurality of areas by a set display method is realized in a computer.
- Still another embodiment of the present invention relates to a recording medium on which a computer program is recorded.
- This recording medium is a recording medium in which a computer program for realizing a function of displaying at least a part of an image on a display on a computer is recorded, and is configured by layering image data of different resolutions in one image in the order of resolution.
- a computer program is recorded that refers to the scenario setting file and causes a computer to realize a function of continuously switching and displaying the plurality of areas by a set display method.
- Still another aspect of the present invention relates to the data structure of content.
- This data structure includes hierarchical data configured by layering image data of different resolutions in one image in the order of resolution, and a plurality of regions in the hierarchical data in a virtual space defined by an image plane and a resolution axis.
- the information regarding the display method of the area is set, and the scenario setting file for continuously switching and displaying the plurality of areas is associated with the attribute information for controlling the viewing of the hierarchical data.
- the data structure includes a plurality of hierarchical data to be set and a plurality of attribute information for controlling viewing of each hierarchical data. , May be associated with each other.
- attribute information for controlling viewing of the content may be further associated with content continuously displayed by the scenario setting file.
- Still another aspect of the present invention relates to a recording medium on which a data structure of content is recorded.
- This recording medium records the data structure.
- information can be displayed with an easy operation even when information is advanced.
- FIG. 1 It is a figure which shows the use environment of the image processing system concerning embodiment of this invention. It is a figure which shows the external appearance structure of the input device applicable to the image processing system of FIG. It is a figure which shows the hierarchical structure example of the image data used in this Embodiment. It is a figure which shows the structure of the image processing apparatus in this Embodiment. It is a figure for demonstrating the prefetch process in this Embodiment. It is a figure which shows typically the flow of the image data in this Embodiment. It is a figure which shows typically the relationship of the several hierarchy data used as display object in this Embodiment. It is a figure which illustrates the mode of a display image when a link is set between hierarchy data in this Embodiment.
- this Embodiment it is a figure which shows the mode of the transfer of a display image at the time of combining the guidance to a different hierarchy and the guidance to another area in the same hierarchy. It is a flowchart which shows the flow of a process when the process which controls the transfer of an image in detail is described in the scenario setting file of this Embodiment. It is a figure which shows typically the example of the distribution mode of the data at the time of implement
- FIG. 1 shows a use environment of an image processing system 1 according to an embodiment of the present invention.
- the image processing system 1 includes an image processing device 10 that executes image processing software, and a display device 12 that outputs a processing result by the image processing device 10.
- the display device 12 may be a television having a display that outputs an image and a speaker that outputs sound.
- the display device 12 may be connected to the image processing device 10 by a wired cable, or may be wirelessly connected by a wireless LAN (Local Area Network) or the like.
- the image processing apparatus 10 may be connected to an external network such as the Internet via the cable 14 to download and acquire hierarchical compressed image data.
- the image processing apparatus 10 may be connected to an external network by wireless communication.
- the image processing device 10 may be a game device, for example, and may implement an image processing function by loading an application program for image processing.
- the image processing apparatus 10 may be a personal computer, and may implement an image processing function by loading an image processing application program.
- the image processing apparatus 10 performs an enlargement / reduction process of an image displayed on the display of the display apparatus 12, a movement process in the up / down / left / right directions, and the like according to a request from the user.
- these processes are collectively referred to as “display image moving process”.
- the input device transmits a movement request signal for the display image to the image processing device 10.
- FIG. 2 shows an external configuration of the input device 20.
- the input device 20 includes a cross key 21, analog sticks 27a and 27b, and four types of operation buttons 26 as operation means that can be operated by the user.
- the four types of operation buttons 26 include a circle button 22, a x button 23, a square button 24, and a triangle button 25.
- a function for inputting a display image enlargement / reduction request and a vertical / left / right scroll request is assigned to the operation unit of the input device 20.
- the input function of the display image enlargement / reduction request is assigned to the right analog stick 27b.
- the user can input a display image reduction request by pulling the analog stick 27b forward, and can input a display image enlargement request by pressing the analog stick 27b from the front.
- the input function of the display area movement request is assigned to the cross key 21.
- the user can input a movement request in the direction in which the cross key 21 is pressed by pressing the cross key 21.
- the image movement request input function may be assigned to another operation means, for example, the scroll request input function may be assigned to the analog stick 27a.
- the input device 20 has a function of transmitting the input image movement request signal to the image processing device 10, and is configured to be capable of wireless communication with the image processing device 10 in the present embodiment.
- the input device 20 and the image processing device 10 may establish a wireless connection using a Bluetooth (registered trademark) protocol, an IEEE802.11 protocol, or the like. Note that the input device 20 may be connected to the image processing device 10 via a cable and transmit an image movement request signal to the image processing device 10.
- FIG. 3 shows an example of the hierarchical structure of image data used in the present embodiment.
- the image data has a hierarchical structure including a 0th hierarchy 30, a first hierarchy 32, a second hierarchy 34, and a third hierarchy 36 in the depth (Z-axis) direction. Although only four layers are shown in the figure, the number of layers is not limited to this.
- image data having such a hierarchical structure is referred to as “hierarchical data”.
- the hierarchical data shown in Fig. 3 has a hierarchical structure of a quadtree, and each hierarchy is composed of one or more tile images 38. All the tile images 38 are formed in the same size having the same number of pixels, and have, for example, 256 ⁇ 256 pixels.
- the image data of each layer expresses one image at different resolutions, and the original image of the third layer 36 having the highest resolution is reduced in a plurality of stages to obtain the second layer 34, the first layer 32, the 0th layer.
- Image data of the hierarchy 30 is generated.
- the resolution of the Nth layer (N is an integer greater than or equal to 0) may be 1 ⁇ 2 of the resolution of the (N + 1) th layer in both the left and right (X axis) direction and the up and down (Y axis) direction.
- the hierarchical data is held in the storage device in a compressed state in a predetermined compression format, and is read from the storage device and decoded before being displayed on the display.
- the image processing apparatus 10 has a decoding function corresponding to a plurality of types of compression formats, and can decode, for example, compressed data in the S3TC format, JPEG format, and JPEG2000 format.
- the compression processing may be performed in units of tile images, or may be performed in units of a plurality of tile images included in the same layer or a plurality of layers.
- the hierarchical structure of the hierarchical data is set with the horizontal direction as the X axis, the vertical direction as the Y axis, and the depth direction as the Z axis, thereby constructing a virtual three-dimensional space.
- the image processing apparatus 10 derives coordinates (frame coordinates) of the four corners of the frame in the virtual space using the movement amount.
- the frame coordinates in the virtual space are used for display image generation processing to be described later.
- the image processing apparatus 10 may derive information for specifying the hierarchy and texture coordinates (UV coordinates) in the hierarchy.
- the combination of the hierarchy specifying information and the texture coordinates is also referred to as frame coordinates.
- FIG. 4 shows the configuration of the image processing apparatus 10.
- the image processing apparatus 10 includes a wireless interface 40, a switch 42, a display processing unit 44, a hard disk drive 50, a recording medium mounting unit 52, a disk drive 54, a main memory 60, a buffer memory 70, and a control unit 100.
- the display processing unit 44 has a frame memory that buffers data to be displayed on the display of the display device 12.
- the switch 42 is an Ethernet switch (Ethernet is a registered trademark), and is a device that transmits and receives data by connecting to an external device in a wired or wireless manner.
- the switch 42 may be connected to an external network via the cable 14 and receive the compressed image data layered from the image server.
- the switch 42 is connected to the wireless interface 40, and the wireless interface 40 is connected to the input device 20 using a predetermined wireless communication protocol.
- the image movement request signal input from the user by the input device 20 is supplied to the control unit 100 via the wireless interface 40 and the switch 42.
- the hard disk drive 50 functions as a storage device that stores data.
- the compressed image data received via the switch 42 is stored in the hard disk drive 50.
- the recording medium mounting unit 52 reads data from the removable recording medium.
- the disk drive 54 drives and recognizes the ROM disk to read data.
- the ROM disk may be an optical disk or a magneto-optical disk.
- the compressed image data may be stored in these recording media.
- the control unit 100 includes a multi-core CPU, and has one general-purpose processor core and a plurality of simple processor cores in one CPU.
- the general-purpose processor core is called PPU (Power Processing Unit), and the remaining processor cores are called SPU (Synergistic-Processing Unit).
- the control unit 100 includes a memory controller connected to the main memory 60 and the buffer memory 70.
- the PPU has a register, has a main processor as an operation execution subject, and efficiently assigns a task as a basic processing unit in an application to be executed to each SPU. Note that the PPU itself may execute the task.
- the SPU has a register, and includes a sub-processor as an operation execution subject and a local memory as a local storage area. The local memory may be used as the buffer memory 70.
- the main memory 60 and the buffer memory 70 are storage devices and are configured as a RAM (Random Access Memory).
- the SPU has a dedicated DMA (Direct Memory Access) controller as a control unit, can transfer data between the main memory 60 and the buffer memory 70 at high speed, and the frame memory and the buffer memory 70 in the display processing unit 44 High-speed data transfer can be realized.
- the control unit 100 according to the present embodiment realizes a high-speed image processing function by operating a plurality of SPUs in parallel.
- the display processing unit 44 is connected to the display device 12 and outputs an image processing result according to a request from the user.
- the image processing apparatus 10 uses a part of compressed image data determined according to a rule described later in order to smoothly change a display image when performing a display image enlargement / reduction process or a display area movement process. Is loaded from the hard disk drive 50 into the main memory 60. Further, an image to be displayed in the future is predicted based on an image movement request from the user, and a part of the compressed image data loaded in the main memory 60 is decoded and stored in the buffer memory 70. This makes it possible to instantaneously switch an image used for generating a display image at a necessary later timing.
- a process of predicting a tile image to be displayed in the future and developing it in advance in the buffer memory 70 is referred to as a “prefetching process”.
- FIG. 5 shows a diagram for explaining the prefetching process.
- FIG. 5 shows the structure of hierarchical data, and each hierarchy is expressed as L0 (0th hierarchy), L1 (1st hierarchy), L2 (2nd hierarchy), and L3 (3rd hierarchy).
- the position in the depth (Z-axis) direction indicates the resolution. The position closer to L0 has a lower resolution, and the position closer to L3 has a higher resolution.
- the position in the depth direction corresponds to the scale ratio, and when the scale ratio of the display image of L3 is 1, the scale ratio in L2 is 1/4, and in L1 The scale factor is 1/16, and the scale factor at L0 is 1/64.
- the display image when the display image changes from the L0 side to the L3 side, the display image enlarges.
- the display image changes from the L3 side to the L0 side the display image is reduced.
- An arrow 80 indicates that the image movement request signal from the user requests reduction of the display image, and crosses the reduction ratio 1/4 (L2).
- the image processing apparatus 10 of the present embodiment when the position in the depth direction of L1 and L2 prepared as the tile image 38 is set as a prefetch boundary in the depth direction, and the image change request signal crosses the prefetch boundary, The prefetch process is started.
- the display image is created using a tile image of L2 (second layer).
- the L2 tile image is used when the scale ratio of the image to be displayed is between the switching boundary 82 between the L1 tile image and the L2 tile image and the switching boundary 84 between the L2 tile image and the L3 tile image.
- the image processing apparatus 10 performs a convolution operation on the image movement request signal from the input device 20 and a transfer function, delays generation of a display image requested by the image movement request signal, and is predicted from the image movement request signal in the meantime.
- a tile image 38 required in the future is specified and pre-read from the main memory 60.
- the image processing apparatus 10 pre-reads and decodes the corresponding tile image 38 of L1 in the reduction direction from the main memory 60, Write to the buffer memory 70.
- a prefetch boundary is set for the image data developed in the buffer memory 70, and the prefetch process is started when the display position by the image change request signal crosses the prefetch boundary.
- FIG. 6 schematically shows the flow of image data in the present embodiment.
- the hierarchical data is stored in the hard disk drive 50.
- a recording medium mounted on the recording medium mounting unit 52 or the disk drive 54 may be held.
- the hierarchical data may be downloaded from an image server connected by the image processing apparatus 10 via a network.
- the hierarchical data here is subjected to fixed length compression in the S3TC format or the like, or variable length compression in the JPEG format or the like.
- a part of the image data is loaded into the main memory 60 in a compressed state (S10).
- the area to be loaded here is a predetermined rule such as the vicinity of the current display image in the virtual space, the area of the image, the area where a display request is predicted to be frequently made based on the user's browsing history, etc. Determined by.
- the loading is performed not only when an image change request is made, but also at any given time interval, for example. This prevents the load process from being concentrated at one time.
- the compressed image data to be loaded is a block unit having a substantially constant size. Therefore, the hierarchical data held by the hard disk drive 50 is divided into blocks according to a predetermined rule. By doing so, data management in the main memory 60 can be performed efficiently. That is, even if the compressed image data is variable-length compressed, the data size to be loaded is almost equal in units of blocks (hereinafter referred to as “image blocks”). A new load is completed by overwriting any of the stored blocks. As a result, fragmentation is unlikely to occur, the memory can be used efficiently, and address management is facilitated.
- the buffer memory 70 includes at least two buffer areas 72 and 74.
- the size of each of the buffer areas 72 and 74 is set larger than the size of the frame memory 90.
- One of the buffer areas 72 and 74 is a display buffer that is used to hold an image used to generate a display image, and the other is a decoding that is used to prepare an image predicted to be necessary thereafter. Buffer.
- the buffer area 72 is a display buffer
- the buffer area 74 is a decoding buffer
- the display area 68 is displayed.
- the image stored in the decoding buffer by the prefetching process may be an image in the same hierarchy as the image stored in the display buffer, or may be an image in a different hierarchy having a different scale.
- the image in the display area 68 among the images stored in the buffer area 72, which is a display buffer, is drawn in the frame memory 90 (S14).
- the image in the new area is decoded as necessary and stored in the buffer area 74.
- the display buffer and the decoding buffer are switched according to the timing of completion of storage, the amount of movement of the display area 68, and the like (S16). Thereby, a display image can be smoothly switched with respect to a movement of a display area, a change of a scale ratio, or the like.
- FIG. 7 schematically shows the relationship between a plurality of hierarchical data to be displayed in such an aspect.
- two triangles indicate different hierarchical data 150 and 152.
- Each of the hierarchical data 150 and 152 actually has a configuration in which a plurality of image data having different resolutions are discretely present in the Z-axis direction in the figure as shown in FIG.
- the display image moves in the Z-axis direction in the figure.
- the horizontal plane in the figure is moved.
- a state in which the two hierarchical data 150 and 152 overlap as shown in the figure is generated.
- the display image enters the area of the hierarchical data 152, that is, between the hierarchical data Will be moved.
- the images of the hierarchical data 150 and 152 may be data representing the same object in different resolution ranges or data representing completely different objects.
- the hierarchical data 150 is world map data and the hierarchical data 152 is Japan map data
- a transition from the hierarchical data 150 to the hierarchical data 152 occurs when the user expands the Japanese region of the world map.
- a more detailed display of the map of Japan is possible.
- the hierarchical data 150 is data on the menu screen and the hierarchical data 152 is manual data describing each icon displayed on the menu screen
- the user can expand the desired icon on the menu screen to cope with the icon. It is possible to switch to a manual image explaining the function to be performed.
- the hierarchical data used for drawing is switched in response to the input of the display image movement request including the movement of the display image in the virtual space, that is, enlargement and reduction. Since such switching can be performed only with basic operations on the currently displayed image, a user interface with good operability is provided without the need to display or select a menu screen for switching. it can. For example, when creating content that can be expanded continuously from a world map image to a high-resolution image that allows you to see buildings and roads, you can keep the hierarchical data separately according to the resolution range, etc. Data in an area that does not need to be expanded can be omitted, and the data size can be significantly reduced rather than constructing one huge hierarchical data. In addition, it is easy to continuously display completely different images, and application to various image representations and creation of contents are facilitated.
- link information represented by a line 154 in FIG. 7 in which region of the image being displayed and at which resolution to switch to another hierarchical data.
- switching from the hierarchical data 150 to the hierarchical data 152 is performed at a position where the Z-axis is z1 and the position on the horizontal plane (see FIG. 3) represented by the line 154.
- link switching between hierarchical data is referred to as “link”.
- FIG. 8 shows an example of a display image when a link is set between hierarchical data.
- three hierarchical data of images 156, 158 and 160 are displayed.
- a link is set to the area 162 of the image 156 and the area 163 of the image 158, and a link is set to the area 164 of the image 156 and the area 165 of the image 160.
- Such an area is hereinafter referred to as a “link area”.
- the link area corresponds to the line 154 in FIG.
- the hierarchical data used for display is switched from the image 156 to the image 158, and the link in the image 158 is displayed.
- a region 163 becomes a display image (arrow A).
- an image in which the resolution is further increased for an area mainly centered on a pentagon in the image 156 is held in the hard disk drive 50 as hierarchical data of another image 158.
- the link area 162 and the link area 163 are set to have the same viewing angle. Then, a higher resolution image than the highest resolution image in the hierarchical data of the image 156 can be continuously displayed using the hierarchical data of the image 158. At this time, since the appearance is simply zoomed in to the pentagon and the transition of the arrow a in FIG. 7 occurs, the user is not aware that the hierarchical data has been switched.
- an arrow B is also set.
- the display from the image 158 to the image 156 is performed.
- the hierarchical data to be used is switched, and the link area 162 in the image 156 becomes a display image (arrow B). Also in this case, it is possible to continuously reduce the display image in the image 158 only by reducing the display data without being aware of the switching of the hierarchical data.
- the transition from the link area 164 to the link area 165 also zooms in on the ellipse while displaying the image 156, and when the display image overlaps the link area 164, the hierarchical data is switched and the image 160 is switched.
- the link area 165 becomes a display image. Thereby, an image display with a higher resolution than the image 156 can be performed. It should be noted that the state that the display image “overlaps” the link area does not have to overlap exactly, so a rule is set in advance that the display image is considered to have overlapped when entering the predetermined range from the link area. Just keep it.
- FIG. 9 shows the configuration of the control unit 100 in detail.
- the control unit 100 includes an input information acquisition unit 102 that acquires information input by the user from the input device 20, a compressed data division unit 104 that divides hierarchical data into image blocks, and a load block determination unit that determines an image block to be newly loaded.
- 106 includes a load unit 108 for loading necessary image blocks from the hard disk drive 50.
- the control unit 100 further includes a prefetch processing unit 110 that performs prefetch processing, a link determination unit 116 that determines whether data to be loaded or data to be decoded is included in the link destination hierarchical data, and decodes the compressed image data And a display image processing unit 114 for rendering a display image.
- the control unit 100 further includes a scenario interpretation unit 117 that interprets the set scenario information and controls the link determination unit 116, the load unit 108, and the display image processing unit 114.
- each element described as a functional block for performing various processes can be configured by a CPU (Central Processing Unit), a memory, and other LSIs in terms of hardware, and memory in terms of software. This is realized by a program loaded on the computer.
- the control unit 100 includes one PPU and a plurality of SPUs, and each functional block can be configured by the PPU and the SPU individually or in cooperation. Therefore, it is understood by those skilled in the art that these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof, and is not limited to any one.
- the hard disk drive 50 stores a plurality of hierarchical data 101 to which links are set.
- the main memory 60 stores a link setting file 118 in advance.
- the link setting file 118 is a file in which the set link information is recorded, and what is added to the hierarchical data 101 main body may be loaded from the hard disk drive 50.
- the scenario setting file 119 stored in the main memory 60 will be described later.
- the input information acquisition unit 102 acquires instruction information, such as start / end of image display, movement of a display area, enlargement / reduction of a display image, etc. input by the user to the input device 20.
- the input information acquisition unit 102 may further delay the image movement request signal based on a preset maximum value for moving the display image, a transfer function that performs a convolution operation with the image movement request signal, and the like.
- the transfer function may be a Gaussian function, for example.
- the image processing apparatus 10 uses this delay time to secure the time required for the prefetch processing of the image data, the time required for the reproduction of the linked image and the moving image, which will be described later, and the activation of the application. Thereby, smooth image display corresponding to a user's request
- the compressed data dividing unit 104 reads the hierarchical data from the hard disk drive 50, etc., divides it according to a predetermined rule, generates an image block, and stores it in the hard disk drive 50. For example, when the user selects any one of the hierarchical data stored in the hard disk drive 50 with respect to the input device 20, the information is acquired from the input information acquisition unit 102, and the division process is started. Alternatively, hierarchical data that is originally divided into image blocks may be stored in the hard disk drive 50. When such hierarchical data is to be displayed, the compressed data dividing unit 104 does not have to operate.
- the load block determination unit 106 confirms whether there is an image block to be newly loaded from the hard disk drive 50 to the main memory 60, determines the next image block to be loaded, and issues a load request to the load unit 108. At that time, the load block determination unit 106 inquires of the link determination unit 116 whether the image block to be loaded contains an image block of another hierarchical data to be linked. The load block determination unit 106 performs the above confirmation and determination processing at a predetermined time interval, for example, when the load unit 108 is not performing the load process, for example, when a user makes an image movement request. . The load unit 108 performs actual load processing in accordance with a request from the load block determination unit 106.
- the image block including the destination image area is not stored in the main memory 60
- the image block is loaded from the hard disk drive 50, the necessary area is decoded, and the display image is displayed. It is necessary to perform processing such as drawing at once. In this case, it is conceivable that the load process becomes a bottleneck, and the responsiveness to the user request is impaired.
- (1) image blocks are loaded so as to cover regions that are likely to be displayed in the future, and (2) loading is performed as needed so that the loading process is not concentrated at one time. Load under policy. As a result, the load process is less likely to interfere with the display image changing process.
- the prefetch processing unit 110 predicts an image area that will be required for drawing a display image in the future according to the frame coordinates of the current display image and the display image movement request information input by the user, and decodes the information. 112. However, immediately after the start of image display, or when the image to be changed cannot be drawn with the image already stored in the buffer memory 70, information on a predetermined area including an image necessary for drawing the display image at that time is not predicted. Is supplied to the decoding unit 112. In addition, the prefetch processing unit 110 inquires of the link determination unit 116 whether the predicted image region or the image region necessary for drawing the currently displayed image is included in another hierarchical data of the link destination.
- the link determination unit refers to the link setting file 118 stored in the main memory 60 in advance, and in response to an inquiry from the load block determination unit 106, whether the image block to be loaded includes the image block of the link destination hierarchical data. Determine whether or not. If included, the coordinates of the point to be loaded in the currently displayed hierarchical data are converted to the coordinates in the linked hierarchical data, and the load block is determined together with the coordinates before conversion and the file name of the linked hierarchical data Return to section 106. Further, in response to an inquiry from the prefetch processing unit 110, it is determined whether or not the area of the linked hierarchical data is included in the area necessary for drawing. If it is included, information related to the coordinates of the linked link area is returned. An example of setting a link will be shown later.
- the decoding unit 112 reads and decodes a part of the compressed image data from the main memory 60 based on the image area information acquired from the prefetch processing unit 110, and stores the decoded data in the decoding buffer or the display buffer.
- the display image processing unit 114 determines the frame coordinates of a new display image according to the display image movement request input by the user, reads the corresponding image data from the display buffer of the buffer memory 70, and the frame memory 90 of the display processing unit 44. To draw.
- the scenario interpretation unit 117 interprets the scenario setting file 119 stored in the main memory 60 and controls the display image in order to continuously guide the display image. Details will be described later.
- FIG. 10 shows the positional relationship between a reference frame and an image.
- the reference frame 264 for the image 156 is a rectangle having the same center as the center of the image 156 and circumscribing the image 156 and having a predetermined aspect ratio.
- the aspect ratio may be a predetermined value, for example, the same as the aspect ratio of the display to be displayed or the display area on the display. Even if the display image is enlarged or reduced, the frame always maintains the ratio.
- a frame is designated by four parameters of a horizontal direction offset, a vertical direction offset, an enlargement ratio, and a rotation angle.
- FIG. 11 is a diagram for explaining the definition of the frame when the reference frame is moved in parallel.
- values are assigned to the parameters of the vertical offset and the horizontal offset.
- the horizontal component offset_x and the vertical component offset_y of the distance from the center 272 of the frame to the center of the image 156, that is, the center 270 of the reference frame are values of the horizontal offset and the vertical offset. Therefore, the frame 262 is expressed as (offset_x, offset_y, 1.0, 0).
- FIG. 12 is a diagram for explaining the definition of the frame when the enlargement ratio is changed without moving the reference frame in parallel.
- the ratio of the frame 266 to the reference frame is substituted into the enlargement ratio parameter. If the frame 266 of FIG. 12 is 0.5 times the reference frame of FIG. 10, the frame 266 is expressed as (0, 0, 0.5, 0).
- FIG. 13 is a diagram illustrating the definition of a frame when the reference frame is rotated without being translated.
- the rotation angle 282 of the frame 280 from the reference frame is substituted into the rotation angle parameter.
- the frame 280 is expressed as (0, 0, 1.0, 0.25).
- any frame of the display image can be expressed by four parameters.
- these four parameter sets are referred to as “frame definition parameters”.
- FIG. 14 shows an example of the data structure of the link setting file 118.
- the link setting file 118 corresponds to one link, that is, a description of switching from one hierarchical data to another hierarchical data, and includes a link source image frame field 302, an effective scale range field 304, a link destination file field 306, and
- the link destination image frame field 308 is composed of four types of fields.
- the link source image frame field 302 designates the display image when the hierarchical data is switched in the image being displayed, that is, the frame of the link area by the above-described frame definition parameter.
- the frame corresponds to, for example, the frame of the link area 163 in the link indicated by the arrow B in FIG.
- the effective scale range field 304 designates the width of the enlargement ratio at which the link is effective, starting from the enlargement ratio in the link source image frame field 302.
- the enlargement ratio of the link area indicated in the link source image frame field 302 is “2.0”
- the value of the effective scale range field 304 is “98.0”. If the display image has a rate of 2.0 to 100.0, the link is valid and the hierarchical data is switched.
- the link indicated by the arrow B in FIG. 8 zooms out the display image, that is, increases the frame enlargement ratio from a frame smaller than the link area 163 of the image 158, and switches to the image 156 when it overlaps the link area 163. . Therefore, the value of the effective scale range field 304 is set to a positive value in order to make the link effective when the enlargement ratio becomes “2.0” or more. As a result, the link can be made effective even when the magnification is sufficiently increased in the display of the image 158 and then moved to the vicinity of the link area 163.
- the link indicated by the arrow A in FIG. 8 zooms in on the display image, that is, lowers the enlargement ratio of the frame from a frame larger than the link area 162 of the image 156 and switches to the image 158 when it overlaps the link area 162. . Therefore, as shown in the second row of FIG. 14, the effective scale range field 304 is set to a negative value such as “ ⁇ 1.0”.
- the link destination file field 306 designates the file name of the link destination hierarchical data. In the example of the link indicated by the arrow B in FIG. 8, this corresponds to the file name of the hierarchical data of the image 156.
- the link destination image frame field 308 specifies a frame definition parameter of a display image after switching of hierarchical data, that is, a frame of a link area of a link destination.
- a link setting file is created for each hierarchical data of the link source. That is, the link information of arrows A and C in FIG. 8 is described in the link setting file of the hierarchical data of the image 156, and the link information of arrow B is described in the link setting file of the hierarchical data of the image 158.
- Each file is stored in association with the corresponding hierarchical data. In this way, even if a link is set in both directions, the movement can be made independent.
- the link areas A and B in the transition of the arrow A and the link areas A and B in the transition of the arrow B can have different areas and resolutions.
- the link setting file is not added to the image 160, after transitioning to the image 160, the user can enjoy image display and the like.
- the link determination unit 116 in response to the inquiry from the prefetch processing unit 110, the area predicted by the prefetch processing is the link area set in the link setting file. Is included. If included, the file name of the link destination hierarchical data and the frame definition parameter of the link area of the link destination are returned.
- the prefetch processing unit 110 passes the information to the decoding unit 112 as in the case where the link area is not included.
- the decoding unit 112 reads the data of the link area of the link destination from the main memory 60 and decodes it.
- the link determination unit 116 confirms whether or not a point to be loaded is included in the link area in response to an inquiry from the load block determination unit 106. If included, the file name of the linked hierarchical data is returned. At this time, the coordinates in the link source image of the point to be loaded are converted into the coordinates in the link destination image, and the information is also returned.
- the load block determination unit 106 loads, from the hard disk drive 50 to the main memory 60, the image block including the coordinate-converted point in the hierarchical data of the link destination image.
- FIG. 15 schematically shows points to be loaded when links are set in two hierarchical data. It is desirable that the main memory 60 is basically loaded with compressed data of an image around the currently displayed display image.
- the “periphery” may include the periphery in the vertical and horizontal (X-axis, Y-axis) directions and the depth (Z-axis) direction of the hierarchical structure in an image of the same hierarchy.
- the periphery in the Z-axis direction means a display image and an enlarged image and a reduced image including the vicinity thereof.
- the two triangles represent the hierarchical data 184 and 186 as in FIG. 7.
- a link such as a line 188 is set in these hierarchical data 184 and 186.
- the current display image is a line 190, for example, an image block including points of white circles 192 and black circles 194 in the figure is loaded into the main memory 60.
- points within a predetermined range from the area of the current display image are determined as points to be loaded.
- the determination of the point to be loaded and the loading of the image block including the point may be performed as needed at predetermined time intervals.
- an image block is stored in the hard disk drive 50 in order to load data in a necessary area
- information that associates the image area of each image block with the image block storage area is also stored in the hard disk drive 50. deep.
- information in which the area on the image of each image block is associated with the storage area of the image block is stored in the main memory 60.
- the load block determination unit 106 periodically checks whether or not an image block including a point to be loaded is stored in the main memory 60, and if not, determines the image block as a load target.
- the linked data is loaded with priority over the data of the currently displayed hierarchical data 184. You may do it. Thereby, even if the transition to the link destination occurs immediately, a new image of the link destination can be displayed smoothly.
- FIG. 16 is a diagram for explaining a method of converting XY coordinates from a link source image to a link destination image.
- the link is set so that the link area 200 of the image 156 is switched to the link area 204 of the image 158, and the point 196 of the image 156 corresponds to the point 198 of the image 158.
- the coordinates of the point 196 are (Pa_x, Pa_y)
- the side length of the link area 200 is (La_sx, La_sy)
- the center coordinates of the area are (La_x, La_y)
- the coordinates of the point 198 are (Pb_x, Pb_y).
- the length of the side of the link area 204 is (Lb_sx, Lb_sy)
- the center coordinates of the area are (Lb_x, Lb_y).
- La_sx: (Pa_x ⁇ La_x) Lb_sx: (Pb_x ⁇ Lb_x) (Formula 1)
- La_sy: (Pa_y ⁇ La_y) Lb_sy: (Pb_y ⁇ Lb_y) (Formula 2) Therefore, the coordinates of the point 198 are obtained as follows.
- Pb_x (Lb_sx / La_sx) ⁇ (Pa_x ⁇ La_x) + Lb_x (Formula 3)
- Pb_y (Lb_sy / La_sy) ⁇ (Pa_y ⁇ La_y) + Lb_y (Formula 4)
- FIG. 17 is a diagram for explaining a Z coordinate conversion method from a link source image to a link destination image.
- the hierarchical data 184 and the hierarchical data 186 are linked in a line 208. That is, the position of the line 208 indicates the link area of the hierarchical data 184 and the link area of the hierarchical data 186.
- Np is the number of pixels of the lowest layer image, that is, the image with the highest resolution, in each hierarchical data included in the width of one pixel of the target resolution image. Therefore, the variable “lod” is an index representing the distance from the base in the triangle representing the hierarchical data, and has a common axis in the Z-axis direction that does not depend on the number of hierarchical levels included in each hierarchical data.
- the distance from the enlargement / reduction ratio of the link area represented by the line 208 to the enlargement / reduction ratio of the point to be converted does not depend on the hierarchical data.
- the load value of the link area is assumed to be when the area is displayed on the entire screen.
- the values of the link area load in both the hierarchical data 184 and 186 are La_lod and Lb_lod
- the lod value of the point 210 to be converted is Pa_lod and Pb_lod
- the coordinates of the point to be loaded in the hierarchical data of the currently displayed image can be replaced with the coordinates in the hierarchical data of the link destination.
- the obtained Pb_lod is not necessarily on the hierarchy having the image data in the hierarchy data 186, the data of the hierarchy closest to the position obtained from Pb_lod is actually loaded.
- the display image reaches a predetermined area and enlargement ratio in one image, the other image is displayed. That is, it is possible to further enlarge the object displayed by the other image, or to display completely different content, using the display image movement instruction input as a trigger.
- the number of hierarchical data to be displayed at the same time may be three or more, and the link may be set so as to circulate such that the original image is returned when the enlargement ratio is changed.
- a display such as returning to the original hierarchical data when sequentially expanding a plurality of hierarchical data to which links are set, or returning to a reduced image of the hierarchical data when enlarged with certain hierarchical data. it can. In the latter case, it is only necessary to specify the name of the file in the link destination file field of the link setting file.
- the following display can be performed using such a mechanism.
- 1. Continuous transition of images of the same object but with significantly different scales, such as shifting the display to Japan, prefectures, cities, towns, buildings, etc. by expanding the world map. 2.
- a display shifts to information display related to the icon such as a manual. 3. If you expand the cover from the cover list screen of the book, such as the back number of the magazine, the display shifts to the content display of the book.
- an object in the image such as a person's pupil
- the display shifts to the object or in the landscape, and when the image at the transition destination is reduced, an image different from the original image is displayed.
- migration is mapped to images of the same object but with significantly different scales, such as shifting the display to Japan, prefectures, cities, towns, buildings, etc. by expanding the world map. 2.
- an icon as an option displayed on a menu screen of an information processing device, a game device, or the like is enlarged, a display shifts to information display related to the icon such as
- video data may be set as a link destination.
- the link destination can be regarded as hierarchical data composed of moving picture data of one hierarchy.
- a link to moving image data is set in one area of a still image.
- the link setting file can use the data structure shown in FIG. In the link destination file field 306, the file name of the moving image file is designated.
- the link destination image frame field 308 may be invalidated when the resolution or display area of the moving image is fixed. In this way, the link is set, and when the display image is predicted to move to the link area of the image being displayed by the above-described prefetching process, encoding of the designated moving image file is started. Alternatively, only the encoding process may be continued regardless of the prediction.
- an application file may be designated in the link destination file field 306 of the link information, and the application may be activated when a certain area in the image is zoomed in.
- FIG. 18 shows an example of an image in which a link area is set.
- a link area such as link areas 352a, 352b, and 352c are set.
- link areas 352a, 352b, and 352c are set.
- the link area is limited as in the image 350, the movement of the display image may be guided in order to reduce the user's trouble of alignment. This function is effective when the display image is intentionally guided even when the link area is not limited.
- the frame definition parameters used in the above link information are used. That is, for each area to be guided (hereinafter referred to as a guiding area), a frame definition parameter represented by (horizontal offset, vertical offset, enlargement ratio, rotation angle) is created as a file in the same way as link information. .
- the file is stored as the scenario setting file 119 in the main memory 60 of FIG.
- the display area falls within a predetermined range in the virtual space with respect to the frame set in the scenario setting file, the display image is guided to the guidance area. This process can be realized by the same process as described above if an image movement request signal to the guidance area is virtually generated.
- the “predetermined range” is also defined in the scenario setting file using the frame definition parameter.
- the display image can be guided to the link area only by the user bringing the display image close to the vicinity of the link area 352a.
- the user can easily move to the set link destination, and the operability is improved.
- the movement of the display image in the virtual space is used as a trigger to move to another image that is a link destination, play a movie, start an application, and the like.
- the user's intention can be predicted in advance. Therefore, it is possible to speculatively execute decoding of another image data, decoding of moving image data, and application activation processing before actually switching the display to the link destination.
- the time required from an actual image switching instruction to output can be significantly reduced.
- FIG. 19 shows a state in which the display layer is shifted while guiding the display image in one layer data.
- hierarchical data 360 corresponds to an image 362.
- the guidance areas 374 and 376 represented by the lines 368 and 370 are set in the scenario setting file 119 by the above-described frame definition parameter, and the currently displayed area 372 corresponds to the line 366.
- the display image When the user enlarges the display image from the area 372 and the display image enters the predetermined range from the guidance area 374, the display image is guided to the guidance area 374 (arrow D). Further, when the display image enters a predetermined range from the guidance area 376, the display image is guided to the guidance area 376 (arrow E).
- This aspect can be used for various purposes depending on the content of the image to be displayed.
- the area that the user wants to enlarge is often limited.
- the display image is shifted when the desired area is enlarged, and it is sometimes difficult to search for the desired area with the enlargement ratio at that time.
- the area that is predicted to be enlarged in this embodiment is registered in the scenario setting file in advance, the user can move the display image to the area and input an enlargement instruction to accurately enlarge the area. can do.
- the display image is guided to the guide area not only when the display image is in the vicinity of the guide area, but, for example, when a predetermined button is pressed, the display image moves to the guide area regardless of the current position of the display image. Good.
- FIG. 20 shows how the display image is transferred when the guidance to a different hierarchy and the guidance to another area in the same hierarchy are combined.
- the area of the character that will be enlarged and read is set as a guidance area for each article.
- the guiding area 392 represented by the line 386 corresponds to this.
- a plurality of guidance areas are set so as to follow from the beginning to the end of the article in a lower layer, that is, a layer having a resolution that can read the characters. This corresponds to a guidance area 394 represented by a line 388 and a guidance area 396 represented by a line 390.
- the user first displays the area 382 of the entire page represented by the line 384, and then enlarges the display image closer to the desired article. Then, it is guided to the guide area 392 of the article (arrow F). Therefore, when the image is further enlarged, the information is guided to the guidance area 394 at the beginning of the article (arrow G).
- the user who has read the text in the guidance area 394 performs a direction instruction or an input to press a predetermined button, the user is guided to a guidance area 396 in which a subsequent text is described (arrow H).
- the display order is set together with the frame definition parameter.
- operation keys for instructing movement of the display area are also defined. For example, sentences written in columns such as newspaper articles need to be moved from right to left again after the display area is moved from right to left. In such a case, if the display area and the order are set in advance, the user does not need to search to which position the display image should be moved next in the enlarged image. Further, even if the movement is within the same hierarchy, it may be guided when the current display image enters a predetermined range of the guidance area as described above.
- 19 and 20 show the transition of the display image in one hierarchical data for the sake of simplicity. However, if a link to another hierarchical data is set during the transition, the other hierarchical data is naturally set.
- the display may be shifted to.
- the display image is guided when the user makes an image movement request including enlargement / reduction.
- a function of transferring a display image to a guide area registered in advance every predetermined time is further provided. In this case, the user only needs to input an instruction to execute such a mode. With this function, it is possible to provide a new expression technique close to a moving image using a material composed of still images, such as magazine sales promotion images and continuous browsing of photographs.
- the frame definition parameter, the display order, the display time of each image, and the like are created as the scenario setting file 119.
- the scenario setting file 119 may describe processing for controlling image migration more finely in a markup language such as XML.
- the scenario interpretation unit 117 reads out and interprets the description from the main memory 60, and controls the display image by appropriately making processing requests to the display image processing unit 114, the link determination unit 116, and the load unit 108.
- FIG. 21 is a flowchart showing the flow of processing described at this time.
- hierarchical data is designated (S20).
- the hierarchical data specified here may be one hierarchical data representing one image, or a group of a plurality of hierarchical data to which links are set.
- the image to be displayed is designated by the frame definition parameter (S22).
- effect processing for displaying the image is appropriately designated (S24). If another image is displayed before that, for example, a crossfade process is designated, or a process of enlarging the current image while gradually reducing the previous image is designated. Then, the time until the display shifts to the next image, and the complementary processing of the current image and the next image at that time are designated (S26).
- the “next image” may be, for example, an enlarged image or a reduced image of the current image, an image having a different hierarchy in the same hierarchical data, an image of a link destination, or an image in different hierarchical data.
- the image complementing method a method generally used in animation technology or the like when the current image and the next image are used as key frames can be applied.
- the processing from S20 to S26 is taken as a unit, and if there is an image that is to be continuously displayed with different hierarchical data, it is described so as to be repeated.
- the prefetch processing unit 110 reads the scenario setting file 119 described in this way, a virtual image movement request is generated in the same way as when the user inputs an image movement request, and the decoding unit 112 is requested to perform decoding processing.
- the number of layers of layer data used for image drawing may be specified separately from the frame definition parameter.
- (3) to (7) specify the hierarchical data used in the content.
- (8) designates the initial position of the image.
- (9) to (13) are hierarchical data images in which the first image to be used is displayed as an index, and designate the hierarchical data image to be displayed and its display position.
- (14) to (31) zooming is performed while the camera animation is applied to the hierarchical data image of the book cover, and the data is changed.
- (14) to (26) designate camera animation in key frame notation.
- an image of the hierarchical data to be displayed and its display position are designated, and a link is established using the display position.
- the image is switched to a hierarchical data image including a link to the moving image, and the moving image is shown in an up position.
- (32) to (35) have links to moving images as well as links to images of hierarchical data.
- (36) designates a drawing effect at the time of screen switching.
- (9) to (43) a copyright display image of a moving image is displayed during moving image display.
- (40) to (41) designate display of a normal image having no hierarchical structure.
- FIG. 22 schematically shows an example of a data distribution mode when realizing the present embodiment.
- servers 400, 402, and 404 are connected via a network 420.
- Each server may be a content producer's server or an information terminal of a general user. Further, a recording medium such as a CD-ROM or a DVD may be used instead of the server.
- the server 400 provides content including the hierarchical data 406a and the attribute file 408a added thereto.
- the attribute file 408a will be described later.
- the server 402 provides content to which hierarchical data 406b composed of a plurality of hierarchical data and link setting files 410b and 410c, scenario setting file 412b, and attribute file 408b in which the link information is set are added.
- the link setting files 410b and 410c are added for each hierarchical data as described above.
- the scenario setting file can be set across hierarchical data on the assumption of the link, the scenario setting file is added to the entire hierarchical data for which the link is set.
- the server 404 provides only the scenario setting file 412c.
- the data structure shown in the figure is merely an example.
- a scenario setting file may be added to single hierarchical data to which no link is set.
- the link setting file is not added to the scenario setting file. It may be added.
- the content held by the server 400 or the server 402 can be displayed by itself, but if included in the setting in the scenario setting file 412c of the server 404, the scenario setting file 412c and the hierarchy specified thereby By obtaining the data 406a and 406b, one content is generated. Therefore, any of the data structures shown in FIG. 22 can be a unit of distribution as one content.
- an attribute file is added to the hierarchical data.
- Information to be recorded in the attribute file includes, for example, information relating to the contents of the content, for example, basic information such as content name, author, publisher, sponsor, creation date, modification date, edition, description language, content and material data Right holders, information for returning charges, information for control during secondary use, ownership / copyright information such as expiration date, number of copies allowed, number of transfers, etc., ratings and the like.
- control attributes of the content for example, permission of connection and data use, encryption method, authentication control information such as signature, whether or not the usage fee is charged, whether an upper limit is set, whether it is free, whether it is virtual currency
- information related to billing such as payment method such as charge, debit or check method, operating environment such as platform, OS, recommended resources, access control information such as target user, valid area, country, etc. May be.
- attribute information area and hierarchical data area, content structure such as external reference link information, content name, representative image, billing information, thumbnail information indicating attribute summary, frame information storage location information, Such data structure information may be added.
- the attribute file is added to each of the hierarchical data in addition to the individual hierarchical data.
- FIG. 23 shows a configuration of an image processing apparatus having a content production support function in the present embodiment.
- the image processing apparatus 500 shown in the figure may actually have the same configuration as the image processing apparatus 10 shown in FIG. 4, but here only functional blocks provided for realizing the present embodiment are included.
- Show. 21 may be realized by the same processor as the control unit 100 shown in FIG. Or it is good also as a separate apparatus.
- the image processing apparatus 500 has any one or combination of functions described below. 1. 1. Accept the guidance area settings and generate and update the scenario setting file. 2. Accept link area settings and generate and update link setting files Accepts multiple image selections and generates an index image that can be selected by setting links
- the image processing apparatus 500 includes an input device 520, a control unit 502, a hard disk drive 550, and a main memory 560.
- the hard disk drive 550 stores existing hierarchical data 551. A link may be set between the hierarchical data.
- the input device 520 is an interface for the user to input the above-described function selection, image area selection, and various setting instructions, and may have the appearance configuration shown in FIG. 2, for example.
- the control unit 502 includes an input information acquisition unit 504, a setting image display unit 506, and a setting information registration unit 508.
- the input information acquisition unit 504 acquires information input to the input device 520 by the user, and appropriately makes a processing request to the setting image display unit 506 and the setting information registration unit 508 according to the content.
- the setting image display unit 506 reads the hierarchical data of the image selected by the user from the hard disk drive 550 and displays it when the user inputs that he / she wants to set a guidance area or a link area. Further, the display image is moved according to a screen movement request from the user, or a rectangle for designating an area is displayed in accordance with the position information of the pointer.
- the setting information registration unit 508 acquires the frame definition parameter of the area, and obtains the link setting file 562 or the scenario setting file 564. And stored in the main memory 560.
- the setting information registration unit 508 When the user selects a plurality of images, the setting information registration unit 508 also generates index image data 566 arranged in a predetermined format by appropriately selecting the resolution of the images, for example, as hierarchical data, and stores it in the main memory 560. Store. At this time, a link setting file 562 in which a link is set between the generated hierarchical data of the index image and the hierarchical data of individual images (hereinafter referred to as “individual images”) included therein is also generated at the same time. To store. As described above, the link setting file 562, the scenario setting file 564, and the index image data 566 are not only stored in the main memory 560 and used for image display, but also recorded on the hard disk drive 550 or another recording medium. Good. At this time, the content may be combined with the hierarchical data body to be set as one content.
- FIG. 24 is a diagram for explaining a procedure example of the process of receiving the guidance area setting and generating and updating the scenario setting file described in 1 above.
- the setting image display unit 506 that has obtained the information from the input information acquisition unit 504 reads the hierarchical data from the hard disk drive 550 and displays it.
- An image 570 in FIG. 24 represents the entire selected image.
- the user makes an image movement request to the input device 520 while confirming the display of the setting image display unit 506, and for example, after a region 572 to be set as a guidance region is displayed on the entire screen, a predetermined setting button is pressed. Press. Instead of this processing, a rectangle surrounding the area may be drawn by a pointer operation, and the setting button may be pressed.
- the setting information registration unit 508 acquires the frame definition parameter of the area and records it in the scenario setting file 564.
- the user selects another area 574 as necessary and presses the setting button.
- the setting information registration unit 508 adds the frame definition parameter of the area to the next line of the scenario setting file 564. By repeating this, all desired areas are recorded in the scenario setting file 564.
- the scenario setting file 564 generated in this way can sequentially display the areas to be displayed in the order of the areas 572, 574,.
- a markup language describing processing for controlling display such as display time of each region, animation processing for interpolating an image, effect processing, and the like may be generated.
- variations of image processing using sample images may be displayed in advance so that a user can select a desired process.
- the selected process is recorded in the scenario setting file 564 together with the frame definition parameter of the guidance area.
- FIG. 25 is a diagram for explaining a procedure example of the above-described processing of receiving the link area setting and generating and updating the link setting file.
- the setting image display unit 506 that has obtained the information from the input information acquisition unit 504 reads the hierarchical data from the hard disk drive 550 and displays it on two screens.
- An image 582 and an image 584 in FIG. 25 represent the selected image.
- the user makes an image movement request for the image 582 to the input device 520 while confirming the display of the setting image display unit 506, and displays an image including the region 586 to be set as the link region.
- a region is selected by drawing a rectangle surrounding the region by operating the pointer.
- the area 588 is selected for the image 584. Thereafter, a predetermined setting button is pressed.
- the setting information registration unit 508 acquires the frame definition parameters of the areas 586 and 588 and records them in the link setting file 562 with a data structure as shown in FIG. For example, a rule is set so that the link source image is displayed on the left side of the setting image display unit 506 and the link destination image is displayed on the right side of the setting image display unit 506, and the user selects whether the link is in the enlargement or reduction direction of the image. As a result, the information designated in the effective scale range field 304 and the link destination file field 306 is also acquired and recorded.
- the data used for image display is added to the hierarchical data of the image 584. It is possible to shift and display an image with a further enlargement ratio.
- the above example shows a case where a link is set between image data, but the link destination is not limited to an image, and may be data such as a movie, an application, sound, music, text, and the like.
- the link source image may be displayed as an image 582, and an icon representing data that can be a link destination may be displayed instead of the image 584 to allow the user to select.
- the file name of the data corresponding to the selected icon is recorded in the link destination file field 306 in the link setting file 562, and the link destination image frame field 308 may be invalid.
- the feature points of the objects displayed in each area are extracted and matched, so that the frame definition parameter is set so that the objects completely overlap in the two images. May be finely adjusted in the virtual space. Accordingly, it is possible to prevent the object from being shifted during the image transfer by the link, and the switching process from becoming clear. This process is effective not only when the objects of the two images are the same, but also when connecting the two images by cross-fading so that a certain object changes.
- one area is selected from each of the two images and links are set.
- the number of images may be three or more, and a plurality of link areas may be set in one image. Good. This case can also be realized by repeating the above processing.
- a dialog for allowing the user to input information such as where to display necessary information among the information is displayed. It may be.
- this information may also be recorded in the link setting file 562 and appropriately displayed when the display image is transferred to the link destination.
- FIG. 26 is a diagram for explaining a processing mode of generating an index image that accepts a plurality of image selections and can select these images after setting a link.
- the user selects hierarchical data of a plurality of individual images for which an index is to be generated with respect to the input device 520.
- the setting information registration unit 508 converts an index image in which an individual image having an appropriate resolution as an index, such as an image having the lowest resolution of the selected hierarchical data, for example, an image such as the image 350 shown in FIG. Data 566 is generated and stored in the main memory 560.
- areas 352a, 352b, 352c, etc. are individual images selected by the user.
- Hierarchical data 590 may be selected by the user. For example, if an image of a museum wall is selected as the hierarchical data 590 and an individual image is arranged within the frame of the wall, an image in which the individual image is decorated on the wall of the museum is generated. Information such as where the individual images are arranged in the index image and the size of each image may also be received from the user. In this case, the setting information registration unit 508 generates index image data in which the individual image is embedded at the position and size according to the user's designation.
- the setting information registration unit 508 further sets a link setting file 562 in which links to the hierarchical data 592a, 592b,..., 592n of the individual images are set at positions where the individual images are embedded in the generated hierarchical data 590 of the index image. And stored in the main memory 560.
- the index image data 566 and the link setting file 562 generated in this way are used to zoom in on an individual image in the index image, the display shifts to the hierarchical data 592a of the individual image, and a further enlargement ratio is obtained. You can display images and play videos.
- the index image data 566, the link setting file 562, and the hierarchical data of individual images may be stored in the hard disk drive 550 as one content.
- index image hierarchy data including all the individual image hierarchy data without setting a link between the individual image hierarchy data 592a and the index image hierarchy data 590.
- an index image in which a plurality of existing index images are embedded may be generated. The processing in this case can be similarly realized by making it possible to select an index image instead of an individual image.
- a link is set to the hierarchical data of two images, and the hierarchical data used for drawing the display image is transferred only by inputting parallel movement, enlargement, and reduction instructions.
- extra data such as a high-resolution image in a region that becomes meaningless when enlarged can be omitted, and the data size can be reduced.
- images with remarkably different scales such as a world map and a map around a building, as separate hierarchical data, it is possible to reset the numerical values for controlling the position of the display image for each hierarchical level. Easy to hold.
- a link is set to a completely different image such as a menu image and a manual for each icon on the menu, it is possible to realize mutual transition of images by only enlargement and reduction operations.
- Another image can be viewed with the location information in mind.
- a conventional method such as displaying a help screen, searching for a description that seems to be related to the icon display, and displaying the description in the help is displayed.
- the process to be performed is complicated, and the user's thinking is easily interrupted. As a result, you may eventually forget what you originally intended.
- the icon and the manual are directly connected, an intuitive grasp is possible and work efficiency is improved.
- the linked image is decoded in advance by prefetching it.
- the link destination is a moving image reproduction or application activation. That is, by performing the moving image reproduction and application activation in advance by the prefetching process, it is possible to output smoothly when the user actually gives an instruction to move to the link destination. This has the effect of significantly reducing the processing waiting time and reducing the user's stress as compared with the conventional method of starting by clicking an icon.
- images can be switched smoothly by performing appropriate image effect processing at the time of switching, such as by delaying the time from the input of the display image change request signal of the user to displaying the image by convolution calculation or crossfading. You can produce as if. As a result, it is possible to provide a new input tool that uses a moving operation of a display image regardless of whether it is a still image or a moving image, or not only an image but also music or text data.
- Link settings are made by defining the link area in the link source and link destination hierarchical data in the virtual space, so even a seemingly complex link structure can be set easily, and content can be easily accessed by general users. Can be produced.
- the display image can be guided to the area. For example, since the display image can be guided to the set link area only by aligning the display image, the image can be switched to the link destination in a short time.
- by creating a scenario setting file in which a plurality of portions to be shown in the image are recorded such portions can be continuously displayed, and effective contents for promotion and presentation can be produced.
- Hierarchical data with link settings and hierarchical data with guidance area settings such as scenario setting files created in this way can be distributed as a single package.
- attribute information such as information on contents, information on control, and data structure information is added for each unit.
- the link area and the guidance area can be selected after displaying the actual screen, and the link setting file and the scenario setting file are generated in a predetermined format by the selection.
- the user can easily perform setting after inflating the image while confirming the actual image.
- the position of the link area between the two images is finely adjusted by extracting feature points and matching processing. As a result, it is possible to make a continuous transition without causing a position shift or the like when switching images, and the viewer is less likely to notice the switching of images.
- an index image in which a plurality of individual images selected by the user are embedded is generated.
- a link setting file between the index image and the individual image is generated.
- the present invention can be used for information processing apparatuses such as computers, game machines, and image display apparatuses.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Controls And Circuits For Display Device (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
- Input From Keyboards Or The Like (AREA)
- Digital Computer Display Output (AREA)
- Editing Of Facsimile Originals (AREA)
Abstract
Description
システムが提案されている。この家庭用エンタテインメントシステムでは、GPUがポリ
ゴンを用いた三次元画像を生成する(例えば特許文献1参照)。
前記シナリオ設定ファイルを参照し、設定された表示方法で前記複数の領域を連続的に切り替えて表示する機能と、をコンピュータに実現させることを特徴とするコンピュータプログラムを記録する。
La_sy:(Pa_y-La_y)=Lb_sy:(Pb_y-Lb_y) (式2)
よってポイント198の座標は次のように求められる。
Pb_x=(Lb_sx/La_sx)×(Pa_x-La_x)+Lb_x (式3)
Pb_y=(Lb_sy/La_sy)×(Pa_y-La_y)+Lb_y (式4)
lod=log2Np
ここでNpは、対象となる解像度の画像の1画素の幅に含まれる、各階層データにおいて最も下層の画像、すなわち最も解像度の高い画像の画素数である。したがって変数lodは、階層データを表す三角形において底辺からの隔たりを表す指標であり、各階層データに含まれる階層の数などに依存しない、Z軸方向の共通の軸を有する。
Pa_lod-La_lod=Pb_lod-Lb_lod (式5)
したがって、
Pb_lod=Lb_lod+(Pa_lod-La_lod) (式6)
となる。
1.世界地図を拡大していくことにより、日本、県、市、町、建物へ表示を移行させるなど、同一の対象物であるがスケールが著しく異なる画像の連続移行
2.情報処理装置、ゲーム装置などのメニュー画面において表示された選択肢たるアイコンを拡大していくと、説明書など当該アイコンに関連する情報表示に移行
3.雑誌のバックナンバーなど書籍の表紙一覧画面からある表紙を拡大していくと、書籍の内容表示に移行
4.人物の瞳など画像中の対象物を拡大していくと、当該対象物の中や写っている風景などに表示が移行、移行先の画像を縮小していくと元の画像とは異なる画像へと移行
(1)<?xml version="1.0" encoding="utf-8"?>
(2)<Viewer>
(3) <FileList>
(4) <File name="INDEX"/>
(5) <File name="hyoshi"/>
(6) <File name="ichiran"/>
(7) </FileList>
(8) <InitCameraPosition x="-0.219" y="0.32" scale="0.28"/>
(9) <Section>
(10) <Event type="change" name="INDEX" wait="0.0">
(11) <CameraPosition x="-0.219" y="0.32" scale="0.28"/>
(12) </Event>
(13) </Section>
(14) <Section>
(15) <Event type="camera" name="camera1" wait="0.0">
(16) <Interpolator
(17) duration='4.0'
(18) type='linear'
(19) key='0 0.5 1.0'
(20) keyValue='
(21) -0.219 0.32 0.28
(22) -0.115955 0.29424 0.2
(23) -0.115955 0.29424 0.155553
(24) '/>
(25) </Event>
(26) </Section>
(27) <Section>
(28) <Event type="change" name="hyoshi" wait="0.0">
(29) <CameraPosition x="0.01257207987839" y="-0.00214762229374"
scale="0.94793879664622"/>
(30) </Event>
(31) </Section>
(32) <Section>
(33) <Event type="change" name="09france-ichiran" wait="2.0">
(34) <CameraPosition x="-0.007705" y="-0.008650" scale="0.508980"/>
(35) <VideoPosition name="video:sample.m2v" x="0.135605" y="-0.035605"
scale="0.061268"/>
(36) <Effect type="fade0"/>
(37) </Event>
(38) </Section>
(39) <Section>
(40) <Event type="image" name="tbs01.png" wait="0.0">
(41) <Position x="0.971875" y="-0.95" alpha="0.0" layer="1003"
cardinal="rightbottom"/>
(42) </Event>
(43) </Section>
(44) </Story>
(45)</Viewer>
1.誘導領域の設定を受け付け、シナリオ設定ファイルを生成、更新する
2.リンク領域の設定を受け付け、リンク設定ファイルを生成、更新する
3.複数の画像選択を受け付け、それらの画像を選択できるインデックス画像を、リンクを設定したうえで生成する
Claims (47)
- 画像の少なくとも一部をディスプレイに表示する画像処理装置であって、
一の画像で異なる解像度の画像データを解像度順に階層化して構成される階層データを保持する記憶装置と、
画像平面および解像度の軸によって定義される仮想空間において、前記階層データ内の領域を指定したシナリオ設定ファイルを保持するメモリと、
ユーザからの表示画像の変更に係る指示入力を受け付ける入力情報取得部と、
ユーザから所定の指示入力がなされた際、前記シナリオ設定ファイルにおいて指定された領域へ表示画像を誘導する表示画像処理部と、
を備えることを特徴とする画像処理装置。 - 前記入力情報取得部は、ディスプレイに表示されている表示画像の前記仮想空間における移動要求をユーザから受け付け、
前記表示画像処理部は、ユーザからの表示画像の移動要求の結果、前記領域の所定範囲内に表示画像が入ったとき、当該領域へ表示画像を誘導することを特徴とする請求項1に記載の画像処理装置。 - 前記シナリオ設定ファイルに設定される階層データ内の領域は、所定の縦横比率を有する矩形であることを特徴とする請求項1または2に記載の画像処理装置。
- 前記シナリオ設定ファイルで指定する領域は、同一の解像度の画像平面上の複数の領域を含むことを特徴とする請求項1から3のいずれかに記載の画像処理装置。
- 前記シナリオ設定ファイルで指定する領域は、同一階層データにおいて解像度の異なる画像の複数の領域を含むことを特徴とする請求項1から4のいずれかに記載の画像処理装置。
- 前記メモリは、前記仮想空間において異なる階層データ内の所定の領域を対応づけたリンク設定ファイルをさらに保持し、
前記シナリオ設定ファイルで指定する領域は、前記リンク設定ファイルで対応づけられた複数の階層データ内の複数の領域を含み、
前記リンク設定ファイルにおいて設定された、表示中の階層データにおける領域の所定範囲内に表示画像が入ったとき、当該領域に対応づけられた別の階層データの領域へ表示画像を切り替えることを特徴とする請求項1から5のいずれかに記載の画像処理装置。 - 前記シナリオ設定ファイルには、指定した複数の領域の表示順がさらに設定され、
前記表示画像処理部は、ユーザからの連続表示開始指示を前記入力情報取得部が受け付けると、前記シナリオ設定ファイルを参照し、指定された複数の領域を、設定された表示順に連続的に表示することを特徴とする請求項1に記載の画像処理装置。 - 前記入力情報取得部は、現在表示中の画像領域を前記シナリオ設定ファイルに登録する旨の指示をユーザよりさらに受け付け、
前記画像処理装置は、受け付けた領域を前記シナリオ設定ファイルに登録する設定情報登録部をさらに備えることを特徴とする請求項1に記載の画像処理装置。 - 画像の少なくとも一部をディスプレイに表示する画像処理方法であって、
記憶装置から画像データを読み出して表示装置に描画するステップと、
現在表示中の画像における表示領域の移動および拡大縮小を含む表示画像の移動要求をユーザより受け付けるステップと、
前記表示画像の移動要求に応じて、あらかじめメモリに設定された領域および解像度に表示画像を誘導するステップと、
を含むことを特徴とする画像処理方法。 - コンピュータに、画像の少なくとも一部をディスプレイに表示する機能を実現させるコンピュータプログラムであって、
記憶装置から画像データを読み出して表示装置に描画する機能と、
現在表示中の画像における表示領域の移動および拡大縮小を含む表示画像の移動要求、をユーザより受け付ける機能と、
前記表示画像の移動要求に応じて、あらかじめメモリに設定された領域および解像度に表示画像を誘導する機能と、
をコンピュータに実現させることを特徴とするコンピュータプログラム。 - コンピュータに、画像の少なくとも一部をディスプレイに表示する機能を実現させるコンピュータプログラムを記録した記録媒体であって、
記憶装置から画像データを読み出して表示装置に描画する機能と、
現在表示中の画像における表示領域の移動および拡大縮小を含む表示画像の移動要求、をユーザより受け付ける機能と、
前記表示画像の移動要求に応じて、あらかじめメモリに設定された領域および解像度に表示画像を誘導する機能と、
をコンピュータに実現させることを特徴とするコンピュータプログラムを記録した記録媒体。 - 画像の少なくとも一部をディスプレイに表示する画像処理装置であって、
一の画像で異なる解像度の画像データを解像度順に階層化して構成される階層データを保持する記憶装置と、
画像平面および解像度の軸によって定義される仮想空間において、異なる階層データ内の所定の領域を対応づけたリンク設定ファイルを保持するメモリと、
ディスプレイに表示されている表示画像の前記仮想空間における移動要求をユーザから受け付ける入力情報取得部と、
ユーザからの表示画像の移動要求の結果、前記リンク設定ファイルにおいて設定された、表示中の階層データにおける領域の所定範囲内に表示画像が入ったとき、当該領域に対応づけられた別の階層データの領域へ表示画像を切り替える表示画像処理部と、
を備えることを特徴とする画像処理装置。 - 前記リンク設定ファイルに設定される階層データ内の領域は、所定の縦横比率を有する矩形であることを特徴とする請求項12に記載の画像処理装置。
- 前記リンク設定ファイルは、対応付けられた領域の組ごとに、元の表示画像が拡縮いずれの方向に移動した場合に表示画像の切り替えを有効とするかを記録し、
前記表示画像処理部は、ユーザからの表示画像の移動要求に基づき、表示画像の切り替えが有効と判定された場合に表示画像を切り替えることを特徴とする請求項12または13に記載の画像処理装置。 - 前記入力情報取得部が受け付けたユーザからの表示画像移動要求に基づき、以後の表示画像の移動を予測する先読み処理部をさらに備え、
前記表示画像処理部は、前記リンク設定ファイルにおいて設定された、表示中の階層データにおける領域の所定範囲内に表示画像が入ることが前記先読み処理部によって予測されたとき、当該領域に対応付けられた別の階層データの領域のデコードを開始することを特徴とする請求項12または13に記載の画像処理装置。 - 前記記憶装置に保持された階層データは所定の規則で分割した画像ブロックで構成され、表示中の階層データのうち、表示画像から前記仮想空間において所定の距離にあるポイントを含む画像ブロックを、前記記憶装置から前記メモリにロードするロード部をさらに備え、
前記ポイントが、前記リンク設定ファイルにおいて設定された、表示中の階層データにおける領域の所定範囲内にあるとき、前記ロード部は、前記ポイントの座標を、当該領域に対応付けられた別の階層データの座標に変換したうえ、当該ポイントを含む前記別の階層データの画像ブロックをロードすることを特徴とする請求項12または13に記載の画像処理装置。 - 前記リンク設定ファイルに設定される階層データは、一の階層からなる動画像データを含むことを特徴とする請求項12に記載の画像処理装置。
- 前記記憶装置が保持する階層データは、当該階層データの視聴を制御するための属性情報が付加され、
前記表示画像処理部は、表示画像を切り替える際、対象となる階層データの前記属性情報を読み出し、当該情報に基づき所定の規則により表示態様を変化させることを特徴とする請求項12に記載の画像処理装置。 - 画像の少なくとも一部をディスプレイに表示する画像処理方法であって、
記憶装置から画像データを読み出して表示装置に描画するステップと、
現在表示中の画像における表示領域の移動および拡大縮小を含む表示画像の移動要求をユーザより受け付けるステップと、
表示画像があらかじめメモリに設定された領域および解像度に達したとき、当該設定において対応付けられた別の画像の所定の領域へ表示を切り替えるステップと、
を含むことを特徴とする画像処理方法。 - 前記別の画像の所定の領域は、動画像の表示領域を含むことを特徴とする請求項19に記載の画像処理方法。
- コンピュータに、画像の少なくとも一部をディスプレイに表示する機能を実現させるコンピュータプログラムであって、
記憶装置から画像データを読み出して表示装置に描画する機能と、
現在表示中の画像における表示領域の移動および拡大縮小を含む表示画像の移動要求をユーザより受け付ける機能と、
表示画像があらかじめメモリに設定された領域および解像度に達したとき、当該設定において対応付けられた別の画像の所定の領域へ表示を切り替える機能と、
をコンピュータに実現させることを特徴とするコンピュータプログラム。 - コンピュータに、画像の少なくとも一部をディスプレイに表示する機能を実現させるコンピュータプログラムを記録した記録媒体であって、
記憶装置から画像データを読み出して表示装置に描画する機能と、
現在表示中の画像における表示領域の移動および拡大縮小を含む表示画像の移動要求をユーザより受け付ける機能と、
表示画像があらかじめメモリに設定された領域および解像度に達したとき、当該設定において対応付けられた別の画像の所定の領域へ表示を切り替える機能と、
をコンピュータに実現させることを特徴とするコンピュータプログラムを記録した記録媒体。 - 一の画像で異なる解像度の画像データを解像度順に階層化して構成される階層データのうち複数の階層データ内の所定の領域を、画像平面および解像度の軸によって定義される仮想空間において対応づけ、画像表示時に階層データ間で切り替えを行うためのリンク設定ファイルと、
当該リンク設定ファイルによって対応づけられた前記複数の階層データと、
当該階層データの視聴を制御する属性情報と、
を対応づけたことを特徴とするコンテンツのデータ構造。 - 請求項23に記載のコンテンツのデータ構造を記録した記録媒体。
- 画像の少なくとも一部をディスプレイに表示する画像処理装置であって、
一の画像で異なる解像度の画像データを解像度順に階層化して構成される階層データを保持する記憶装置と、
少なくとも2つの前記階層データを対応づけるとともに、当該階層データ間の表示画像の切り替え条件を設定したリンク設定ファイルを保持するメモリと、
ある階層データの画像を表示している間に、表示画像が前記切り替え条件を満たすか否かを、前記リンク設定ファイルを参照して判定するリンク判定部と、
前記リンク判定部が前記切り替え条件を満たしていると判定した場合に、前記階層データに対応づけられた別の階層データの画像に表示画像を切り替える表示画像処理部と、
を備えることを特徴とする画像処理装置。 - ディスプレイに表示されている表示画像の領域移動および拡大縮小を含む移動要求をユーザから受け付ける入力情報取得部をさらに備え、
前記リンク判定部は、前記移動要求がなされた際に、当該移動要求の結果、表示された画像が前記切り替え条件を満たすか否かを判定することを特徴とする請求項25に記載の画像処理装置。 - 前記リンク設定ファイルにおいて、表示画像が所定の領域および解像度に達したときが前記表示画像の切り替え条件として設定されていることを特徴とする請求項26に記載の画像処理装置。
- 前記リンク設定ファイルにおいて対応付けられる階層データは動画データを含み、
前記表示画像処理部は、表示画像として動画を表示することを特徴とする請求項25に記載の画像処理装置。 - 表示中の階層データが動画データに対応付けられている場合に、前記リンク判定部による判定とは独立に、前記動画データのデコードを開始するデコード部をさらに備えることを特徴とする請求項28に記載の画像処理装置。
- 前記入力情報取得部が受け付けたユーザからの表示画像移動要求に基づき、以後の表示画像の移動を予測する先読み処理部をさらに備え、
表示中の階層データが前記リンク設定ファイルにおいて動画データに対応付けられている場合に、前記表示画像が前記切り替え条件を満たすことが前記先読み処理部によって予測されたとき、前記動画データのデコードを開始するデコード部をさらに備えることを特徴とする請求項26に記載の画像処理装置。 - 前記表示画像処理部は、表示画像を切り替える際、切り替え前の画像と切り替え後の画像との間でクロスフェード、ディゾルブ、ワイプ、ポリゴンメッシュを用いたページめくり状表現、から選択される一の効果を施すことを特徴とする請求項25に記載の画像処理装置。
- 画像の少なくとも一部をディスプレイに表示する画像処理方法であって、
メモリにおいてあらかじめ対応付けられた複数の画像データを処理対象として記憶装置から読み出すステップと、
前記複数の画像データのうち少なくとも一つを表示するステップと、
現在表示中の画像における表示領域の移動および拡大縮小を含む表示画像の移動要求をユーザより受け付けるステップと、
表示画像があらかじめメモリに設定された条件を満たしたとき、表示中の画像データに対応づけられた別の画像データへ表示を切り替えるステップと、
を含むことを特徴とする画像処理方法。 - コンピュータに、画像の少なくとも一部をディスプレイに表示する機能を実現させるコンピュータプログラムであって、
メモリにおいてあらかじめ対応付けられた複数の画像データを処理対象として記憶装置から読み出す機能と、
前記複数の画像データのうち少なくとも一つを表示する機能と、
現在表示中の画像における表示領域の移動および拡大縮小を含む表示画像の移動要求をユーザより受け付ける機能と、
表示画像があらかじめメモリに設定された条件を満たしたとき、表示中の画像データに対応づけられた別の画像データへ表示を切り替える機能と、
をコンピュータに実現させることを特徴とするコンピュータプログラム。 - コンピュータに、画像の少なくとも一部をディスプレイに表示する機能を実現させるコンピュータプログラムを記録した記録媒体であって、
メモリにおいてあらかじめ対応付けられた複数の画像データを処理対象として記憶装置から読み出す機能と、
前記複数の画像データのうち少なくとも一つを表示する機能と、
現在表示中の画像における表示領域の移動および拡大縮小を含む表示画像の移動要求をユーザより受け付ける機能と、
表示画像があらかじめメモリに設定された条件を満たしたとき、表示中の画像データに対応づけられた別の画像データへ表示を切り替える機能と、
をコンピュータに実現させることを特徴とするコンピュータプログラムを記録した記録媒体。 - ユーザより複数の個別画像を選択する入力を受け付ける入力情報取得部と、
選択された複数の個別画像を所定のフォーマットで配置したインデックス画像のデータを生成する設定情報登録部と、を備え、
前記複数の個別画像は、異なる解像度の画像データを解像度順に階層化して構成される階層データの構造をなし、
前記設定情報登録部は、前記インデックス画像において個別画像を配置した領域と、当該領域に配置された個別画像の階層データとを対応づけ、インデックス画像から個別画像へ、表示画像の描画に用いるデータの切り替えを行うためのリンク設定ファイルを生成してメモリに出力することを特徴とする情報処理装置。 - 前記設定情報登録部は、前記インデックス画像のデータを前記階層データとして生成することを特徴とする請求項35に記載の情報処理装置。
- 前記設定情報登録部は、あらかじめ生成された階層データの所定領域に前記個別画像を所定の解像度で埋め込むことにより、前記インデックス画像のデータを生成することを特徴とする請求項35に記載の情報処理装置。
- 前記個別画像は動画像を含むことを特徴とする請求項35に記載の情報処理装置。
- 前記設定情報登録部は、前記インデックス画像と、前記個別画像とからなる画像データに対し、複数の領域を選択する入力をユーザより受け付け、選択された複数の領域について、画像平面および解像度の軸によって定義される仮想空間における座標を特定して記録することにより、表示画像を当該複数の領域で切り替えるために参照されるシナリオ設定ファイルをさらに生成することを特徴とする請求項35に記載の情報処理装置。
- 前記インデックス画像のデータおよび前記個別画像のデータ、またはそれらの画像データの格納領域に係る情報と、前記リンク設定ファイルと、前記シナリオ設定ファイルと、を含むファイルをさらに生成することを特徴とする請求項39に記載の情報処理装置。
- 前記ファイルに階層データの視聴を制御する属性情報をさらに含ませることを特徴とする請求項40に記載の情報処理装置。
- 前記インデックス画像は、前記ファイルによって構成されるコンテンツを画像処理装置において視聴または処理する際の初期表示画面であることを特徴とする請求項40または41に記載の情報処理装置。
- ユーザより複数の個別画像を選択する入力を受け付けるステップと、
選択された複数の個別画像を記憶装置より読み出し、所定のフォーマットで配置したインデックス画像のデータを生成してメモリに出力するステップと、を含み、
前記複数の個別画像は、異なる解像度の画像データを解像度順に階層化して構成される階層データの構造をなし、
前記出力するステップは、前記インデックス画像において個別画像を配置した領域と、当該領域に配置された個別画像の階層データとを対応づけ、インデックス画像から個別画像へ、表示画像の描画に用いるデータの切り替えを行うためのリンク設定ファイルを生成してさらに出力することを特徴とする情報処理方法。 - ユーザより複数の個別画像を選択する入力を受け付ける機能と、
選択された複数の個別画像を記憶装置より読み出し、所定のフォーマットで配置したインデックス画像のデータを生成してメモリに出力する機能と、をコンピュータに実現させることを特徴とするコンピュータプログラムであって、
前記複数の個別画像は、異なる解像度の画像データを解像度順に階層化して構成される階層データの構造をなし、
前記出力する機能は、前記インデックス画像において個別画像を配置した領域と、当該領域に配置された個別画像の階層データとを対応づけ、インデックス画像から個別画像へ、表示画像の描画に用いるデータの切り替えを行うためのリンク設定ファイルを生成してさらに出力することを特徴とするコンピュータプログラム。 - ユーザより複数の個別画像を選択する入力を受け付ける機能と、
選択された複数の個別画像を記憶装置より読み出し、所定のフォーマットで配置したインデックス画像のデータを生成してメモリに出力する機能と、をコンピュータに実現させることを特徴とするコンピュータプログラムを記録した記録媒体であって、
前記複数の個別画像は、異なる解像度の画像データを解像度順に階層化して構成される階層データの構造をなし、
前記出力する機能は、前記インデックス画像において個別画像を配置した領域と、当該領域に配置された個別画像の階層データとを対応づけ、インデックス画像から個別画像へ、表示画像の描画に用いるデータの切り替えを行うためのリンク設定ファイルを生成してさらに出力することを特徴とするコンピュータプログラムを記録した記録媒体。 - 異なる解像度の画像データを解像度順に階層化して構成される階層データの構造を有する複数の個別画像のデータと、
前記個別画像を所定のフォーマットで配置したインデックス画像のデータと、
前記インデックス画像において個別画像を配置した領域と、当該領域に配置された個別画像の階層データとを対応づけ、インデックス画像から個別画像へ、表示画像の描画に用いるデータの切り替えを行うためのリンク設定ファイルと、
を対応づけたことを特徴とするコンテンツのデータ構造。 - 請求項46に記載のコンテンツのデータ構造を記録した記録媒体。
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2009801444115A CN102209951A (zh) | 2008-11-11 | 2009-09-08 | 图像处理装置、信息处理装置、图像处理方法、以及信息处理方法 |
KR1020137020473A KR101400935B1 (ko) | 2008-11-11 | 2009-09-08 | 화상 처리 장치, 정보 처리 장치, 화상 처리 방법, 및 정보 처리 방법 |
US13/127,598 US8917286B2 (en) | 2008-11-11 | 2009-09-08 | Image processing device, information processing device, image processing method, and information processing method |
RU2011123257/08A RU2509341C2 (ru) | 2008-11-11 | 2009-09-08 | Устройство обработки изображения и способ обработки изображения |
EP09825859.3A EP2360562B1 (en) | 2008-11-11 | 2009-09-08 | Image processing device, information processing device, image processing method, and information processing method |
Applications Claiming Priority (12)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2008-289312 | 2008-11-11 | ||
JP2008-289314 | 2008-11-11 | ||
JP2008-289313 | 2008-11-11 | ||
JP2008289312A JP5524469B2 (ja) | 2008-11-11 | 2008-11-11 | 画像処理装置および画像処理方法 |
JP2008-289315 | 2008-11-11 | ||
JP2008289314A JP5520470B2 (ja) | 2008-11-11 | 2008-11-11 | 画像処理装置および画像処理方法 |
JP2008289313A JP5520469B2 (ja) | 2008-11-11 | 2008-11-11 | 画像処理装置および画像処理方法 |
JP2008289315A JP5520471B2 (ja) | 2008-11-11 | 2008-11-11 | 画像処理装置および画像処理方法 |
JP2008289667A JP5520472B2 (ja) | 2008-11-12 | 2008-11-12 | 情報処理装置および情報処理方法 |
JP2008-289667 | 2008-11-12 | ||
JP2008289668A JP5520473B2 (ja) | 2008-11-12 | 2008-11-12 | 情報処理装置および情報処理方法 |
JP2008-289668 | 2008-11-12 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2010055604A1 true WO2010055604A1 (ja) | 2010-05-20 |
Family
ID=42169751
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2009/004441 WO2010055604A1 (ja) | 2008-11-11 | 2009-09-08 | 画像処理装置、情報処理装置、画像処理方法、および情報処理方法 |
Country Status (6)
Country | Link |
---|---|
US (1) | US8917286B2 (ja) |
EP (1) | EP2360562B1 (ja) |
KR (2) | KR20110087300A (ja) |
CN (2) | CN102209951A (ja) |
RU (1) | RU2509341C2 (ja) |
WO (1) | WO2010055604A1 (ja) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012035748A1 (ja) * | 2010-09-15 | 2012-03-22 | 株式会社ソニー・コンピュータエンタテインメント | 画像処理装置、コンテンツ作成装置、画像処理方法、およびコンテンツファイルのデータ構造 |
US20140247285A1 (en) * | 2011-07-04 | 2014-09-04 | Sony Computer Entertainment Inc. | Image display system, information processing device, server, and image processing method |
JP2015512546A (ja) * | 2012-04-06 | 2015-04-27 | ▲騰▼▲訊▼科技(深▲セン▼)有限公司 | インストールパッケージのウイルスチェック・除去方法および装置 |
Families Citing this family (41)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8874477B2 (en) | 2005-10-04 | 2014-10-28 | Steven Mark Hoffberg | Multifactorial optimization system and method |
CA2754672C (en) * | 2009-03-25 | 2017-11-21 | Sony Computer Entertainment Inc. | Information processing device and information processing method |
JP5116742B2 (ja) * | 2009-09-11 | 2013-01-09 | 株式会社ソニー・コンピュータエンタテインメント | 情報処理装置、情報処理方法、およびコンテンツファイルのデータ構造 |
US9235268B2 (en) * | 2010-04-09 | 2016-01-12 | Nokia Technologies Oy | Method and apparatus for generating a virtual interactive workspace |
US8898567B2 (en) | 2010-04-09 | 2014-11-25 | Nokia Corporation | Method and apparatus for generating a virtual interactive workspace |
JP2012048491A (ja) * | 2010-08-26 | 2012-03-08 | Nec Biglobe Ltd | 画像生成装置、画像生成方法、プログラムおよび記録媒体 |
US8909562B2 (en) | 2011-03-28 | 2014-12-09 | Google Inc. | Markov modeling of service usage patterns |
US20130060615A1 (en) * | 2011-09-06 | 2013-03-07 | Apple Inc. | Managing access to digital content items |
US20130063446A1 (en) * | 2011-09-10 | 2013-03-14 | Microsoft Corporation | Scenario Based Animation Library |
JP5851170B2 (ja) * | 2011-09-22 | 2016-02-03 | 株式会社ソニー・コンピュータエンタテインメント | 画像処理装置および画像処理方法 |
JP5713855B2 (ja) * | 2011-09-22 | 2015-05-07 | 株式会社ソニー・コンピュータエンタテインメント | 情報処理装置、情報処理方法、およびコンテンツファイルのデータ構造 |
US9043766B2 (en) * | 2011-12-16 | 2015-05-26 | Facebook, Inc. | Language translation using preprocessor macros |
JP5548671B2 (ja) * | 2011-12-27 | 2014-07-16 | 株式会社ソニー・コンピュータエンタテインメント | 画像処理システム、画像提供サーバ、情報処理装置、および画像処理方法 |
JP5966584B2 (ja) * | 2012-05-11 | 2016-08-10 | ソニー株式会社 | 表示制御装置、表示制御方法およびプログラム |
JP5975739B2 (ja) | 2012-06-01 | 2016-08-23 | 任天堂株式会社 | 情報処理プログラム、情報処理装置、情報処理システム、およびパノラマ動画表示方法 |
JP6124517B2 (ja) * | 2012-06-01 | 2017-05-10 | 任天堂株式会社 | 情報処理プログラム、情報処理装置、情報処理システム、およびパノラマ動画表示方法 |
JP6006536B2 (ja) | 2012-06-01 | 2016-10-12 | 任天堂株式会社 | 情報処理プログラム、情報処理装置、情報処理システム、およびパノラマ動画表示方法 |
EP2898697A4 (en) * | 2012-09-24 | 2016-10-19 | Qualcomm Inc | CODING DEPTH CARD |
TWI606418B (zh) * | 2012-09-28 | 2017-11-21 | 輝達公司 | 圖形處理單元驅動程式產生內插的圖框之電腦系統及方法 |
CN105474188B (zh) * | 2013-09-03 | 2019-08-13 | 飞力凯网路股份有限公司 | 信息处理设备和信息处理方法 |
CN104699250B (zh) * | 2015-03-31 | 2018-10-19 | 小米科技有限责任公司 | 显示控制方法及装置、电子设备 |
RU2632131C2 (ru) | 2015-08-28 | 2017-10-02 | Общество С Ограниченной Ответственностью "Яндекс" | Способ и устройство для создания рекомендуемого списка содержимого |
RU2632100C2 (ru) | 2015-09-28 | 2017-10-02 | Общество С Ограниченной Ответственностью "Яндекс" | Способ и сервер создания рекомендованного набора элементов |
RU2629638C2 (ru) | 2015-09-28 | 2017-08-30 | Общество С Ограниченной Ответственностью "Яндекс" | Способ и сервер создания рекомендуемого набора элементов для пользователя |
CN106730810B (zh) * | 2015-11-19 | 2020-02-18 | 网易(杭州)网络有限公司 | 一种移动智能终端的游戏按钮切换方法及装置 |
CN105491284B (zh) | 2015-11-30 | 2018-12-18 | 小米科技有限责任公司 | 预览图像的显示方法和装置 |
RU2632144C1 (ru) | 2016-05-12 | 2017-10-02 | Общество С Ограниченной Ответственностью "Яндекс" | Компьютерный способ создания интерфейса рекомендации контента |
RU2632132C1 (ru) | 2016-07-07 | 2017-10-02 | Общество С Ограниченной Ответственностью "Яндекс" | Способ и устройство для создания рекомендаций содержимого в системе рекомендаций |
RU2636702C1 (ru) | 2016-07-07 | 2017-11-27 | Общество С Ограниченной Ответственностью "Яндекс" | Способ и устройство для выбора сетевого ресурса в качестве источника содержимого для системы рекомендаций |
USD882600S1 (en) | 2017-01-13 | 2020-04-28 | Yandex Europe Ag | Display screen with graphical user interface |
RU2730435C1 (ru) | 2017-04-21 | 2020-08-21 | Зенимакс Медиа Инк. | Системы и способы рендеринга с адаптируемым качеством под управлением кодировщика |
JP7140515B2 (ja) * | 2018-03-08 | 2022-09-21 | 任天堂株式会社 | 情報処理装置、情報処理システム、情報処理プログラムおよび情報処理方法 |
US10636392B2 (en) * | 2018-05-02 | 2020-04-28 | Apple Inc. | Electronic display partial image frame update systems and methods |
RU2720952C2 (ru) | 2018-09-14 | 2020-05-15 | Общество С Ограниченной Ответственностью "Яндекс" | Способ и система для создания рекомендации цифрового содержимого |
RU2720899C2 (ru) | 2018-09-14 | 2020-05-14 | Общество С Ограниченной Ответственностью "Яндекс" | Способ и система для определения зависящих от пользователя пропорций содержимого для рекомендации |
RU2714594C1 (ru) | 2018-09-14 | 2020-02-18 | Общество С Ограниченной Ответственностью "Яндекс" | Способ и система определения параметра релевантность для элементов содержимого |
RU2725659C2 (ru) | 2018-10-08 | 2020-07-03 | Общество С Ограниченной Ответственностью "Яндекс" | Способ и система для оценивания данных о взаимодействиях пользователь-элемент |
RU2731335C2 (ru) | 2018-10-09 | 2020-09-01 | Общество С Ограниченной Ответственностью "Яндекс" | Способ и система для формирования рекомендаций цифрового контента |
RU2757406C1 (ru) | 2019-09-09 | 2021-10-15 | Общество С Ограниченной Ответственностью «Яндекс» | Способ и система для обеспечения уровня сервиса при рекламе элемента контента |
US11468224B2 (en) * | 2020-08-17 | 2022-10-11 | IT Cadre, LLC | Method for resizing elements of a document |
CN117576249B (zh) * | 2024-01-19 | 2024-04-02 | 弈芯科技(杭州)有限公司 | 一种芯片版图数据处理方法及装置 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000172248A (ja) * | 1998-09-28 | 2000-06-23 | Fujitsu Ltd | 電子情報表示方法、電子情報閲覧装置および電子情報閲覧プログラム記憶媒体 |
US6563999B1 (en) | 1997-03-27 | 2003-05-13 | Sony Computer Entertainment, Inc. | Method and apparatus for information processing in which image data is displayed during loading of program data, and a computer readable medium and authoring system therefor |
JP2003281187A (ja) * | 2002-03-20 | 2003-10-03 | Fujitsu Ltd | 仮想三次元情報閲覧方法、コンピュータプログラム及び記録媒体 |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0465756A (ja) | 1990-07-05 | 1992-03-02 | Hitachi Ltd | 文書の関連付け方法 |
US5793310A (en) * | 1994-02-04 | 1998-08-11 | Nissan Motor Co., Ltd. | Portable or vehicular navigating apparatus and method capable of displaying bird's eye view |
US6005679A (en) * | 1994-08-22 | 1999-12-21 | Fuji Photo Film Co., Ltd. | Image data filing system for quickly retrieving an area of interest of an image from a reduced amount of image data |
KR100317370B1 (ko) * | 1999-03-30 | 2001-12-22 | 구자홍 | 온스크린 디스플레이 메뉴를 이용한 영상표시기기의 레벨조절표시장치 및 방법 |
KR100405060B1 (ko) | 2000-08-24 | 2003-11-07 | 휴먼드림 주식회사 | 데이터 통신망을 통한 디지털 확대 이미지 제공방법,디지털 확대 이미지 제공장치 |
JP3732168B2 (ja) * | 2001-12-18 | 2006-01-05 | 株式会社ソニー・コンピュータエンタテインメント | 仮想世界におけるオブジェクトの表示装置、表示システム及び表示方法、ならびにそれらを利用可能な仮想世界における地価及び広告料の設定方法 |
JP4471337B2 (ja) * | 2002-08-01 | 2010-06-02 | キヤノン株式会社 | 画像処理装置及び方法、並びにコンピュータプログラム及びコンピュータ可読記憶媒体 |
JP4111268B2 (ja) * | 2002-12-13 | 2008-07-02 | 株式会社リコー | サムネイル画像の表示方法、サーバコンピュータ、クライアントコンピュータ及びプログラム |
US7075535B2 (en) * | 2003-03-05 | 2006-07-11 | Sand Codex | System and method for exact rendering in a zooming user interface |
JP4274887B2 (ja) | 2003-09-30 | 2009-06-10 | キヤノンマーケティングジャパン株式会社 | 情報処理装置および動画再生制御方法および制御プログラムおよび記録媒体 |
JP4366592B2 (ja) * | 2004-07-12 | 2009-11-18 | ソニー株式会社 | 電子機器、電子機器における表示制御方法およびグラフィッカル・ユーザ・インターフェース用プログラム |
JP5050371B2 (ja) | 2006-03-10 | 2012-10-17 | 日本電気株式会社 | 操作記録再現装置およびプログラム |
US7542994B2 (en) * | 2006-03-24 | 2009-06-02 | Scenera Technologies, Llc | Graphical user interface for rapid image categorization |
JP4050777B1 (ja) | 2007-04-06 | 2008-02-20 | 株式会社デジタルマックス | 画像表示システム |
-
2009
- 2009-09-08 US US13/127,598 patent/US8917286B2/en active Active
- 2009-09-08 EP EP09825859.3A patent/EP2360562B1/en active Active
- 2009-09-08 KR KR1020117011771A patent/KR20110087300A/ko active Application Filing
- 2009-09-08 CN CN2009801444115A patent/CN102209951A/zh active Pending
- 2009-09-08 KR KR1020137020473A patent/KR101400935B1/ko active IP Right Grant
- 2009-09-08 RU RU2011123257/08A patent/RU2509341C2/ru active
- 2009-09-08 CN CN201310534416.7A patent/CN103605452B/zh active Active
- 2009-09-08 WO PCT/JP2009/004441 patent/WO2010055604A1/ja active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6563999B1 (en) | 1997-03-27 | 2003-05-13 | Sony Computer Entertainment, Inc. | Method and apparatus for information processing in which image data is displayed during loading of program data, and a computer readable medium and authoring system therefor |
JP2000172248A (ja) * | 1998-09-28 | 2000-06-23 | Fujitsu Ltd | 電子情報表示方法、電子情報閲覧装置および電子情報閲覧プログラム記憶媒体 |
JP2003281187A (ja) * | 2002-03-20 | 2003-10-03 | Fujitsu Ltd | 仮想三次元情報閲覧方法、コンピュータプログラム及び記録媒体 |
Non-Patent Citations (1)
Title |
---|
See also references of EP2360562A4 * |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012035748A1 (ja) * | 2010-09-15 | 2012-03-22 | 株式会社ソニー・コンピュータエンタテインメント | 画像処理装置、コンテンツ作成装置、画像処理方法、およびコンテンツファイルのデータ構造 |
JP2012063940A (ja) * | 2010-09-15 | 2012-03-29 | Sony Computer Entertainment Inc | 画像処理装置、コンテンツ作成装置、画像処理方法、およびコンテンツファイルのデータ構造 |
US9218111B2 (en) | 2010-09-15 | 2015-12-22 | Sony Corporation | Image processing device for displaying content, content creation device, and image processing method |
US20140247285A1 (en) * | 2011-07-04 | 2014-09-04 | Sony Computer Entertainment Inc. | Image display system, information processing device, server, and image processing method |
US9460486B2 (en) * | 2011-07-04 | 2016-10-04 | Sony Corporation | Image display system, information processing device, server, and image processing method |
JP2015512546A (ja) * | 2012-04-06 | 2015-04-27 | ▲騰▼▲訊▼科技(深▲セン▼)有限公司 | インストールパッケージのウイルスチェック・除去方法および装置 |
Also Published As
Publication number | Publication date |
---|---|
EP2360562A1 (en) | 2011-08-24 |
CN102209951A (zh) | 2011-10-05 |
EP2360562A4 (en) | 2013-12-25 |
RU2509341C2 (ru) | 2014-03-10 |
CN103605452B (zh) | 2018-04-17 |
CN103605452A (zh) | 2014-02-26 |
KR20130094861A (ko) | 2013-08-26 |
KR20110087300A (ko) | 2011-08-02 |
US8917286B2 (en) | 2014-12-23 |
RU2011123257A (ru) | 2012-12-20 |
US20110273470A1 (en) | 2011-11-10 |
EP2360562B1 (en) | 2015-04-08 |
KR101400935B1 (ko) | 2014-06-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2010055604A1 (ja) | 画像処理装置、情報処理装置、画像処理方法、および情報処理方法 | |
WO2012011215A1 (ja) | 画像処理装置、画像表示装置、画像処理方法、および画像ファイルのデータ構造 | |
JP6073664B2 (ja) | コンテンツ再生装置及びコンテンツ再生プログラム | |
JP5520469B2 (ja) | 画像処理装置および画像処理方法 | |
JP5520473B2 (ja) | 情報処理装置および情報処理方法 | |
JP5467123B2 (ja) | 情報処理装置および情報処理方法 | |
JP5520472B2 (ja) | 情報処理装置および情報処理方法 | |
JP5920673B2 (ja) | 画像処理装置および画像処理方法 | |
JP5520471B2 (ja) | 画像処理装置および画像処理方法 | |
US8972877B2 (en) | Information processing device for displaying control panel image and information image on a display | |
JP5524469B2 (ja) | 画像処理装置および画像処理方法 | |
JP5520470B2 (ja) | 画像処理装置および画像処理方法 | |
JP5992729B2 (ja) | 情報処理装置および情報処理方法 | |
KR101825598B1 (ko) | 컨텐츠 제공 방법을 실행하기 위하여 기록 매체에 저장된 컴퓨터 프로그램, 방법 및 장치 | |
TW201325674A (zh) | 產生遊戲事件效果之方法、工具,與電腦可讀記錄媒體 | |
JP2009129224A (ja) | 画像操作装置と画像操作プログラムと記録媒体と画像操作方法 | |
JP5292149B2 (ja) | 情報処理装置および情報処理方法 | |
JP5419783B2 (ja) | 画像再生装置及び画像再生装置の制御方法 | |
JP2008129863A (ja) | コンテンツ配信システム及びコンテンツ配信方法 | |
JP2007011055A (ja) | 画像表示装置及び画像表示方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200980144411.5 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09825859 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1900/KOLNP/2011 Country of ref document: IN |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 20117011771 Country of ref document: KR Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2009825859 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2011123257 Country of ref document: RU |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13127598 Country of ref document: US |