JP2004326555A - Image/video processing displaying method and apparatus, as well as image/video processing displaying program and storage medium storing same program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable viewer's recognition of an important portion while grasping the whole effectively as much as possible when displayed compactedly on a small screen in a portable terminal or a PDA. <P>SOLUTION: Image information is displayed by superimposing the important portion on the top where the whole is simply reduced, with display magnification larger than total display magnification, when some important portions in images are clear. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an image / video processing display method and apparatus, an image / video processing display program, and a storage medium storing the image / video processing display program, and in particular, to an image / video for electronically displaying a still image or video. The present invention relates to a video processing display method and apparatus, an image / video processing display program, and a storage medium storing the image / video processing display program.
[0002]
[Prior art]
2. Description of the Related Art Small display terminals such as mobile terminals and PDAs have become widespread, and there are many opportunities to display images and videos for viewing on a large screen size on a small screen. When an image or video originally created assuming a large screen is processed and distributed so that it can be displayed on a smaller screen for automatic image processing, the image or video is simply reduced to the desired size and displayed. Is the mainstream of the automatic processing currently being performed. The reduction algorithm includes, for example, existing geometric transformation methods such as a nearest neighbor method, a bilinear interpolation method, and a cubic interpolation method (for example, see Non-Patent Document 1).
[0003]
In addition, when a road portion or a character portion on a map image is detected by using an edge detection technology or the like, and the portion is visually disappeared when the map image is reduced, the image is not visually uncomfortable. There are interpolation methods and the like.
[0004]
As another display method, the importance automatically generated from only physical information such as a luminance difference amount using metadata previously described in image information / video information or image processing technology such as moving object tracking. There is a method in which an image or a specific portion (object) in an image is cut out and displayed with reference to the information.
[0005]
[Non-patent document 1]
Morio Onoe: Image Processing Handbook, Shokodo (1987), pp 273-276
[0006]
[Problems to be solved by the invention]
However, in the image simply reduced by the above-described geometric conversion method, when the object shown in the original image is not large, the object is reduced and displayed small, so that the object can be visually recognized in the original image. It is highly possible that the information of the object concerned can not be grasped by the reduced display. Also, in an image in which only the object is cut out and displayed instead of reducing the entire image, the object can be recognized to the same degree as when browsing the original image, but it is difficult to grasp the appearance of the entire image. is there.
[0007]
Of course, it is possible to manually re-edit the image content for a small screen in an easy-to-view manner, but for all terminals of any size, re-editing the content one by one requires various terminals. It is not realistic these days.
[0008]
The present invention has been made in view of the above points, and provides an image / video processing and displaying method that enables a viewer to enjoy important parts while grasping the entire image information as effectively as possible. It is an object of the present invention to provide an apparatus, an image / video processing display program, and a storage medium storing the image / video processing display program.
[0009]
[Means for Solving the Problems]
FIG. 1 is a diagram for explaining the principle of the present invention.
[0010]
The present invention relates to an image / video processing and display method for reducing and displaying electronic image data created assuming a certain screen size on a screen smaller than the assumed size,
When specific information for one or more objects or regions in the image data is set in the characteristic region information storage unit,
Based on the screen size obtained from the device to be output, data is generated by simply reducing the size of the image data (step 1),
Based on the screen size and the information stored in the characteristic region information storage unit, a part of the image data stored in the image information storage unit is cut out and processed (step 2).
A part of the processed image data is combined with the data simply reduced in size (step 3),
The combined data is output to the output target device (step 4).
[0011]
Further, according to the present invention, when characteristic information is set for a plurality of objects and regions in the characteristic region information storage means, and the degree of information representing those characteristics is determined, the display magnification of the overlapping object or region is changed. In accordance with the priority, it is changed for each object or each area, and the priority of the information amount is made to correspond to the ratio of the specific portion to the entire display.
[0012]
Further, the present invention decomposes the video data into each frame image data,
When at least one important object and its importance are given to each frame image data, the image data is set so that the important object becomes relatively large for each of the frame image data. Generate
Combining the generated image data so as to correspond to the time series in the video data,
Display the combined image data.
[0013]
FIG. 2 is a diagram illustrating the principle of the present invention.
[0014]
The present invention is an image / video processing and display apparatus for reducing electronic image data created assuming a certain screen size on a screen smaller than the assumed size,
Video information storage means 102 in which video data is stored;
A feature area information storage unit 103 that stores specific information on one or more objects or areas in the image data;
A reduced image editing unit 105 that generates data in which image data is simply reduced in size based on a screen size acquired from a device to be output;
A region image editing unit 106 that cuts out and processes a part of the image data stored in the video information storage unit based on the screen size and the information stored in the characteristic region information storage unit;
Image synthesizing means 107 for synthesizing a part of the processed image data and data simply reduced in size;
And output means 108 for outputting the synthesized data to a device to be output.
[0015]
Further, the characteristic region information storage means 103 of the present invention
It has characteristic information on a plurality of objects and regions, and the characteristic information includes superiority and inferiority in the amount of information representing the characteristic,
The area image editing means 106
By referring to the information in the characteristic region information storage means 103, the display magnification of the object or region to be overlapped is changed for each object or region according to the priority, and the priority of the information amount is made to correspond to the ratio of the specific portion to the entire display. Including means.
[0016]
Further, the area image editing means 106 of the present invention
Means for decomposing the video data into each frame image data,
When at least one important object and its importance are given to each frame image data, the image data is set so that the important object becomes relatively large for each of the frame image data. Means for generating, having
The image combining means 107
Means for combining the image data generated by the area image editing means 106 so as to correspond to the time series in the video data,
The output means 108
Means for displaying the combined image data.
[0017]
The present invention is an image / video processing display program for displaying electronic image data created assuming a certain screen size on a screen smaller in size than the assumed size,
A reduced image editing step of generating data in which image data is simply reduced in size based on the screen size acquired from the output target device;
One of the image data stored in the video information storage means is determined based on the screen size and the information stored in the characteristic area information storage means for storing specific information for one or more objects or areas in the image data. An area image editing step of cutting out and processing a part;
An image synthesizing step of synthesizing a part of the processed image data and the data simply reduced in size,
An output step of outputting the synthesized data to the output target device,
Consisting of a computer.
[0018]
Also, the area image editing step of the present invention,
A plurality of objects and regions have characteristic information, and the characteristic information refers to information in a characteristic region information storage unit that includes information on the degree of information representing the characteristics, and determines the display magnification of the overlapping object or region. In accordance with the priority, the method includes a step of changing the object or the area for each of the objects, and associating the priority of the information amount with the ratio of the specific portion to the entire display.
[0019]
Also, the area image editing step of the present invention,
Decomposing the video data into each frame image data;
When at least one important object and its importance are given to each frame image data, the image data is set so that the important object becomes relatively large for each of the frame image data. Generating, having
The image synthesis step
Coupling the image data generated in the region image editing step so as to correspond to a time series in the video data,
The output step is
Displaying the combined image data.
[0020]
The present invention is a storage medium storing an image / video processing display program for reducing electronic image data created assuming a certain screen size to a screen smaller than the assumed size,
A reduced image editing step of generating data in which the image data is simply reduced in size based on the screen size obtained from the output target device;
Based on the screen size and the information stored in the characteristic region information storage unit that stores specific information for one or more objects or regions in the image data, the image data stored in the video information storage unit is An area image editing step of cutting out and processing a part,
An image synthesizing step of synthesizing a part of the processed image data and the data simply reduced in size,
An output step of outputting the synthesized data to the output target device,
And stores a program to be executed by a computer.
[0021]
Further, the area image editing step of the storage medium storing the image / video processing display program of the present invention,
A plurality of objects and regions have characteristic information, and the characteristic information refers to information in a characteristic region information storage unit that includes information on the degree of information representing the characteristics, and determines the display magnification of the overlapping object or region. In accordance with the priority, the method includes a step of changing the object or the area for each of the objects, and associating the priority of the information amount with the ratio of the specific portion to the entire display.
[0022]
Further, the area image editing step of the storage medium storing the image / video processing display program of the present invention,
Decomposing the video data into each frame image data;
When at least one important object and its importance are given to each frame image data, the image data is set so that the important object becomes relatively large for each of the frame image data. Generating, having
The image synthesis step
Coupling the image data generated in the region image editing step so as to correspond to a time series in the video data,
The output step is
Displaying the combined image data.
[0023]
As described above, when some important points in the image are known together with the image information, the entire area is simply reduced and displayed, and the important points are overlapped and displayed at a display magnification larger than the entire display magnification. This allows the viewer to enjoy the important parts while grasping the whole as effectively as possible.
[0024]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[0025]
FIG. 3 shows a configuration of an image / video processing and display device according to an embodiment of the present invention. The image / video processing and display device shown in FIG. 1 includes an information storage unit 101 and an output control unit 104.
[0026]
The information storage unit 101 includes a video information storage unit 102 that stores image data, and a characteristic region information storage unit 103 that stores characteristic information set for objects and regions.
[0027]
The output control unit 104 is stored in the reduced image editing unit 105 that generates data obtained by simply reducing the size of image data based on the screen size obtained from the screen size of the output device 109, and is stored in the image size and characteristic region information storage unit 103. Region image editing unit 106 that cuts out and processes a part of the image data stored in the image information storage unit 102 based on the extracted information, the image data generated by the reduced image editing unit 105 and the image data generated by the region image editing unit 106 An image synthesizing unit 107 that synthesizes the obtained image data, and an output unit 108 that outputs the image data synthesized by the image synthesizing unit 107 to the output device 109 and displays the image as an image.
[0028]
The operation in the above configuration will be specifically described below.
[0029]
In the following, a description will be given assuming that the assumed screen size of the image content is H_in, the width is W_in, the width of the output device 109 for reducing display according to the present invention is H_out, and the width is W_out.
[0030]
Now, it is assumed that the positions and sizes of N important objects (hereinafter, referred to as symbols O_i (i = 1, 2,..., N)) existing in the image are stored in the characteristic region information storage unit 103. Here, for simplicity of processing, the existence region of O_i is treated as a rectangle, the center coordinates of the existence region of O_i are (C_x (O_i), C_y (O_i)), the vertical length is H (O_i), and the horizontal length is W ( O_i). Further, it is assumed that a unique feature information amount (hereinafter referred to as “importance”) μ (O_i) is assigned to each object O_i. Examples of important objects include, for example, a player or a ball (or a rectangular area surrounding each of them) in a photograph of a sports game, an intruder in a photograph in which a surveillance camera photographs an abnormal intruder, or , A rectangular area surrounding each of them).
[0031]
The generation process of the display image data will be described.
[0032]
FIG. 4 is a flowchart of the display image data generation process according to the first embodiment of the present invention.
[0033]
First, the reduced image editing unit 105 prepares image data in which the entire image data is simply reduced to the output screen size, and sets it to A (step 101). At this time, when the aspect ratio of the original image is different from the aspect ratio of the display screen size, it is desirable to generate a margin or the like and perform interpolation. Of course, in some cases, the image obtained by reducing the image while changing the aspect ratio may be used as A.
[0034]
Next, for each i = 1,..., N (step 102), the display magnification of the object O_i is determined (step 103), and the image data B_i obtained by reducing the O_i is generated. Here, as in the method of generating the image A, the aspect ratio of each object is considered in the direction of saving. Of course, in some cases, the aspect ratio may be changed. Hereinafter, the expression “display magnification” indicates the value of “vertical length after reduction / vertical length of original image”.
[0035]
A basic value P_i for determining the display magnification is given by, for example, the following formula.
[0036]
P_i = Min (Max (1, α ^* (μ (O_i) / (Max_ {j = 1,... N})
μ (O_j))) ^* (H_out / H_in)), H_out / H (O_i), W (O_i))
Here, α is a constant determined in advance for each process, and α> 1.
[0037]
An image obtained by reducing the size of O_i is written in the area of center coordinates (C_x (O_i), C_y (O_i)), portrait H (O_i) ^* P_i, landscape W (O_i) ^* P_i, and the other parts are “transparent parts”. And It is assumed that a vertically long image H_out and a horizontally long image W_out are B_i.
[0038]
FIG. 5 shows a specific example for explaining the above calculation formula. The assumed display size of the original image is 1024 pixels wide × 768 pixels high, the screen size of the display destination is 256 pixels wide × 192 pixels high, α in the above formula for calculating P_i is α = 3, and object O_i is shown in FIG. Only the five shown in the table were used, and the vertical length and importance of each were as shown in the table.
[0039]
Each of the objects O_i is relatively equal in size or larger than the whole reduced object. In addition, the larger the importance of the object, the larger the value of P_i. The larger the importance of the object, the larger the size of the object. The calculation formula for calculating P_i is an example, and other calculation formulas for calculating P_i may be used as long as the calculation effects can obtain the above-described effects.
[0040]
Note that with only the above formula, when O_i is biased toward the edge of the screen, when generating B_i, the reduced image of O_i may be out of the range of B_i. Therefore, in such a case, the center coordinates of the area in which the reduced image is drawn are corrected by performing a minimum slide process until the area falls within the range of B_i. For example, if C_y (O_i) <H (O_i) ^* P_i / 2 as a result of the above processing, the center coordinates of the area in which the reduced image is drawn are corrected by performing the minimum slide processing until the area falls within the range of B_i. (Step 104). For example, if C_y (O_i) <H (O_i) ^* P_i / 2 by the above processing, the reduced image drawn as it is is H (O_i) ^* P_i / 2-C_y (O_i) from the upper end of B_i. Since it protrudes, the y coordinate of the center of the area to be drawn is C_y (O_i) + H (O_i) ^* P_i / 2-C (O_i).
[0041]
By performing the above processing for i = 1,..., N, reduced images B_1,..., B_N corresponding to the objects O_i,. The image combining unit 107 combines these with A to generate image data after reduced display. Specifically, for example, B_i, etc. are overwritten on A of the image data with pixels of a portion excluding the transparent portion of the image. In the order of overwriting B_i, the reduced image portion of the object having a large value of μ (O_i) is more likely to remain as the final display image.
[0042]
[Second embodiment]
Next, a case where a processed image data sequence is generated for video data using the processing of the first embodiment described above, and the processed images are joined in a time series and displayed as a video explain.
[0043]
Generally, video data is an aggregate in which frame image data is arranged in time series. Now, it is assumed that one or more important objects and their importance are given to these frame image data.
[0044]
The video data is decomposed into frame image data, and image data is generated for each of the frame image data by using the method in the above-described first embodiment so that the important object becomes relatively large. Then, these image data are combined so as to correspond to the time series of the original video data, and are combined into video data and displayed.
[0045]
Actually, the disassembling process and the combining process are not essential. For example, when outputting, an implementation form in which processing and display are performed in real time is also possible.
[0046]
In the first and second embodiments, the video information storage unit 102 and the characteristic region information storage unit 103 are configured by a storage device such as a database, and the reduced image editing unit 105, the region image The operations of the editing unit 106, the image synthesizing unit 107, and the output unit 108 are constructed as programs, installed in a computer used as an image / video processing display device, and executed by a control unit such as a CPU, or via a network. It is also possible to distribute.
[0047]
Further, the constructed program is stored in a hard disk device connected to a computer used as an image / video processing display device, or in a portable storage medium such as a flexible disk or a CD-ROM, and is installed in the computer at the time of execution. , Can be executed by control means such as a CPU.
[0048]
It should be noted that the present invention is not limited to the above embodiment, and various changes and applications are possible within the scope of the claims.
[0049]
【The invention's effect】
FIG. 6 is a diagram for explaining the effect of the reduced display method of the present invention. In the figure, it is assumed that objects O_1, O_2, and O_3 are designated with respect to an original image 401 like an object description image 402, and the importance levels are 100, 50, and 20, respectively. An image sequence 403 displayed simply reduced and an image sequence 404 reduced and displayed by the method of the present invention are shown side by side. Compared to the simple reduced display, in the method of the present invention, the shape of the object can be determined in detail, and the relative positions of the object and the surroundings are preserved to the maximum. Therefore, the viewer can enjoy the entire situation and the detailed visual information of the important object at the same time.
[Brief description of the drawings]
FIG. 1 is a diagram for explaining the principle of the present invention.
FIG. 2 is a principle configuration diagram of the present invention.
FIG. 3 is a configuration diagram of an image / video processing and display device according to the first embodiment of the present invention.
FIG. 4 is a flowchart of display image data generation processing according to the first embodiment of the present invention.
FIG. 5 is a diagram for explaining a calculation formula for obtaining a basic value P_i according to the first embodiment of the present invention.
FIG. 6 is a diagram for explaining the effect of the reduced display method of the present invention.
[Explanation of symbols]
101 information storage unit 102 video information storage unit, video information storage unit 103 feature area information storage unit, feature area information storage unit 104 output control unit 105 reduced image editing unit, reduced image editing unit 106 area image editing unit, area image editing unit 107 image synthesizing unit, image synthesizing unit 108 output unit, output unit 109 output device 401 original image 402 object description image 403 simple reduced image example 404 image according to the present invention

Claims (12)

In an image / video processing display method for reducing and displaying electronic image data created assuming a certain screen size on a screen smaller than the assumed size,
When specific information for one or more objects or regions in the image data is set in the characteristic region information storage unit,
Based on the screen size obtained from the output target device, to generate data simply reduced size of the image data,
Based on the screen size and the information stored in the feature area information storage means, cut out and process a part of the image data stored in the image information storage means,
By combining a part of the processed image data and the data simply reduced in size,
Outputting the synthesized data to the output target device. In the characteristic area information storage means, characteristic information is set for a plurality of objects and areas, and if the information amount representing the characteristics is determined to be superior or inferior, the display magnification of the overlapping object or area is set according to the superiority or inferiority. 2. The image / video processing / displaying method according to claim 1, wherein the image / video processing / displaying method is changed for each object or each area so that the degree of the information amount and the ratio of the specific portion to the entire display are made to correspond. Decomposing the video data into each frame image data,
When at least one important object and its importance are given to each frame image data, the image data is set so that the important object becomes relatively large for each of the frame image data. Generate
Combining the generated image data so as to correspond to the time series in the video data,
3. The image / video processing and displaying method according to claim 1, wherein the combined image data is displayed. An image and video processing and display device for reducing electronic image data created assuming a certain screen size on a screen smaller than the assumed size,
Video information storage means for storing video data,
Feature region information storage means for storing specific information for one or more objects or regions in the image data;
Based on the screen size acquired from the output target device, reduced image editing means for generating data simply reduced in size of the image data,
An area image editing unit that cuts out and processes a part of the image data stored in the video information storage unit based on the screen size and the information stored in the characteristic area information storage unit,
Image synthesizing means for synthesizing a part of the processed image data and the data simply reduced in size,
Output means for outputting the combined data to the output target device,
An image / video processing and display device comprising: The feature area information storage means includes:
It has characteristic information on a plurality of objects and regions, and the characteristic information includes superiority and inferiority in an information amount representing the characteristic,
The area image editing means,
By referring to the information in the characteristic area information storage means, the display magnification of the object or the area to be overlapped is changed for each object or area according to the priority, and the priority of the information amount is made to correspond to the ratio of the specific portion to the entire display. The image / video processing and display device according to claim 4, further comprising means. The area image editing means,
Means for decomposing the video data into each frame image data,
When at least one important object and its importance are given to each frame image data, the image data is set so that the important object becomes relatively large for each of the frame image data. Means for generating, having
The image combining means includes:
Means for combining the image data generated by the area image editing means so as to correspond to a time series in the video data,
The output means,
6. The image / video processing and display device according to claim 4, further comprising means for displaying the combined image data. An image and video processing display program for reducing the size of electronic image data created assuming a certain screen size on a screen smaller than the assumed size,
A reduced image editing step of generating data in which the image data is simply reduced in size based on the screen size obtained from the output target device;
Based on the screen size and the information stored in the characteristic region information storage unit that stores specific information for one or more objects or regions in the image data, the image data stored in the video information storage unit is An area image editing step of cutting out and processing a part,
An image synthesizing step of synthesizing a part of the processed image data and the data simply reduced in size,
An output step of outputting the synthesized data to the output target device,
An image / video processing and display program characterized by being executed by a computer. The area image editing step includes:
A plurality of objects and regions have characteristic information, and the characteristic information refers to information in a characteristic region information storage unit that includes information on the degree of information representing the characteristics, and determines the display magnification of the overlapping object or region. 8. The image / video processing and display program according to claim 7, further comprising the step of changing each object or each area in accordance with the priority, so as to correspond the priority of the information amount and the ratio of a specific portion to the entire display. The area image editing step includes:
Decomposing the video data into each frame image data;
When at least one important object and its importance are given to each frame image data, the image data is set so that the important object becomes relatively large for each of the frame image data. Generating, and
The image combining step includes:
Combining the image data generated in the region image editing step so as to correspond to a time series in the video data,
The output step includes:
9. The image / video processing display program according to claim 7, further comprising a step of displaying the combined image data. A storage medium storing an image / video processing display program for reducing electronic image data created assuming a certain screen size on a screen smaller than the assumed size,
A reduced image editing step of generating data in which the image data is simply reduced in size based on the screen size obtained from the output target device;
Based on the screen size and the information stored in the characteristic region information storage unit that stores specific information for one or more objects or regions in the image data, the image data stored in the video information storage unit is An area image editing step of cutting out and processing a part,
An image synthesizing step of synthesizing a part of the processed image data and the data simply reduced in size,
An output step of outputting the synthesized data to the output target device,
A storage medium storing an image / video processing display program, wherein the storage medium stores a program to be executed by a computer. The area image editing step includes:
A plurality of objects and regions have characteristic information, and the characteristic information refers to information in a characteristic region information storage unit that includes information on the degree of information representing the characteristics, and determines the display magnification of the overlapping object or region. 11. The storage medium storing the image / video processing / displaying program according to claim 10, further comprising the step of changing the degree of the information amount and the ratio of a specific portion to the entire display according to the priority. The area image editing step includes:
Decomposing the video data into each frame image data;
When at least one important object and its importance are given to each frame image data, the image data is set so that the important object becomes relatively large for each of the frame image data. Generating, having
The image combining step includes:
Combining the image data generated in the region image editing step so as to correspond to a time series in the video data,
The output step includes:
A storage medium storing the image / video processing display program according to claim 10 or 11, further comprising a step of displaying the combined image data.

Images