JP2001103469A - Object video image display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display an object video image that is a selection object without impairing its display image. SOLUTION: Decoded object video images A20, B22, C24 are fed to an object video image selection section 34. The selection section 34 receives sets of shape information A26, B28, C30, including contour information of each object video image respectively. When a user uses a setting section 36 to enter an identification number of an object desired to be selected, the selection section 34 selects an object video image that is the object of selection from the identification numbers of the object video image entered by the setting section 36. The selection section 34 allows the selection object to be displayed as it is and allows the object video image that is a non-selection object to be displayed in a color for the entire object by using the shape information.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an object video display apparatus coded by the MPEG system, and more particularly to a technique for selecting and displaying an object video displayed on a display screen.

[0002]

2. Description of the Related Art Conventionally, it has not been easy to realize a technique for selecting a target image from a rectangular screen such as MPEG2. However, an object image of the MPEG4 system can be used for an object image even when the display is constantly moving. If there is a selection instruction, the corresponding object can be selected. As a method of selection instruction, a method of sequentially selecting and confirming the object image displayed by the remote control, a method of directly selecting the target object with the mouse, or a method of directly specifying the target object image from the screen with the touch panel and selecting There are methods such as doing. When selecting the target object video with the setting key etc.
There is a technique for highlighting the object video to emphasize and display that the target object video is selected.

[0003]

The above-described method of highlighting a selection target object is a display method for highlighting that a target object image has been selected. However, this method has a disadvantage that the image quality of the target object video changes at the time of selection, and the impression displayed before the selection differs from the impression at the time of the selection. In particular, it is not suitable for use such as changing the image quality or the like of a target object image by key operation.

[0004] Other issues relating to the selection of an object image include the following. There is a use in which a plurality of object videos are moving and a desired object video is selected in a moving state. For example, it is used to observe the movement of the object itself. In this case, even if a desired object image is selected, it is difficult to confirm whether the object image selected by the user has been selected because it is obstructed by the movement of another object image.

When the object image is a person, a sound object is separately added. Then, it is assumed that there is a request to select an object video and change the volume or sound quality of the sound corresponding to each object video. Since sound objects are separately added, it has conventionally been difficult to select an object video, even if an attempt is made to select an object video, without knowing which object video is generating the sound.

[0006] Since the object image is moving, the object image to be selected cannot be observed in detail. -Since the sizes of the object images are different and the arrangements are also different, it has been difficult to observe the object images to be selected in detail when selecting the object images. As described above, there are various problems when selecting a desired object video from a plurality of object videos.

[0007]

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and a first invention is directed to an object image supply means for supplying a plurality of encoded object images, Decoding each object video from the supply unit, a decoding unit that outputs at least shape information indicating the outline of the object video, and the object video and the shape information decoded by the decoding unit are input, An identification signal given to each object video is detected, and based on the detection result of the identification signal, the input object video is divided into at least two groups, and a first processing is performed on the first group of object videos. Object video selection processing means for performing, on the second group, a second process different from the first process,
A display unit for combining and displaying the object videos subjected to the first and second processes by the object video selection processing unit.

According to the first aspect of the invention, when the user selects an object video to be selected and displays it, the object video selection processing means causes the object video to be selected to be displayed as it is. The non-selection target video is subjected to some processing so that it can be distinguished from the selected object video. This prevents the image quality of the selection target object from changing. Further, which object video is the object video to be selected is identified by the identification signal. for that reason,
The user can easily determine which of the object images to be selected automatically by selecting the identification signal or reading the identification signal by the object image selection processing means.

According to the second aspect of the present invention, an object image supply means for supplying a plurality of encoded object images, and each object image from the supply means can be decoded and a specific object image can be designated. Possible object video designating means, connected to the object video designating means, and based on an output signal from the designating means, selection processing means for selecting a specific object video from the object videos output from the respective decoding means. And an erasing means for erasing an object video other than the object video selected by the selection processing means, and a display means for displaying an object video not erased by the erasing means.

In the configuration of the second aspect of the present invention, since the erasing means employs a structure for erasing images other than the object image selected by the selection processing means,
The user can clearly confirm the object to be selected.

[0011] Next, the third aspect of the present invention relates to an object image supply means for supplying an encoded object image, a decoding means for decoding each object image from the supply means, and Display means for displaying the supplied object video, sound-generating object detection means for detecting an object video including a target where sound is generated among the object video supplied from the supply means, and display corresponding to the object video Display change instructing means for giving an instruction for changing the contents, and connected to the sound generating object detecting means, and when a predetermined instruction is given by the display changing instructing means, the object image displayed on the display means is displayed. The sound-generating object image detected by the sound-generating object detecting means and another object It is characterized by comprising a display control means for displaying such that can distinguish and video.

In the third aspect of the present invention, the sound-generating object detecting means detects an object image generating a sound. That is, this means detects an object that is currently generating a sound or an object that is generating a sound in the past or the future. Then, the display control means performs display control for displaying the sound-generating object image detected by the sound-generating object detecting means and other object images among the object images displayed on the display means. By doing so, it is possible to easily confirm by the display that the sound is being generated at the time of selecting the object video that is generating the sound, so that it is possible to make a reliable selection and change the sound volume and sound quality. be able to. By changing the sound quality of the sound volume, it is possible to confirm whether or not the image is the selected object image.

Next, a fourth aspect of the present invention is directed to an object image supply means for supplying a plurality of encoded object images, a decoding means for decoding each object image from the supply means, Stop instruction means for instructing the object video to stop the movement of the video simultaneously, and display means for displaying each object video as a still image object when instructed by the stop instruction means. It is characterized by the following.

In the configuration of the fourth invention, the stop instructing means instructs the decoded object video to stop the motion of the video simultaneously, and the display means executes the decoding. When the stop instruction is given, each object video is displayed as a still image object, so that the object to be selected can be observed in detail after the motion of the object video is temporarily stopped.

According to a fifth aspect of the present invention, there is provided an object image supply means for supplying a plurality of encoded object images, a decoding means for decoding each object image from the supply means, and a method for decoding the decoded object image. Display means for displaying, a blank area detecting means for detecting a blank area on a screen on which no object video is displayed on the display screen of the display means, and selecting a specific object video from the decoded object video And a blank area display control means for controlling the display of the object image selected by the selection means in the blank area detected by the blank area detection means.

In the configuration of the fifth invention, the blank area detecting means detects a blank area on the display screen of the display means where no object video is displayed, and selects the object selected by the selecting means. By controlling the blank area display control means to move and display the video to the detected blank area, especially when selecting a moving object video, the movement of the object video other than the selection target is not disturbed. By moving the target object video to a blank area of the display screen, the object to be selected can be observed in more detail, and the movement of another non-selection target object video can be easily observed.

[0017]

Embodiments of the present invention will be described below with reference to the drawings. (First Embodiment) FIG. 1 is a block diagram showing the configuration of a first embodiment of the object video display device of the present invention. The video source 2 is a medium such as a disk, in which performers or still lifes of scenes such as movies are stored as moving image object videos. In the present invention, the description will be given for the purpose of reproducing the object video stored on the disc,
It may be used for displaying an object image in real time, such as extracting a subject from an image captured by a television camera or the like and then encoding the object image.

The object video read from the video source 2 is output as serially encoded data 4. The serially encoded data 4 is applied to the separating unit 6 to compress the encoded data A8, B obtained by compressing the object video appearing in each scene.
And C12. In the present invention, the number of object videos is limited to three for the sake of simplicity, but the number of object videos that appear in each scene is naturally different.

The encoded data A8, B10 and C12 are MP
Object encoding by the EG4 method has been performed,
It is stored in the medium as a video source 2 in a compressed state. The coded data A8, B10, C12 are applied to the object video decoding units A14, B16, C18, respectively, and the original object video A20, B22, C2
4 is reproduced. At the same time, the shape information A26, B28, C30 in each object video is also reproduced. Here, the shape information is called an alpha plane, and an area in which the object video of the corresponding arbitrary shape is surrounded by a rectangle is expressed as a logical value 1, and the remaining area is expressed as a logical value 0 as a transparent area. It was done. The shape information can be said to be information about coordinates, and can also represent the coordinates of the outline of the object. For the object video A20, the object video B22, the object video C24 and the shape information A26, the shape information B28, and the shape information C30, the coordinates to be pasted on the display screen and the overlapping state are designated by the scene configuration information 32, and each object video is set to the corresponding coordinates. Are pasted to form a display screen as a whole. The object video selection unit 34 is provided with setting information 38 output from the setting unit 36 by a setting operation such as a key operation and the input object videos A20,
22, C24 and shape information A26, B28, C30,
The object images A20 and B are selected according to each selection method described later.
22 and C24 are processed and output as processed object images A40, B42 and C44. The processed object videos A40, B42, and C44 are applied to the video compositing unit 46, and the processed object videos A40, B42, and C44 are applied to the coordinates specified by the scene configuration information 32 on the display screen as described above. Are arranged and output as synthesized video data 48. Synthetic video data 48
Is a display screen applied to the monitor 50 and synthesized.
In some cases, the output of the video source is stopped and the scene is fixed while the object video is selected by the object video selection unit 34.
4 outputs the control information 52 to the video source 2.

FIG. 2 is a block diagram showing details of the object video selecting section of FIG. FIG. 3 is a diagram showing a display example of an object video displayed in the configuration shown in FIGS. Again, in the present embodiment, object videos other than the object video set by the setting unit 36 out of the object videos A20, B22, and C24 output from the object video decoding units A14, B16, and C18 shown in FIG. The main purpose is to display the object to be selected as prominent.

The setting section 36 generates the number of the object video desired to be set, and the like. With a normal remote controller etc., the number is incremented each time a key is pressed, the screen selection state changes each time, and when the desired selection state is reached,
Press the enter key to select. Further, a mouse, a touch panel, or the like may obtain the position coordinates of the pointing cursor or the finger pressing the screen, and send the number of the object video in the vicinity to the control unit 54.

Here, it is assumed that the number for selecting the object image A20 has been sent to the control unit 54. The object video A20 is directly input to the switching unit A56 and output as a processed object video A40. Then, as described later, for the object video A20, the process of creating the silhouette A60 for the shape information A26 through the coloring section A58 is omitted. On the other hand, the shape information B28 is applied to the coloring portion B62, and the inside of the shape is subjected to a process for coloring with an appropriate color, and is output as a silhouette B64. The silhouette B64 is switched by the switching unit B66 so as to pass through the silhouette B64, and is output as the processed object image B42. In a similar process, the silhouette C68 is also colored by the coloring unit C70, switched by the switching unit C72, and output as the processed object video C44. The processed object images A40, B42, and C44 are sent to the image synthesizing unit 46, are arranged according to the coordinates specified by the scene configuration information 32, become synthesized image data 48, are displayed on the monitor 50, and are displayed on the monitor 50 as shown in FIG. The video A40 is the original video, and the object video B42 and the object video C44 are displayed by being replaced with silhouettes.

In this embodiment, the object video corresponding to the number of the object video input from the setting unit 36 is displayed as it is, and the other object video is displayed as a silhouette, so that the favorite object is not selected as it is. It is possible to confirm in a state, and by making other objects into silhouettes, there is an effect that errors in selection are reduced and the arrangement relation of the entire objects is maintained as it is.

In the above description, the silhouette is colored. However, a character for explaining the silhouette or an image such as a logo for easily expressing the silhouette may be added to the silhouette. The outline of the shape information may be displayed as it is as a solid line or a dotted line. In the above description, the object video to be selected is the original video as it is, and the other object video is displayed as a silhouette, but the object video to be selected is displayed as a silhouette, and the other object video is displayed as it is. May be displayed. In particular, when the object video to be selected is erased from the display, if the object video to be selected is displayed in advance in a silhouette, when the object is erased, the correspondence with other object videos is intuitive. There are advantages that can be confirmed.

An index is added to the scene composition information 32 in order to identify a specific group of object videos among the object videos displayed on the monitor 50. The object video selecting section 34 has a detecting means for decoding the index. Then, when the object video to which the index is added appears, the detection unit detects the object video and performs a process of surrounding the corresponding object video with a closed curve as described above. For example, if an object image such as a still life that is not directly related to the construction of a scene is grouped and displayed as a silhouette, the scene can be easily understood. Here, when the object video with the index added to the scene configuration information 32 appears in the state where the detection means is always on, the corresponding object video is turned into a silhouette. Further, the detection means may be driven from the time when a key operation is performed from the outside, for example, from the setting unit 36, and if the index is included in the scene configuration information thereafter, the corresponding object video may be turned into a silhouette.

When the object images are grouped, object images other than the specific object image may be silhouetted. For example, an object image other than a specific performer appearing in a scene is made into a silhouette, and an object image of only the performer is clearly displayed, and the other object images are made into a silhouette, which makes it easier to understand the scene.

When an object video including the silhouetted object video is displayed, if the silhouetted object video overlaps another object video, the lower object video becomes difficult to see. Since the silhouetted object image is often colored with a single color, the concealed image of the object image on the back side stands out as compared with the case where the general object images overlap. Therefore, it is preferable to change the overlapping state so that the object video that has been silhouetted by the video synthesis unit 46 is located below the other object video.

(Second Embodiment) As described in the conventional example, there is a disadvantage that when an object video to be selected is highlighted, an image is greatly different from an image of the original object video. In the present embodiment, the image of the object video to be selected is maintained as it is, and the object video to be selected may be surrounded by an arbitrary closed curve in order to make the operator recognize that the target object video has been selected. It is the gist.

FIG. 4 is a block diagram of an embodiment in which an object image to be selected is surrounded by an arbitrary closed curve. FIG.
FIG. 4 is a diagram for explaining a method of calculating the size of a closed curve when an object video to be selected is surrounded by an arbitrary closed curve. The present embodiment is an example in which a closed curve is surrounded around the object video A20, assuming that the object video A20 is set by the setting unit 36. First, the shape information A attached to the selected object video A20
26 is applied to the center-of-gravity detector 80. The center-of-gravity detector 80 calculates the center of gravity A82 of the shape information A26 as shown in FIG. The center of gravity A82 is applied to the closed curve generator 84.

The present embodiment is an example in which an object image to be selected as a closed curve is circled. The closed curve generation unit 84 first turns the radius by 360 degrees from the center of gravity A82 and obtains the longest point in contact with the contour of the shape information A26. In FIG. 5, the top of the person, ie, a, is the longest. Then, the closed curve A140, that is, the radius of the circle is set to a + b by taking a margin b from a. That is, the feature of the present embodiment is to calculate a closed curve suitable for the shape without touching the shape from the shape information, and to surround the periphery with the calculated closed curve. Therefore, if the shape of the shape information A26, that is, the shape of the object image A20 changes, the size of the closed curve can be changed according to the shape. The closed curve A1 generated by the closed curve generator 84
40 is superimposed on the object video A20 by the superimposition unit 86 with the center of gravity A82 as the center of the circle and output as the processed object video A40. In the present embodiment, a circle is used as an example of the closed curve, but any closed curve such as a rectangle may be used.

(Third Embodiment) The second embodiment is an example in which an object video to be selected is surrounded by an arbitrary closed curve. The main purpose is to enlarge the outline of the object video and display the object video overlaid with the original object video. FIG. 6 is a block diagram for realizing an embodiment in which an object video to be selected is surrounded by a closed curve approximating the object video. FIG.
FIG. 4 is a diagram for describing an example in which an object video to be selected is surrounded by a closed curve similar to the object video. Also in this example, the object video to be selected is the object video A20. The shape information A26 is applied to the shape enlarging unit 88. In the shape enlarging unit 88, there is a method of enlarging the original shape information at a fixed ratio or increasing the original shape information A26 by a fixed length and width. Here, the latter will be described. As shown in FIG. 7, a closed curve B90 approximate to the object image A20 is created such that the vertical and horizontal ends of the shape information A26 become larger by a, and the overlapping unit 8 is formed together with the original object image A20.
6 and output as a processed object video A40. This embodiment has the same effect as the conventional border by making the closed curve an appropriate size, and does not impair the visual image of the object image A20 because the closed curve is apart from the object image A20. It is understood by the operator that the corresponding object video has been selected. Further, since the closed curve is close to the original object image as in the second embodiment, the probability that another object image comes into contact with the closed curve is reduced.

Of the object images displayed on the monitor 50, the grouped object images are defined in advance by the scene configuration information 32, and an index indicating the group is specified for the grouped object images. Then, as in the first embodiment, the object image in the group may be surrounded by a closed curve by the index detecting means. That is, when an important object image is instructed, it is enclosed by a closed curve so that the user can recognize its existence. For example, if an important person or a quasi-important person appears in a specific scene, the object image is surrounded by a closed curve, and the user is alerted to the object image. Here, the closed curve may of course be a border.

In the above example, the priority may be specified for the index, and the line type of the closed curve may be changed according to the priority. For example, important objects have thick lines, and less important object images have thin lines. In addition, important object images have darker line colors, less important object images have lighter line colors, important object images have double closed curves, and less important object images have one closed curve. The priority difference can be distinguished by various methods such as making the line thinner.

In the first, second and third embodiments, the indexed object video is always detected by the index and the specified processing is performed. However, usually, no special processing is performed on the object video, and when an instruction such as a key operation is issued from the setting unit 36, the index may be detected and the specified processing may be performed.

In the first, second, and third embodiments, the scene to which an index is to be added may change depending on the scene. That is, depending on the scene, an index is added to a certain object video,
When the scene changes, there may be a state where no index is added to the same object video.

In the second and third embodiments, when another object image approaches the object image selected and touches the closed curve, it becomes difficult to see. Therefore, it is also possible to check the interval between the two by using the shape information of the object video that is to be selected and the shape information of the approaching object video.

In order to check the interval, there is a method of checking the interval between horizontal lines that are in contact with the shape information in the horizontal direction in order to simplify the processing. Similarly, there is a method of checking the interval between the vertical lines that are in contact with the shape information in the vertical direction. Then, when the interval between the two becomes equal to or less than a predetermined threshold, or when the closed curve touches a horizontal line or a vertical line that is in contact with the shape information side of the adjacent object image, the size of the generated closed curve is reduced. You may. That is, the proximity state of the approaching object image may be detected, and the size of the closed curve may be dynamically changed according to the degree of proximity.

In the case of an example in which a closed curve similar to the selected object image is enclosed, when another object image comes close to the object image, the closed curve is reduced, and finally, the periphery of the selected object image is outlined. I will be.

In the above example, in order to simplify the processing, the closed curve may be formed by linearizing the outline of the shape information of the object video to be selected from the beginning. (Fourth Embodiment) There is an application in which a specific object video is selected from a plurality of moving object videos and a moving video is observed. When it is desired to observe the motion trajectory of a specific object image, the display of another object image becomes an obstacle. As another object image overlaps with this object image, the target object image becomes more difficult to see. In the present embodiment, the main purpose is to delete the display of the object video other than the selected object video.

FIG. 8 is a block diagram for realizing an example of erasing an object video other than the selected object video. The target object video is directly selected with a mouse or a touch panel, or selected in advance by a selection method using highlighting, or the method according to the first to third embodiments.

In FIG. 8, the number of the object video selected by the setting unit 36 is
Sent to 2. The object video selection and deletion unit 92 deletes an object video other than the object video specified by the setting unit 36. Then, only the selected object video (here, the object video A20 is selected) is applied to the object video moving unit A94. Here, the selected object video may be used as it is as the processed object video A40. However, if the object video is still selected by the object video selection / deletion unit 92, the target object video may be located at the edge of the screen or the like, making it difficult to see. Therefore, the object video moving unit A94 moves the target object video to a predetermined position on the display screen. For example, it is preferable to move a large and easy-to-see place such as the center of the screen. After the selection, a specific frame or the like may be displayed on the screen and moved into the frame. It is preferable to display a description and the like of the object video in the frame together.

(Fifth Embodiment) In some cases, there is an object image generating sound in the object image displayed on the monitor 50. If sound is generated, MP
In the EG4 system, a voice or audio object is sent separately, and is reproduced in synchronization with the object video. However, in the case of a sound object, even if it is different as a sound source, that is, an object, when it is reproduced, it is mixed together so that it is not possible to know which object video is generating sound. If the sound object is changed separately, there is an advantage that only the sound can be changed in volume or sound quality. Conventionally, there has been no method for discriminating an object image generating sound from the motion of the image, that is, the motion of the mouth if the object image is a person.

In the present embodiment, an object image generating sound is selected from the displayed object images,
The main purpose is to provide means for changing the volume or sound quality of the sound object corresponding to the object video. FIG. 9 is a block diagram for realizing an embodiment including a means for selecting an object image generating a sound. FIG. 10 is a display diagram showing a sound generation state of an object image generating a sound.

First, for a plurality of object images displayed on the monitor 50, a key operation of the setting unit 36 is performed in order to display which object is generating sound. If the key is a remote control, press the "Sound" button. The control unit 54 detects the sound object number from the scene configuration information 32 by the sound generation object detection unit 96 assuming that the instruction to display the sound has been given. Similarly, an object video number corresponding to the sound object is extracted. For the corresponding object video, the sound generation display creator 98 creates a display for confirming that sound is being generated. In the present embodiment, an object video A20 is used as a target object video. The display created by the sound generation display creating section 98 may be a small logo or text that does not impair the display of the original object video. In the present embodiment, a display quantitatively indicating the volume and the sound quality is added to the original object video as described later. The display content generated by the sound generation display creation unit 98 and the object video A20 are superimposed by the superimposition unit to become a processed object video A40.

By the above processing, of the object images displayed on the monitor 50, the object image which is generating sound is displayed like a logo which can be distinguished from the other object images so that the sound is generated. Is added. Then, the operator can again select the object video in which those sounds are generated from the setting unit 36. In the present embodiment, the selected object video is an object video A20. Then, the operator sets the volume and the sound quality of the sound in which the selected object video is generated again by key operation from the setting unit 36. The sound volume and sound quality are interpreted as set values by the sound volume sound quality setting interpretation unit 144. The set values of the volume and the sound quality are applied to the sound generation display creating unit 98. The sound generation display creation section 98 generates a volume display and a sound quality display as shown in FIG. 10 according to the magnitude of the set value. That is, in the present embodiment, the set values for the sound volume and the sound quality set by the setting unit 36 can be confirmed by display on the corresponding object video. On the other hand, the sound corresponding to the object video A20, that is, the object sound A142 is output from the object sound decoding unit A100, and is output from the volume sound quality conversion unit 1
02 is applied.

According to the set value output from the volume sound quality setting interpreting section 144, the object voice A142 changes its volume and sound quality and becomes the converted object voice 146. The sound volume and the sound quality according to the set values are applied to the sound volume display 148 and the sound quality display 150 in FIG. 10, and the sound volume and the sound quality are displayed as being changed.

Depending on the object video, no sound is generated during the setting operation depending on the scene, but in the past or in the future (applicable when the video source 2 is a storage medium).
There is a case where the object video to be set generates sound. Therefore, as in the case of the object video in which the sound is being generated, the display is distinguished from the other object video by adding the display in which the object video in which the sound is to be generated is distinguished from the other object video. It does not matter. If the selected object video does not generate sound, the scene configuration information 32 is searched, the target object is moved to a scene where the target sound object generates sound, and a test is performed. The sound in the scene may be generated.

As described above, according to the present embodiment,
First, a display for confirming the generation of sound is added to the object video that is generating sound or is the target of generation of sound in the object video displayed on the monitor 50. Then, the object video generating the sound can be set and selected by the above-described means. Then, the volume and sound quality of the sound in which the selected object video is generated can be set and changed, and the changed results are easily reflected on the display of the target object video.

(Sixth Embodiment) When selecting a moving object image, it is better to stop the movement at once and select a desired object image for the object image that has been converted into a still image, and observe the object image in detail. it can. FIG. 11 is a block diagram showing the configuration of an embodiment according to the present invention in which moving objects are stopped all at once and then selected.

Normally, object images A20, B22,
C24 passes through the switching units A56, B66, and C72, and the processed object images A40, B42,
Converted to C44. Here, when the simultaneous stop key operation is performed on the setting unit 36, the object images A20, B2
2, C24 are still image conversion units A154, B162,
The image is converted to a still image in C164, and the switching units A56, B66,
C72. Switching section A56, B6
6, C72 switches the still object image to the processed object images A40, B42, C44. On the monitor 50, the object video that has been moving until immediately before the key operation is displayed with the coordinates and size unchanged. Thereafter, a desired object image is selected by the setting unit 36 while observing the object image converted into a still image. After the still image is formed, it may be selected to highlight or border a desired object image.

(Seventh Embodiment) According to the sixth embodiment, since the moving object image immediately before moving is selected as a still image and selected, the object images are arranged at random and the sizes of the object images are different. It will be hard to see. In view of this, the present embodiment provides a means for aligning the sizes of the object images, displaying the images after the objects are aligned and stopped.

FIG. 12 is a block diagram showing an embodiment in which the movement of a plurality of object images is stopped and aligned. FIG. 13 is a view showing an object video before being aligned in the present embodiment. FIG. 14 is a diagram showing a state in which object images are aligned in the present embodiment.

Object images A20, B22, C24
Are output as processed object images A40, B42, and C44 through the switching units A, B66, and C72, respectively. When the simultaneous stop key operation is performed on the setting unit 36, the object images A20, B22, and C24 are applied to the enlargement / reduction units A104, B106, and C108, respectively. The control unit 54 controls the enlargement / reduction units A104 and B1.
06 and C108 respectively to control the object video A
20, B22, and C24 have the same size. In order to make the sizes uniform, the length in the vertical direction is detected from the shape information A26, B28, and C30. For example, in the case of a person object video, the height is detected from the top to the tip of the foot.
Then, the shape information is enlarged or reduced by the enlargement / reduction units A104, B106, and C108 so that the length in the vertical direction is constant, and normalized. At the same time, shape information A2
6, the sizes of the object videos A20, B22, and C24 are also normalized according to the ratio of enlargement or reduction of B28, C30. These normalized object images A20, B22, and C24 are equivalent object image A
110, B112, C114
154, the still image forming unit B162 and the still image forming unit C164. Still images are formed by the still image forming units A154, B162, and C164. This still image object video is applied to the arrangement arrangement unit 116. The alignment unit 116 detects the center of gravity of each still image object. Then, for each still image object, the centers of gravity are arranged at equal intervals, and are arranged so as to be vertically aligned. FIG. 14 shows a still image object video that has been converted into a still image and arranged. Center of gravity B118 of the still image object at the left end, center of gravity C120 of the still image object at the center, center of gravity D15 of the still image object at the right end
2 are arranged at equal intervals, and the crowns are also aligned.
Thereafter, a desired still image object video may be set and selected by the setting means.

According to the present embodiment, a plurality of moving object images are enlarged or reduced in size to make the sizes uniform, and then arranged in line. Since the sizes are uniform and aligned, the object images are easy to see, and there is an effect that the object images desired by the operator can be slowly observed and then selected.

(Eighth Embodiment) In this embodiment, an object image selected from a plurality of object images displayed on a monitor screen is moved to a blank area such as the four corners of the screen and displayed as a still image object. When a moving object is selected, it may be difficult to see the selected object video because the selected object video itself is also moving. In addition, since other object images are moving, they overlap with the object image to be selected, making it difficult to see. Therefore, if the movement of the object video to be selected is stopped, the object video itself becomes easy to see. However, there is a possibility that another object image moves and overlaps with the object image to be selected, making it difficult to view. The sixth embodiment is a method in which all the displayed objects are stopped all at once and a desired object image is selected. However, this method has a problem that in a real-time scene, the screen suddenly jumps after the selection is completed. Therefore, in the present embodiment, when a desired object video is selected from a plurality of object videos, the object video is moved to a blank area such as the four corners of the screen and displayed as a still image object in that area. ing.

FIG. 15 is a configuration diagram for realizing an embodiment in which an object image is selected from a plurality of object images, moved to a blank area on the screen, and displayed. FIG.
6 is a display diagram showing a state where a plurality of object videos are displayed. FIG. 17 is a display diagram in which an object video selected from a plurality of object videos is moved to a blank area of the display screen and displayed. FIG. 18 is a diagram for explaining a means for detecting a blank area on the display screen. To select the desired object video, a setting number may be output from the setting unit 36 to highlight the target object video, or the method according to the first to fourth embodiments may be used.

In the following description, the object image A20
Is assumed to be a selection. Object video A2
0 is applied to the still image conversion unit A154, and the object video A20 is converted into a still image object. On the other hand, the blank area detection unit 156 has the shape information A26, B28, C3
0 is applied respectively. The blank area detection unit 156 checks the area where the object video A20 can be displayed at the four corners of the screen using the shape information A26, B28, C30 and the display frame of the screen. According to FIG. 18, the moving vertical line 122 parallel to the vertical line of the display frame is moved to the left and right until it moves until it touches the displayed object video H160. Similarly, the moving horizontal line 124 parallel to the horizontal line of the display frame is moved until it comes into contact with the object G158. Eventually, the moving horizontal line 124 and the moving vertical line 122 are fixed, and the area composed of the display frame is a blank area 126 that does not include an object image inside. If this area is narrow to accommodate the object image A20, a blank area is searched for another corner. If the detected four corner areas cannot accommodate the object image A20, the largest area is selected, and the object image A20 is moved to this area to be displayed over another object image.

When the blank area 126 is detected by the above processing, the object video moving unit B128
Still image of object image A20 to be selected
Is moved to the blank area 126 and displayed. here,
If the blank area 126 is too small to accommodate the object image A20, the object image A20 may be reduced to an appropriate size. FIG. 17 shows an object image A2.
This shows a display state in which 0 is moved to the lower left corner of the display screen. In FIG. 17, the original object video A20 is moved to the corner of the display screen. However, the object video A20 as a still image and the object video A20 before the movement may be continuously displayed at the original position. Without stopping the display of the object video in the real-time state, only the object video selected and displayed can be displayed as a still image in the corner of the screen, and can be observed in detail because it is still.

The object image moved to the corner of the screen is converted to a still image. However, if the original object image has a small movement and there is no fear of protruding from the detected blank area 126, the object image can be moved as it is. it can. Further, when the movement of the object video to be selected is large, the movement can be made slow so as not to protrude from the blank area 126. If the moving state is reproduced as it is, there is an advantage that the movement of another object video and the movement of the target object video can be compared and observed.

[0060]

As described in detail above, according to the first aspect of the present invention, when the user selects an object video to be selected and displays it, the object video selection processing is performed. In the means, the object video to be selected is displayed as it is, and the other non-selected video is subjected to some processing so that it can be distinguished from the selected object video, so that the image quality of the selected object may change. Disappears. Furthermore, since the object video to be selected identifies which object video by the identification signal, the user selects the identification signal,
Alternatively, it is possible to easily determine which of the object videos to be selected automatically by reading the identification signal by the object video selection processing means.

According to the second aspect of the present invention, since the erasing means employs a structure for erasing an image other than the object image selected by the selection processing means, the user can clearly select the object to be selected. You can check.

According to the third aspect, the sound-generating object detecting means detects an object image generating a sound. That is, this means detects an object that is currently generating a sound or an object that is generating a sound in the past or the future. Then, the display control means performs display control for displaying the sound-generating object image detected by the sound-generating object detecting means and other object images among the object images displayed on the display means. By doing so, it is possible to confirm on the display that the sound is being generated when selecting the object video that is generating the sound, so that it is possible to make a reliable selection and change the volume and sound quality of the sound. it can. By changing the sound quality of the sound volume, it is possible to confirm whether or not the image is the selected object image.

In the fourth invention, the stop instruction means is:
For each of the decoded object videos, an instruction is issued to stop the motion of the video at the same time, and the display means displays each object video as a still image object when the stop instruction is issued. After stopping the movement, the object to be selected can be observed in detail.

According to the fifth aspect, the blank area detecting means detects a blank area on the display screen of the display means where no object video is displayed, and detects the object video selected by the selecting means. By controlling the blank area display control means to move to and display the blank area that has been selected, especially when selecting a moving object video, the display is performed so as not to be disturbed by the movement of the object video other than the selection target. By moving the target object video to the blank area of the screen, the selection target object can be observed in more detail, and the movement of another non-selection target object video can be observed.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an embodiment of an object video display device of the present invention.

FIG. 2 is a block diagram showing details of an object video unit.

FIG. 3 is a diagram illustrating an example in which an object video to be selected is displayed as it is, and a non-selection target object video is displayed in silhouette.

FIG. 4 is a block diagram showing a configuration of an embodiment in which an object video to be selected is surrounded by an arbitrary closed curve.

FIG. 5 is a view for explaining a method of calculating a closed curve in the embodiment of FIG. 4;

FIG. 6 is a block diagram showing a configuration of an embodiment in which an object video to be selected is surrounded by a closed curve approximate to the object video.

FIG. 7 is a view for explaining a method of creating an approximated closed curve in the embodiment of FIG. 6;

FIG. 8 is a block diagram showing a configuration of an embodiment for erasing a non-selection object video.

FIG. 9 is a block diagram showing a configuration of an embodiment including a unit for selecting an object video generating a sound.

FIG. 10 is a diagram showing an example of a display method of a sound generation state for an object video that is generating a sound.

FIG. 11 is a block diagram showing the configuration of an embodiment in which moving objects are stopped all at once and then selected.

FIG. 12 is a block diagram showing a configuration of an embodiment in which movements of a plurality of object videos are stopped and aligned.

FIG. 13 is a diagram showing a display example of an object video before alignment in an embodiment in which movement of a plurality of object videos is stopped and aligned.

FIG. 14 is a diagram showing a display example in a state where object videos are aligned in an embodiment in which movements of a plurality of object videos are stopped and aligned.

FIG. 15 is a block diagram showing a configuration of an embodiment in which a specific object video is selected from a plurality of object videos, moved to a blank area of the screen, and displayed.

FIG. 16 is a diagram showing a state where a plurality of object videos are displayed.

FIG. 17 is a diagram showing an example in which the selected object video is moved to a blank area of the display screen and displayed in the embodiment shown in FIG. 15;

FIG. 18 is a view for explaining a method of detecting a blank area on a display screen.

[Explanation of symbols]

2 ... video source, 4 ... serial encoded data, 6 ... separation unit,
8 coded data A, 10 coded data B, 12 coded data C, 14 object video decoding units A, 1
6 ... object video decoding unit B, 18 ... object video decoding unit C, 20 ... object video A, 22 ... object video B, 24 ... object video C, 26 ...
Shape information A, 28 ... Shape information B, 30 ... Shape information C, 3
2 ... scene configuration information, 34 ... object video selection unit,
36 setting part, 38 setting information, 40 processed object video A, 42 processed object video B, 44
Processed object video C, 46 ... Video synthesis unit, 48 ...
Synthetic video data, 50 monitor, 52 control information

Claims (19)

[Claims] 1. An object video supply unit for supplying a plurality of encoded object videos, and decoding for decoding each object video from the supply unit and outputting at least shape information indicating an outline of the object video. Means, an object image decoded by the decoding means and the shape information are input, an identification signal given to each object image is detected, and based on the detection result of the identification signal, the input object The video is divided into at least two groups, the first processing is performed on the first group of object videos, and the first processing is performed on the second group.
Object video selection processing means for performing a second processing different from the above processing, and display means for combining and displaying the object video subjected to the first and second processing by the object video selection processing means, respectively. An object video display device characterized in that: 2. The first process is a process in which an object image of a first group is supplied to the display means as it is, and the second process is a process in which an object image of a second group is 2. The object video display device according to claim 1, wherein the process is a process of supplying shape information to the display unit as an output video. 3. The image selection processing means according to claim 1, wherein:
2. The apparatus according to claim 1, further comprising a setting unit configured to externally set the first group and the second group.
The object video display device according to the above. 4. The image selection processing means carries out the second processing, and the shape information of the object image is supplied to the display means as an output image, and the shape information is displayed overlapping with another object image. In the case, the display means comprises:
3. The object image display device according to claim 2, wherein the output image of the shape information is moved and displayed below another object image. 5. The first process is a process for supplying an object video of a first group to the display means as it is, and the second process is a process of supplying an object video of a second group from shape information thereof. 2. The object video display apparatus according to claim 1, further comprising a process of generating a closed curve surrounding the object video and supplying it as an output video together with the object video to the display unit. 6. The object video display device according to claim 1, wherein said identification signal includes information on a priority level concerning a predetermined display. 7. The object video selection processing means detects an identification signal including the priority information uniquely assigned to each object video, and the closed curve surrounding the object video generated in the second processing is determined. 7. The object video display device according to claim 6, wherein the line image is generated by changing the line type according to the detected priority. 8. The object image selection processing means includes means for measuring an interval between the object image of the second group and another object image close to the object image, and the measurement result obtained by the means is 6. The object video display device according to claim 5, wherein the size of the closed curve to be generated is adjusted accordingly. 9. The object video display according to claim 1, further comprising setting means for generating a control signal for controlling on / off of detection of the identification signal detected by said object video selection processing means. apparatus. 10. An object picture supply means for supplying a plurality of encoded object pictures, and an object picture designation capable of decoding each object picture from said supply means and designating a specific object picture. Means, connected to the object video designating means, and based on an output signal from the designating means, a selection processing means for selecting a specific object video from the object videos output from the respective decoding means, and the selection processing means 2. An object video display device comprising: an erasing unit for erasing an object video other than the object video selected in the above step; and a display unit for displaying the object video not erased by the erasing unit. 11. A function for performing control such that the selection processing means displays a selected object image by moving the object image by a predetermined position from a display position where the object image would be displayed on the display means. The object video display device according to claim 10, further comprising: 12. An object video supply means for supplying an encoded object video, a decoding means for decoding each object video from said supply means, and displaying the object video supplied from said decoding means. A display unit; a sound-generating object detecting unit that detects an object image including a target where a sound is generated among the object images supplied from the supplying unit; and an instruction to change a display content corresponding to the object image. Display change instructing means to be performed and the sound generating object detecting means, and when a predetermined instruction is given by the display changing instructing means, the sound generating object detecting means in the object image displayed on the display means Can be distinguished from the sound-generating object image detected by Object image display apparatus is characterized in that comprising a display control means for displaying. 13. A volume / sound quality changing means for changing a volume and a sound quality of an object image detected by said sound generating object detecting means, and a display means for displaying a current sound volume and sound quality on said object image. Volume
13. The object video display device according to claim 12, further comprising sound quality display control means. 14. When changing the volume and sound quality of an object video by the volume / sound quality changing means, if the object video does not generate sound, a sound is generated in a scene constituted by the object video. Move to the scene,
14. The object video display device according to claim 13, further comprising a sound generating means for generating a sound in the scene. 15. An object picture supply means for supplying a plurality of encoded object pictures, a decoding means for decoding each object picture from said supply means, and a decoding means for each of the decoded object pictures. An object comprising: a stop instructing unit for instructing to simultaneously stop the movement of an image; and a display unit for displaying each object image as a still image object when instructed by the stop instructing unit. Video display device. 16. The display means, when instructed by the stop instructing means, aligns the size of each object video as a still image object, and displays each object video aligned on the screen. 16. The object video display device according to claim 15, further comprising a function. 17. An object video supply means for supplying a plurality of encoded object videos, a decoding means for decoding each object video from said supply means, and a display means for displaying the decoded object video. And a blank area detecting means for detecting a blank area on a screen on which no object video is displayed on the display screen of the display means, and a selecting means for selecting a specific object video from the decoded object video, An object image display device, comprising: a blank area display control means for controlling display of the object image selected by the selection means in a blank area detected by the blank area detection means. 18. The encoded object image is M
2. The object video display device according to claim 1, wherein the object video display device is a PEG system. 19. The encoded object image is M
The object video display device according to claim 10, wherein the object video display device is a PEG system.