JP2013201603A - Reproducing device, recording and reproducing device, and reproducing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To suppress image quality degradation even when largely displaying superimposed images for which two or more kinds of images with different field angles are superimposed.SOLUTION: A first acquisition part 64 of a reproducing device 14 acquires two or more kinds of image data with different field angles, and field angle information indicating the equivalent position and range of the image data with a narrow field angle in each of the two or more kinds of image data. A reception part 76 receives first identification information of the image data of an object to be displayed as a main image, and second identification information of the image data of the object to be superimposed in a partial area on the main image and displayed as a sub image. An extraction part 82 extracts an area corresponding to the image data specified by the second identification information on the basis of the field angle information from the image data specified by the first identification information. A generation part 90 generates a superimposed image for which the extracted image is superimposed on the main image. A display control part 91 displays the superimposed image at a display part 62.

Description

  The present invention relates to a playback device, a recording / playback device, and a playback method.

  A plurality of types of image data having different angles of view and angles with respect to a subject are captured, and other images are superimposed on one image and displayed (so-called PinP (Pcture in Picture)). For example, Patent Document 1 discloses that recording is performed at a reduced resolution or recording rate of one of two types of video signals having different imaging magnifications. Japanese Patent Application Laid-Open No. 2004-228561 discloses that a user-selected video among a plurality of videos is displayed as it is, and only other I pictures are reproduced for other videos.

JP 2004-215124 A JP 2000-156845 A

  However, in the above-described prior art, each image in the superimposed image in which a plurality of types of images are superimposed does not stand out when the image is displayed small, but the image quality decreases as the image is displayed larger. There was a problem that was conspicuous.

  The present invention has been made in view of the above, and a reproducing apparatus capable of suppressing image quality degradation even when a superimposed image obtained by superimposing a plurality of types of images with different angles of view is displayed. A main object is to provide a recording / reproducing apparatus and a reproducing method.

  The reproduction apparatus of the present invention includes a first acquisition unit, a reception unit, an extraction unit, a generation unit, and a display control unit. The first acquisition unit includes a plurality of types of image data having different angles of view, and angle-of-view information indicating positions and ranges corresponding to the image data having a narrower angle of view in each of the plurality of types of image data. Obtain first data. The reception unit includes first identification information of target image data to be displayed as a main image when displaying a superimposed image in which a plurality of images are superimposed among the plurality of types of image data, and a partial area on the main image. And second identification information of image data to be displayed superimposed as a sub-image. The extraction unit extracts a region corresponding to the image data specified by the second identification information from the image data specified by the first identification information based on the angle-of-view information. The generation unit generates a superimposed image in which the extracted image is superimposed on the image data specified by the first identification information. The display control unit performs control to display the generated superimposed image on the display unit.

  The recording / reproducing apparatus of the present invention includes a second acquisition unit, a calculation unit, a first generation unit, a storage unit, a first acquisition unit, a reception unit, an extraction unit, a second generation unit, and display control. A section. The second acquisition unit acquires a plurality of types of image data having different angles of view. The calculation unit includes angle-of-view information indicating a corresponding position and range of the image data having a narrower angle of view for each of the image data other than the image data having the largest angle of view among the plurality of types of acquired image data. Is calculated. The first generation unit generates first data including the acquired plural types of image data and the calculated angle-of-view information. The storage unit stores the first data. The first acquisition unit acquires the first data. The reception unit includes first identification information of target image data to be displayed as a main image when displaying a superimposed image in which a plurality of images are superimposed among the plurality of types of image data, and a partial area on the main image. And second identification information of image data to be displayed superimposed as a sub-image. The extraction unit extracts a region corresponding to the image data specified by the second identification information from the image data specified by the first identification information based on the angle-of-view information. The second generation unit generates a superimposed image in which the extracted image is superimposed on the image data specified by the first identification information. The display control unit performs control to display the generated superimposed image on the display unit.

  The reproduction method of the present invention includes a plurality of types of image data having different angles of view, and angle-of-view information indicating corresponding positions and ranges of the image data having a narrower angle of view in each of the plurality of types of image data. A first identification information of a target image data to be displayed as a main image when displaying a superimposed image obtained by superimposing a plurality of images among the plurality of types of image data; Based on the angle-of-view information from the image data specified by the first identification information; Extracting a region corresponding to the image data specified by the second identification information; and extracting the extracted image from the image data specified by the first identification information. To and generating a superimposed image obtained by superimposing and performing control for displaying the generated superimposed image on the display unit.

  According to the present invention, there is an effect that image quality deterioration can be suppressed even when a superimposed image obtained by superimposing a plurality of types of images with different angles of view is displayed large.

FIG. 1 is a schematic diagram showing a recording / reproducing apparatus. FIG. 2 is a schematic diagram illustrating the recording apparatus. FIG. 3 is a schematic diagram illustrating an example of field angle information. FIG. 4 is a schematic diagram showing a data structure of encoded image data and first data. FIG. 5 is a schematic diagram showing a playback apparatus. FIG. 6 is a flowchart showing the procedure of the recording process performed by the recording apparatus. FIG. 7 is a flowchart showing the procedure of re-establishment processing performed by the playback apparatus. FIG. 8 is a schematic diagram showing a PinP image displayed on the playback apparatus.

  Exemplary embodiments of a reproducing apparatus, a recording / reproducing apparatus, and a reproducing method according to the present embodiment will be described below in detail with reference to the accompanying drawings.

  FIG. 1 is a diagram schematically showing a recording / reproducing apparatus 10 of the present embodiment.

  The recording / reproducing apparatus 10 records image data on a recording medium and reproduces the recorded image data. In this embodiment, the case where the image data is moving image data will be described, but still image data may be used.

  The recording / reproducing apparatus 10 includes a recording apparatus 12 and a reproducing apparatus 14.

  FIG. 2 is a schematic diagram showing the recording device 12. The recording device 12 includes a device main body 30 and a storage unit 32.

  The storage unit 32 stores first data to be described later. The storage unit 32 is a storage medium such as a hard disk drive (HDD).

  The apparatus main body 30 includes a second acquisition unit 16, an encoding unit 18, a buffer 20, a calculation unit 22, a buffer 24, a multiplexer 26 (first generation unit), and a buffer 28.

  The second acquisition unit 16 acquires a plurality of types of image data having different angles of view. In the present embodiment, as an example, a case where three types of image data having different angles of view are acquired will be described.

  In the following description, image data having the widest angle of view (wide angle) among the three types of image data will be referred to as wide-angle image data for easy understanding. In addition, image data having a wide angle of view next to the wide-angle image data will be referred to as first enlarged image data. The image data having the narrowest angle of view among the three types of image data will be described as second enlarged image data. The wide-angle image data, the first enlarged image data, and the second enlarged image data are collectively referred to as image data for explanation.

  The second acquisition unit 16 includes an optical system 40. In the present embodiment, the optical system 40 includes a first optical system 34, a second optical system 36, and a third optical system 38 that acquire image data having different angles of view.

  The first optical system 34 picks up the wide-angle image data having the widest angle among the plurality of optical systems 40 (the first optical system 34, the second optical system 36, and the third optical system 38) provided in the recording apparatus 12. Get by. Specifically, the first optical system 34 includes a lens 34A, an image sensor 34B, and a buffer 34C.

  The image sensor 34B performs photoelectric conversion according to incident light incident through the lens 34A, and generates wide-angle image data corresponding to the incident light. The lens 34 </ b> A is a wide-angle lens having the widest field angle compared to the lens 36 </ b> A provided in the second optical system 36 and the lens 38 </ b> A provided in the third optical system 38. A known CMOS image sensor (Complementary Metal Oxide Semiconductor Image Sensor) or the like is used for the image sensor 34B. Wide-angle image data generated by the image sensor 34B is sequentially stored in the buffer 34C. The buffer 34C can store a plurality of frames (frame images, screens).

  The image sensor 36B performs photoelectric conversion according to incident light incident through the lens 36A, and generates first enlarged image data according to the incident light. The lens 36 </ b> A is a lens having a narrower field angle than the lens 34 </ b> A provided in the first optical system 34 and a wider field angle than the lens 38 </ b> A provided in the third optical system 38. A known CMOS image sensor or the like is used for the image sensor 36B. The first enlarged image data generated by the image sensor 36B is sequentially stored in the buffer 36C. The buffer 36C can store a plurality of frames (frame images, screens).

  The image sensor 38B performs photoelectric conversion in accordance with incident light that has entered through the lens 38A, and generates second enlarged image data in accordance with the incident light. The lens 38 </ b> A is a lens having the narrowest angle of view compared to the lens 34 </ b> A provided in the first optical system 34 and the lens 36 </ b> A provided in the second optical system 36. A known CMOS image sensor or the like is used for the image sensor 38B. The second enlarged image data generated by the image sensor 38B is sequentially stored in the buffer 38C. The buffer 38C can store a plurality of frames (frame images, screens).

  Note that the image sensor 34B, the image sensor 36B, and the image sensor 38B generate image data having the same resolution and recording rate. Therefore, a plurality of types (three types in the present embodiment) of image data (wide-angle image data, first enlarged image data, and second enlarged image data) having different angles of view have equivalent image quality.

  With the above configuration, the second acquisition unit 16 has a plurality of types (three types in the present embodiment) of image data (wide-angle image data, first enlarged image data, second image) having the same image quality and different angles of view. (Enlarged image data) is acquired.

  The encoding unit 18 encodes each of three types of image data having different angles of view acquired by each of the first optical system 34, the second optical system 36, and the third optical system 38. Specifically, the encoding unit 18 reads and encodes the image data stored in each of the buffer 34C, the buffer 36C, and the buffer 38C.

  In the present embodiment, the recording device 12 stores first data, which will be described later, in the storage unit 32 in a format defined by an AVCHD (Advanced Video Code High Definition) (registered trademark). The format is an example and is not limited to this format.

  For this reason, in the present embodiment, the encoding unit 18 is configured as H.264. Based on the H.264 / MPEG-4 AVC format, each of three types of image data having different angles of view is encoded.

  The buffer 20 stores three types of image data (wide-angle image data, first enlarged image data, and second enlarged image data) encoded by the encoding unit 18 and having different angles of view.

  The calculation unit 22 has a larger angle of view in each of the three types of image data (wide-angle image data, first enlarged image data, and second enlarged image data) acquired by the second acquisition unit 16 and having different angles of view. Angle-of-view information indicating the corresponding position and range of narrow image data is calculated. The angle-of-view information is information indicating the corresponding position and range of the image data with a narrower angle of view in the image data with a wider angle of view. The angle-of-view information is indicated, for example, by a group of position coordinates of an area corresponding to the image data having a narrower angle of view in the image data having a wider angle of view.

  In other words, the calculation unit 22 includes two types of image data other than the image data having the narrowest angle of view (the most enlarged image) among the three types of image data having different angles of view acquired by the second acquisition unit 16. Each is a main image. Then, for each of the image data of these main images, each of the image data having a smaller angle of view than the image data of each main image is set as a sub image. Then, the calculation unit 22 calculates angle-of-view information indicating the position and range of each sub-image with respect to the image data of each main image.

  The main image is an image that is displayed on a display unit (details will be described later) provided in the playback device 14 when displaying a superimposed image (hereinafter, sometimes referred to as a PinP image (Pcture in Picture image)). The sub-image is an image that is displayed so as to overlap with a partial area of the main image when the PinP image is displayed.

  In the present embodiment, the calculation unit 22 uses image data with a wider angle of view (wider angle) as a main image, and image data with a smaller angle of view (more enlarged) than each main image as a sub-image. The angle-of-view information of the sub-image corresponding to the image is calculated.

  First, the calculation unit 22 compares frames paired in time for three types of image data having different angles of view stored in the buffer 34C, the buffer 36C, and the buffer 38C. Then, the calculation unit 22 sets each image of image data having a wider angle of view (wider angle) as a main image and each image of image data having a smaller angle of view (more enlarged) than each main image as a sub-image. The angle-of-view information of the sub-image corresponding to each main image is calculated.

  For this reason, in the present embodiment, the calculation unit 22 uses each image of the wide-angle image data as a main image, and subtracts each image of the first enlarged image data and the second enlarged image data having a narrower angle of view than each of the main images. As the image, the angle-of-view information of the sub-image corresponding to each main image is calculated. In the present embodiment, the calculation unit 22 uses each image of the first enlarged image data as a main image, and each image of the second enlarged image data having a smaller angle of view than each main image as a sub-image. The angle-of-view information of the sub image corresponding to the main image is calculated.

  Note that a known image processing method may be used for the calculation of the angle of view information. That is, since the image (sub-image) with a narrower angle of view is a part of the image (main image) with a wider angle of view, the calculation unit 22 compares frames that are temporally paired. Then, using a known image processing method, a corresponding area of the sub-image in each main image is specified, and the position and range of the specified area are calculated as angle-of-view information.

  FIG. 3 is a schematic diagram illustrating an example of field angle information calculated by the calculation unit 22.

  FIG. 3 shows an example of the angle-of-view information of the sub-image when the image of the first enlarged image data is the main image and the image of the second enlarged image data is the sub-image corresponding to the main image. The calculation unit 22 calculates angle-of-view information indicating the position and range of the region P corresponding to the image 44 of the second enlarged image data that is the sub-image in the image 42 of the first image data that is the main image. In the example illustrated in FIG. 3, the calculation unit 22 uses, as the angle-of-view information of the image 44 that is the sub-image corresponding to the image 42 that is the main image, the four corners of the region P corresponding to the image 44 in the image 42 that is the main image. The position coordinates ((X1, Y1), (X2, Y2), (X3, Y3), (X4, Y4)) are calculated.

  Returning to FIG. 2, the buffer 24 stores angle-of-view information indicating the position and range of each sub-image with respect to each main image calculated by the calculation unit 22. Specifically, the buffer 24 stores information indicating each main image and information indicating each sub-image for each main image in association with each other. Information indicating each main image includes identification information of wide-angle image data or first enlarged image data, and time information (imaging time) of an image of each image data. The information indicating each sub-image with respect to each main image corresponds to identification information of the first enlarged image data and / or second enlarged image data, time information (imaging time) of each sub-image, and each sub-image. Angle of view information in the main image.

  The multiplexer 26 stores three types of encoded image data (wide-angle image data, first enlarged image data, and second enlarged image data) stored in the buffer 20 and images stored in the buffer 24. The first data is generated by multiplexing the corner information. That is, the first data includes three types of image data having different angles of view (wide angle image data, first enlarged image data, and second enlarged image data) and angle of view information. The buffer 28 stores the first data generated by the multiplexer 26 and sequentially stores it in the storage unit 32.

  FIG. 4 is a schematic diagram showing the data structure of the image data and the first data. 4A is a schematic diagram showing image data (wide-angle image data, first enlarged image data, and second enlarged image data) encoded by the encoding unit 18 (in FIG. 4A, an image Data 50). FIG. 4B is a schematic diagram showing an example of the first data generated by the multiplexer 26 (see image data 52 in FIG. 4B). Note that the first data shown in FIG. 4B is first data generated by multiplexing two types of image data (wide-angle image data and first enlarged data) having different angles of view and angle-of-view information. It is a schematic diagram which shows.

  As shown in FIG. 4A, the encoded image data is composed of a plurality of transport packets 54. In FIG. 4A, S indicates a system packet, and V indicates a video packet. These transport packets include a packet identifier (PID).

  In FIG. 4B, AUD (Access Unit Delimiter) indicates a delimiter of image data. SPS (Sequence Parameter Set) includes information related to encoding such as the encoding mode of the entire sequence. PPS (Picture Parameter Set) is header information indicating the coding mode of the entire picture. SEI (Supplemental Enhancement Information) indicates additional information. In the present embodiment, the multiplexer 26 includes the angle of view information in this SEI. SLICE indicates actual image data. If interlaced, it indicates one field, and progressive indicates one frame of image data.

  The multiplexer 26 corresponds to the SEI of each frame of each encoded image data having a different angle of view, and the angle of view corresponding to the corresponding sub-image (image of the image data having a narrower angle of view corresponding to the image data). The first data is created by storing the information. A different value is assigned to the PID included in the transport packet of each encoded image data for each image data having a different angle of view. Therefore, the multiplexer 26 uses the PID of each encoded image data as identification information for each image data.

  Next, the playback device 14 will be described.

  The playback device 14 plays back an image based on the first data recorded in the storage unit 32 by the recording device 12.

  FIG. 5 is a schematic diagram showing the playback device 14. The playback device 14 includes a device main body 60, an operation unit 74, and a display unit 62.

  The display unit 62 displays a PinP image (superimposed image) in which another image is superimposed on one image, images of image data having different angles of view included in the first data, and the like. Examples of the display unit 62 include known display devices such as an LCD (Liquid Crystal Display).

  The operation unit 74 receives a playback mode instruction and the like from the user. Examples of the operation unit 74 include a voice recognition device such as a microphone, a mouse, a button, a remote control, and a keyboard.

  The playback mode includes a playback mode for specific image data (specific image playback mode) and a playback mode for PinP images (PinP image playback mode).

  When the user instructs the display unit 62 to display image data to be displayed and the playback mode, the operation unit 74 transmits a specific image playback instruction signal to the apparatus main body 60. . The specific image reproduction instruction signal includes identification information of image data to be displayed on the display unit 62 and information indicating the specific image reproduction mode.

  Further, when an instruction for the operation of the operation unit 74 by the user instructs an instruction for the PinP image reproduction mode, and target image data to be displayed as a main image and image data to be displayed as a sub-image, the operation unit 74 displays the PinP image A reproduction instruction signal is transmitted to the apparatus main body 60. In this PinP image reproduction instruction signal, the first identification information of the image data to be displayed as the main image on the display unit 62, the second identification information of the image data to be displayed as the sub image, and the PinP image reproduction mode are displayed. Contains information to indicate.

  The apparatus main body 60 displays, for example, a column of image data that can be reproduced by the reproducing device 14 on the display unit 62 so that the user can select it. Specifically, for each of a plurality of types of image data having different angles of view stored in a buffer 70 described later, a column of thumbnail images of a frame at a certain time, identification information of each image data, and the like are displayed on the display unit 62. indicate. Then, the apparatus main body 60 displays a message for prompting selection of the reproduction mode on the display unit 62. Then, when an instruction for the display target image data and a reproduction instruction are given to the display unit 62 according to an operation instruction of the operation unit 74 by the user, the operation unit 74 transmits a specific image reproduction instruction signal to the apparatus main body unit 60. That's fine. Further, when a playback instruction, a main image, and a sub-image of a PinP image are selected by a user's operation instruction on the operation unit 74, the operation unit 74 may transmit a PinP image playback instruction signal to the apparatus main body unit 60. .

  The operation unit 74 may further transmit various signals such as a start signal indicating the start of reproduction and an end signal indicating the end of reproduction to the apparatus main body unit 60 according to an operation instruction of the operation unit 74 by the user.

  The apparatus main body 60 acquires the first data stored in the storage unit 32, and displays the image data included in the acquired first data in a playback mode according to the instruction content instructed via the operation unit 74. It is displayed on the display unit 62.

  Specifically, the apparatus main body 60 includes a first acquisition unit 64, a buffer 66, a demultiplexer 68, a buffer 70, a buffer 72, a reception unit 76, a switching unit 78, a decoding unit 80, an extraction unit 82, a buffer 86, and a buffer 88. And a generation unit 90 (generation unit, second generation unit).

  The first acquisition unit 64 acquires the first data from the storage unit 32 and stores it in the buffer 66. The demultiplexer 68 converts the first data stored in the buffer 66 into a plurality of types of image data (wide-angle image data, first enlarged image data, and second enlarged image data) included in the first data and having different angles of view. And angle-of-view information.

  Then, the demultiplexer 68 associates a plurality of types of image data (wide-angle image data, first enlarged image data, and second enlarged image data) separated from the first data into the buffer 70 in association with the identification information of each image data. Store. The demultiplexer 68 corresponds to the identification information of the image data of each main image, the identification information of the image data of the sub image corresponding to each main image, the time information (imaging time) of each sub image, and the corresponding sub image. The angle-of-view information in the main image is stored in the buffer 72 in association with each other.

  The accepting unit 76 accepts various signals input via the operation unit 74 according to an operation instruction from the user. In the present embodiment, the reception unit 76 receives various signals such as a specific image reproduction instruction signal, a PinP image reproduction instruction signal, a start signal, and an end signal from the operation unit 74. Then, the reception unit 76 transmits these received signals to the switching unit 78 and the display control unit 91.

  The switching unit 78 switches the playback mode to either the specific image playback mode or the PinP image playback mode. When the switching unit 78 receives the specific image playback instruction signal from the receiving unit 76, the switching unit 78 switches the playback mode to the specific image playback mode. When the mode is switched to the specific image reproduction mode, the specific image reproduction instruction signal is output to the decoding unit 80, the extraction unit 82, and the generation unit 90.

  On the other hand, when the switching unit 78 receives a PinP image playback instruction signal from the receiving unit 76, the switching unit 78 switches the playback mode to the PinP image playback mode. When switching to the PinP image reproduction mode, the PinP image reproduction instruction signal is output to the decoding unit 80, the extraction unit 82, and the generation unit 90.

  The decoding unit 80 decodes the image data stored in the buffer 70. A known method may be used for the decoding process by the decoding unit 80. Specifically, the decoding unit 80 identifies the coding mode by interpreting SPS and PPS included in the first data, and performs decoding according to the identified coding mode.

  When receiving the specific image reproduction instruction signal from the switching unit 78, the decoding unit 80 reads the image data specified by the identification information included in the specific image reproduction instruction signal from the buffer 70 and decodes it. Then, the decoding unit 80 outputs the decoded image data to the buffer 88.

  Further, when receiving the PinP image reproduction instruction signal from the switching unit 78, the decoding unit 80 is specified by the first identification information of the image data to be displayed as the main image included in the PinP image reproduction instruction signal. The image data to be read is read from the buffer 70 and decoded. Then, the decoding unit 80 outputs the decoded image data to the buffer 88.

  The extraction unit 82 extracts an area corresponding to the sub-image to be displayed from the image of the target image data to be displayed as the main image on the display unit 62 based on the angle-of-view information.

  Specifically, the extraction unit 82 receives a PinP image reproduction instruction signal from the switching unit 78. The extraction unit 82 includes the first identification information of the target image data to be displayed as the main image on the display unit 62 and the second identification information of the target image data to be displayed as the sub-image included in the received PinP image reproduction instruction signal. Read. Then, the extracting unit 82 stores the identification information of the image data of the sub-image corresponding to each main image corresponding to the first identification information of the image data to be displayed as the read main image stored in the buffer 72. The second identification information of the image data to be displayed as the sub-image included in the PinP image reproduction instruction signal is specified. Then, the extraction unit 82 reads the angle-of-view information and time information corresponding to the identification information of the image data of the identified sub-image from the buffer 72.

  In addition, the extraction unit 82 receives the PinP image reproduction instruction signal, and reads the target image data to be displayed as the main image decoded by the decoding unit 80 from the buffer 88. Then, by extracting the position and range indicated by the angle-of-view information of the sub-image from each frame of the target image data to be displayed as the read main image, an area corresponding to the sub-image at the corresponding time is extracted. To do.

  Then, the extraction unit 82 stores the extracted image in the buffer 86 in association with the corresponding time information (imaging time) and the identification information of the corresponding sub-image.

  The extraction unit 82 includes a changing unit 84. The changing unit 84 changes the display size of the extracted image extracted based on the angle-of-view information to a display size predetermined as the size of the sub image displayed on the display unit 62.

  Note that resizing (changing) of the extracted image by the changing unit 84 is not essential, and may be performed as needed. That is, when the display size of the extracted image extracted based on the angle-of-view information matches the display size set in advance as the size of the sub-image displayed on the display unit 62, no change is necessary.

  When the generation unit 90 receives the specific image reproduction signal from the switching unit 78, the generation unit 90 sequentially transmits the image data stored in the buffer 88 to the display control unit 91. The display control unit 91 performs control to display an image of the received image data on the display unit 62. For this reason, the display control unit 91 performs control to display the image of the image data specified by the identification information of the image data to be reproduced on the display unit 62 included in the specific image reproduction instruction signal on the display unit 62.

  On the other hand, when the generation unit 90 receives the PinP image reproduction instruction signal from the switching unit 78, the generation unit 90 determines a predetermined position (for example, lower right of the screen) in the image (that is, the main image) of the image data stored in the buffer 88. And the like, a PinP image (superimposed image) is created by superimposing the extracted images at the corresponding times stored in the buffer 86. Then, the generation unit 90 sequentially transmits the PinP image data of the created PinP image to the display control unit 91. The display control unit 91 performs control to display the PinP image of the received PinP image data on the display unit 62.

  For this reason, when the PinP image reproduction instruction signal is received, the display control unit 91 does not use the image data of the sub-image to be displayed in the main image, but the extracted image extracted from the image data of the main image to be displayed. Is controlled to display on the display unit 62 a PinP image (superimposed image) that is superimposed on a predetermined position on the main image.

  Next, a recording process performed by the recording device 12 in the recording / reproducing device 10 of the present embodiment will be described.

  FIG. 6 is a flowchart showing the procedure of the recording process performed by the recording device 12.

  First, the second acquisition unit 16 acquires a plurality of types of image data having different angles of view (step S100). Each image data acquired by the second acquisition unit 16 is sequentially stored in the buffer 34C, the buffer 36C, and the buffer 38C. Stored in each.

  Next, the calculation unit 22 obtains more images in each of three types of image data (wide-angle image data, first enlarged image data, and second enlarged image data) having different angles of view acquired by the second acquisition unit 16. Angle-of-view information indicating the corresponding position and range of the image data with a narrow angle of view is calculated (step S102). With the processing in step S102, image data other than the image data with the narrowest angle of view among the image data acquired by the second acquisition unit 16 is set as a main image, and each sub-image for the image data of each main image Angle-of-view information indicating the position and range of (image data with a narrower angle of view) is calculated.

  Next, the calculation unit 22 stores the calculated angle-of-view information indicating the position and range of each sub-image with respect to each main image in the buffer 24 (step S104). By the processing in step S104, the buffer 24 stores information indicating each main image and information indicating each sub-image for each main image in association with each other.

  Next, the encoding unit 18 encodes each of the three types of image data having different angles of view acquired by the first optical system 34, the second optical system 36, and the third optical system 38 (steps). S106). Each image data encoded by the process of step S106 is sequentially stored in the buffer 20.

  Next, the multiplexer 26 stores in the buffer 24 three types of image data (wide-angle image data, first enlarged image data, and second enlarged image data) stored in the buffer 20 and having different angles of view. The first data is generated by multiplexing the obtained angle-of-view information (step S108). Then, the multiplexer 26 stores the generated first data in the storage unit 32 via the buffer 28 (step S110).

  Next, it is determined whether or not the apparatus main body 30 has received a signal indicating the end of recording in response to an operation instruction from an operation unit (not shown) (step S112). If a negative determination is made in step S112 (step S112: No), the process returns to step S102. On the other hand, if an affirmative determination is made in step S112 (step S112: Yes), this routine ends.

  Next, a reproduction process performed by the reproduction device 14 in the recording / reproduction device 10 of the present embodiment will be described.

  FIG. 7 is a flowchart showing the procedure of re-establishment processing performed by the playback apparatus 14.

  In the playback device 14, when power is supplied to each part of the device and the reception unit 76 receives a start signal indicating the start of playback from the operation unit 74, the playback process shown in FIG. 7 is executed.

  First, the first acquisition unit 64 acquires first data from the storage unit 32 (step S200). The first data acquired in step S200 is stored in the buffer 66.

  Next, the demultiplexer 68 converts the first data stored in the buffer 66 into a plurality of types of image data (wide-angle image data, first enlarged image data, and second enlarged image) included in the first data and having different angles of view. Image data) and angle of view information are separated (step S202). A plurality of types of image data (wide-angle image data, first enlarged image data, and second enlarged image data) separated from the first data by the process of step S202 are associated with identification information of each image data in the buffer 70. Stored. In addition, the angle-of-view information classified from the first data by the processing of step S202, that is, the angle-of-view information of each sub-image corresponding to each main image is stored in the buffer 72.

  Next, the switching unit 78 determines which one of the PinP image reproduction mode and the specific image reproduction mode is instructed by the user (Step S204). When the signal received from the operation unit 74 via the receiving unit 76 is a PinP image playback instruction signal, the switching unit 78 determines that the PinP image playback mode has been instructed by the user (step S204: PinP image playback). mode). Then, the switching unit 78 transmits the PinP image reproduction instruction signal to the decoding unit 80, the extraction unit 82, the generation unit 90, and the like, and then proceeds to step S206.

  In step S206, the decoding unit 80 reads and decodes the image data specified by the first identification information of the image data to be displayed as the main image included in the received PinP image reproduction instruction signal from the buffer 70 (step S206). ). Then, the decoding unit 80 outputs the decoded image data of the main image to the buffer 88.

  Next, the extraction unit 82 reads the angle-of-view information of the sub image corresponding to the image of the target image data to be displayed as the main image on the display unit 62 from the buffer 72 (step S208). In step S208, the extraction unit 82 includes the first identification information of the target image data to be displayed as the main image on the display unit 62 and the target image data to be displayed as the sub-image included in the received PinP image reproduction instruction signal. The second identification information is read. Then, the extracting unit 82 stores the identification information of the image data of the sub-image corresponding to each main image corresponding to the first identification information of the image data to be displayed as the read main image stored in the buffer 72. The second identification information of the target image data to be displayed as the sub-image included in the PinP image reproduction instruction signal is specified. Then, the extraction unit 82 reads the angle-of-view information and time information corresponding to the identification information of the image data of the identified sub-image from the buffer 72.

  Next, based on the angle-of-view information read in step S208 from the target image data to be displayed as the main image on the display unit 62 stored in the buffer 88 by the processing in step S206, the extraction unit 82 displays the display target. An area corresponding to the sub-image is extracted (step S210).

  Next, the generation unit 90 sets the corresponding time stored in the buffer 86 at a predetermined position (for example, the lower right of the screen) in the image (that is, the main image) of the image data stored in the buffer 88. A PinP image (superimposed image) on which the extracted images are superimposed is created (step S212). Then, the generation unit 90 sequentially transmits the PinP image data of the created PinP image to the display control unit 91.

  Next, the display control unit 91 performs control to display the PinP image of the received PinP image data on the display unit 62 (step S216).

  Next, the receiving unit 76 determines whether or not an end signal indicating the end of reproduction has been received from the operation unit 74. If an affirmative determination is made in step S216 (step S216: Yes), this routine is terminated. If a negative determination is made (step S216: No), the process returns to step S202.

  On the other hand, when the switching unit 78 determines in step S204 that the specific image reproduction mode is instructed by the user (step S204: specific image generation mode), the process proceeds to step S218. When the signal received from the operation unit 74 via the receiving unit 76 is a specific image reproduction instruction signal, the switching unit 78 determines that the specific image reproduction mode has been instructed by the user (step S204: specific image generation). mode). Then, the switching unit 78 transmits the specific image reproduction instruction signal to the decoding unit 80, the generation unit 90, and the like, and then proceeds to step S218.

  In step S218, the decoding unit 80 reads and decodes the image data specified by the identification information included in the received specific image reproduction instruction signal from the buffer 70 (step S218). That is, the decoding unit 80 decodes the image data selected as the target image data to be displayed on the display unit 62 by the user. Then, the decoding unit 80 outputs the decoded image data to the buffer 88.

  Next, the display control unit 91 performs control to display the image of the image data specified by the identification information of the image data to be reproduced on the display unit 62 included in the specific image reproduction instruction signal on the display unit 62. (Step S220). Then, the process proceeds to step S216.

  By executing the reproduction process, a PinP image in which an extracted image obtained by extracting a region corresponding to a sub-image from the target image data to be displayed as the main image is superimposed on the image of the target image data to be displayed as the main image. Can be displayed on the display unit 62.

  FIG. 8 is a schematic diagram showing a PinP image displayed on the playback device 14 of the present embodiment. FIG. 8A is a schematic diagram showing an image 92 of image data to be displayed as a main image. FIG. 8B is a schematic diagram showing an image 94 of target image data to be displayed as a sub-image. In this case, the reproduction processing is executed by the reproduction apparatus 14 according to the present embodiment, so that a region S corresponding to the image 94 as the sub image is extracted from the image 92 as the main image. FIG. 8C is a schematic diagram showing a PinP image 96. As shown in FIG. 8C, a PinP image 96, which is a superimposed image in which the extracted image SA of the extracted region S is superimposed on a predetermined position on the image 92 as the main image, is created and displayed.

  As described above, in the playback device 14 according to the present embodiment, when a PinP image in which another image is superimposed on one image is displayed on the display unit 62, the PinP image in which image data having different angles of view are superimposed. A PinP image in which an extracted image obtained by extracting a region corresponding to a sub-image from an image of target image data to be displayed as the main image is superimposed on an image of target image data to be displayed as the main image. Are displayed on the display unit 62. For this reason, a PinP image can be generated and displayed without performing resolution adjustment such as lowering the resolution of at least one of the images to be superimposed or thinning processing such as lowering the recording rate.

  For this reason, in the playback device 14 according to the present embodiment, the main image and the sub-image that is displayed on the main image and part of the sub-image displayed on the main image without being deteriorated in image quality are not affected by the PinP image. An image can be displayed. Therefore, in the playback device 14 according to the present embodiment, it is possible to suppress deterioration in image quality even when the superimposed image is displayed in a large size.

  Note that the recording device 12 and the reproducing device 14 in the recording / reproducing apparatus 10 of the present embodiment include a control device such as a CPU, a storage device such as a ROM and a RAM, an external storage device such as an HDD and a CD drive device, and a display. The apparatus includes a display device (display unit 62) such as a device and an input device (operation unit 74) such as a keyboard and a mouse, and has a hardware configuration using a normal computer.

  A program for executing each of the recording process and the playback process executed by the recording device 12 and the playback device 14 of the present embodiment is an installable format or an executable format file such as a CD-ROM, a flexible disk ( FD), CD-R, DVD (Digital Versatile Disk) and the like are provided by being recorded on a computer-readable recording medium.

  In addition, a program for executing each of the recording process and the reproduction process executed by the recording apparatus 12 and the reproduction apparatus 14 according to the present embodiment is stored on a computer connected to a network such as the Internet, and is transmitted via the network. You may comprise so that it may provide by downloading. Further, a program for executing each of the recording process and the reproduction process executed by the recording apparatus 12 and the reproduction apparatus 14 of the present embodiment may be provided or distributed via a network such as the Internet.

  In addition, a program for executing each of the recording process and the reproduction process executed by the recording device 12 and the reproduction device 14 according to the present embodiment may be configured to be incorporated in a ROM or the like and provided.

  In addition, although embodiment of this invention was described above, embodiment is shown as an example and is not intending limiting the range of invention. The novel embodiment can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. The above-described embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 10 Recording / reproducing apparatus 12 Recording apparatus 14 Reproducing apparatus 16 2nd acquisition part 18 Encoding part 22 Calculation part 26 Multiplexer 32 Memory | storage part 62 Display part 64 1st acquisition part 68 Demultiplexer 76 Reception part 76
80 Decoding Unit 82 Extracting Unit 90 Creating Unit 91 Display Control Unit

Claims (5)

First data including a plurality of types of image data having different angles of view, and angle-of-view information indicating corresponding positions and ranges of the image data having a narrower angle of view in each of the plurality of types of image data is acquired. A first acquisition unit;
Of the plurality of types of image data, first identification information of image data to be displayed as a main image when displaying a superimposed image in which a plurality of images are superimposed, and a sub-image superimposed on a partial area on the main image A receiving unit that receives second identification information of image data to be displayed,
An extraction unit that extracts an area corresponding to the image data specified by the second identification information from the image data specified by the first identification information based on the angle-of-view information;
A generating unit that generates a superimposed image obtained by superimposing the extracted image on the image data specified by the first identification information;
A display control unit that performs control to display the generated superimposed image on a display unit;
A playback device. The extraction unit includes a changing unit that changes the extracted image extracted to a predetermined display size,
The generation unit generates the superimposed image obtained by superimposing the changed extracted image on the image data specified by the first identification information.
The playback apparatus according to claim 1.   The playback apparatus according to claim 1, wherein the second acquisition unit acquires a plurality of types of image data having the same resolution and different angles of view. A second acquisition unit that acquires a plurality of types of image data having different angles of view;
Calculation for calculating angle-of-view information indicating the corresponding position and range of the image data with a narrower angle of view for each of the image data other than the image data with the largest angle of view among the acquired plural types of image data. And
A first generation unit that generates first data including the acquired plural types of image data and the calculated angle-of-view information;
A storage unit for storing the first data;
A first acquisition unit for acquiring the first data;
Of the plurality of types of image data, first identification information of image data to be displayed as a main image when displaying a superimposed image in which a plurality of images are superimposed, and a sub-image superimposed on a partial area on the main image A receiving unit that receives second identification information of image data to be displayed,
An extraction unit that extracts an area corresponding to the image data specified by the second identification information from the image data specified by the first identification information based on the angle-of-view information;
A second generation unit that generates a superimposed image in which the extracted image is superimposed on the image data identified by the first identification information;
A display control unit that performs control to display the generated superimposed image on a display unit;
A recording / reproducing apparatus. First data including a plurality of types of image data having different angles of view, and angle-of-view information indicating corresponding positions and ranges of the image data having a narrower angle of view in each of the plurality of types of image data is acquired. Steps,
Of the plurality of types of image data, first identification information of image data to be displayed as a main image when displaying a superimposed image in which a plurality of images are superimposed, and a sub-image superimposed on a partial area on the main image Receiving the second identification information of the target image data to be displayed,
Extracting a region corresponding to the image data specified by the second identification information from the image data specified by the first identification information based on the angle-of-view information;
Generating a superimposed image obtained by superimposing the extracted image on the image data specified by the first identification information;
Performing control to display the generated superimposed image on a display unit;
A playback method including:

Images