CN101146202A - Image data processing device, method, program and recording medium - Google Patents

Abstract

Disclosed is an image data processing apparatus which includes a recording part used for recording the content data containing movement image data encoded through a first format; a decoding part for movement images, used for reading-out the content data recorded at the recording part and decoding the movement image data; a non-animated picture coding part used for acquiring non-animated picture data corresponding to images displayed at the preconcerted time from the decoded movement image data out of the decoding part for movement images and coding the acquired non-animated picture data through a second format; and a time information establishing part used for establishing the information about the non-animated picture at the filmed time on the basis of the information added to the encoded movement image data.

Description

Image-data processing apparatus, method, program and recording medium

Technical field

The present invention relates to a kind of image-data processing apparatus, method, program and recording medium, more specifically, relate to a kind of image-data processing apparatus, method, program and recording medium that allows to identify the moment when the rest image that is extracted is taken from moving image.

Background technology

In recent years, in machine, can from motion image data, extract rest image such as DVD (digital versatile disc) register and HDD (hard disk drive) register.

And a kind of electron camera (for example, referring to JP-A-2000-295568 (patent document 1)) that can take rest image when moving image just is taken proposed.

Summary of the invention

But, be difficult to identify the shooting date of the rest image that from moving image, extracts and constantly.In other words, be difficult to identify during the part of the video pictures that in taking section at the fixed time, is write down.

On the other hand, by using when browsing rest image, show that the date and the moment when photographic images improved convenience concerning the user who browses this rest image such as the application software of a plurality of rest images of continuous demonstration of slideshow.

Correspondingly, wish the moment of sign when taking the rest image that from moving image, extracts.

According to embodiments of the invention, a kind of image-data processing apparatus is provided, comprising: recording section is used to write down the content-data that comprises by the coded motion image data of first form; The moving picture decoding part is used for the content-data of playback record at described recording section, and the described motion image data of decoding; The still image coding part is used for the motion image data of being decoded from by described moving picture decoding part, obtains the data with the corresponding rest image of image that shows at predetermined instant, and the Still image data of encoding and being obtained by second form; And time information establishment part, be used for creating the information in the moment that is taken about described rest image based on the information of adding coded motion image data to.

Described time information create part can based on coded motion image data in the shooting of the corresponding moving image of each chapters and sections constantly with by the count information that the reproduction time of being divided motion image data by scheduled unit time is created, create the information in the moment that is taken about described rest image.

Image-data processing apparatus may further include the moving image encoding part, is used for coming the encoding moving pictures data by described first form.In this case, being recorded in the motion image data that comprises in the content-data in the described recording section, is to write down after being encoded by described first form by described moving image encoding part as the data that DV (digital video) form provides.

Described time information is created part can create the information in the moment that is taken about described rest image based on the shooting of the image in the predetermined frame of multiplexing with described motion image data in coded motion image data and the described moving image that adds constantly with by described moving picture decoding partial decoding of h with reproduce the number of frames of described motion image data

Being recorded in the described motion image data that is comprised in the content-data in the described recording section can be the motion image data of coded by described first form in advance and supply.

According to another embodiment of the present invention, provide a kind of image processing method, comprise step: playback record comprises the content-data by the coded motion image data of first form and the described motion image data of decoding in tape deck; From the motion image data of being decoded, obtain data with the corresponding rest image of image that shows at predetermined instant; Based on the information of adding in the coded motion image data, create the information in the moment that is taken about described rest image; And together with the time information of being created, the Still image data of encoding and being obtained by second form.

According to another embodiment of the present invention, provide a kind of computer-readable program, comprise step: the control playback record comprises the content-data by the coded motion image data of first form and the described motion image data of decoding in tape deck; Control obtains the data with the corresponding rest image of image that shows at predetermined instant from the motion image data of being decoded; Control is created the information in the moment that is taken about described rest image based on the information of adding in the coded motion image data; And control follows the time information of being created, the Still image data of encoding and being obtained by second form.

According to another embodiment of the present invention, read the content-data of comprising that is recorded in the recording section by the coded motion image data of first form, and this motion image data of decoding.Then, with will be obtained in the corresponding view data of the image that predetermined instant shows, data as the rest image of view data, this view data is the motion image data of being decoded, and creates information about the moment when taking this rest image based on the information of adding coded motion image data to.Follow the time information of being created, the Still image data of encoding and being obtained by second form.

According to embodiments of the invention, can identify the moment when taking the rest image that from moving image, extracts.

Description of drawings

Fig. 1 is the block diagram that illustrates according to the structure example of the embodiment that uses recorder/player of the present invention;

Fig. 2 is the figure of the example of diagramatic content chapters and sections (chapter);

Fig. 3 illustrates the figure that has in the example of the information of the starting position of chapters and sections and the corresponding relation between its Counter Value;

Fig. 4 is the flow chart of the example of diagram still image capturing processing;

Fig. 5 is the flow chart of the example of diagram still image coding processing;

Fig. 6 is the figure of the shooting sign constantly of diagram rest image;

Fig. 7 is the figure that the information example of being added is shown;

Fig. 8 is shown in the information of being added and the figure of the relation between the GOP;

Fig. 9 is the flow chart of another example of diagram still image capturing processing;

Figure 10 is the flow chart of another example of diagram still image coding processing;

Figure 11 is the figure that illustrates with the structure of the content-data of HDV form;

Figure 12 is the figure that is illustrated in the detailed construction of the AUX-V frame of video among Figure 11;

Figure 13 is the figure of diagram PES structure;

Figure 14 is the block diagram that the functional configuration example of the software that will be carried out by the microcomputer among Fig. 1 is shown;

Figure 15 is the figure that the structure of REC DATE (record date) bag is shown;

Figure 16 is the figure that the structure of REC TIME (record constantly) bag is shown;

Figure 17 is the block diagram that another functional configuration example of the software that will be carried out by the microcomputer among Fig. 1 is shown; And

Figure 18 is the block diagram that the structure example of personal computer is shown.

Embodiment

Before following description embodiments of the invention, with following be described in described in specification and the accompanying drawing and the composition characteristic of illustrated the present invention and embodiment between corresponding relation.This description is to describe in specification or accompanying drawing and diagram support embodiments of the invention in order to guarantee.Therefore, as with the corresponding embodiment of composition characteristic of the present invention, in specification or accompanying drawing, describe or illustrated and not have the embodiment that describes at this, as if having, do not mean that they do not correspond to composition characteristic.On the contrary, embodiment described herein as those embodiment corresponding to composition characteristic, does not mean that this embodiment does not correspond to except that the composition characteristic these composition characteristics.

Image-data processing apparatus comprises according to an embodiment of the invention: recording section (such as the HDD among Fig. 1 152), and its record comprises the content-data by the coded motion image data of first form; Moving picture decoding part (such as the mpeg decoder among Fig. 1 171), it reads the content-data that is recorded in the recording section, and this motion image data of decoding; Still image coding part (such as the jpeg coder among Fig. 1 192), it obtains and will be in the corresponding view data of the image that predetermined instant shows, data as the rest image of view data, this view data is the motion image data of being decoded by moving picture decoding part, and by second form this view data of encoding; And time information establishment part (such as the microcomputer among Fig. 1 101), it creates the information about the moment when taking rest image based on the information that is added in the coded motion image data.

Image-data processing apparatus can also comprise moving image encoding part (such as the mpeg encoder among Fig. 1 123), and it comes the encoding moving pictures data by first form.The motion image data that is included in the content-data that will be recorded in the recording section can be supplied, and as the data with DV (digital video) form, and can partly be encoded by first form by moving image encoding before being recorded.

Image processing method according to another embodiment of the present invention comprises step: reads and comprises the content-data that passes through the coded motion image data of first form that is recorded in the recording section, and this motion image data of decoding (such as the processing among the step S201 of the step S101 among Fig. 4 or Fig. 9); Obtain with will be in the corresponding view data of the image that predetermined instant shows, as the data of the rest image of view data, this view data is the motion image data of being decoded (such as the processing in the step S221 of the step S121 of Fig. 5 and Figure 10); Based on the information of adding in the coded motion image data, create information about the moment when taking rest image (such as the step S123 in Fig. 5 or the processing among the step S224 among Figure 10); And follow the time information of being created, by second form Still image data that obtained (such as the step S124 among Fig. 5 or the processing among the step S225 among Figure 10) of encoding.

With reference to the accompanying drawings, embodiment of the present invention will be described below.

Fig. 1 is the block diagram that illustrates according to the structure example of the embodiment that uses recorder/player 100 of the present invention.

Recorder/player 100 among Fig. 1 is the HDD (hard disk drive) 152 that is recorded in such as the data from the content of the e-machine supply that is connected to recorder/player 100 as recording medium, read the content-data that is write down from HDD 152, and to the image and the voice signal of monitor 201 output contents that for example can be provided as television receiver.

Microcomputer 101 controls of recorder/player 100 are included in the piece in the recorder/player 100.For example, the operational example that can be undertaken by remote controller 103 by the user is as being received by control section 102, and from control section 102 to microcomputer 101 supplies with from the corresponding signal of user's order.Be supplied to the piece of recorder/player 100 by bus 104 from the various control signals of microcomputer 101 outputs, and the signal of the output of the piece from recorder/player 100 is supplied to microcomputer 101 by bus 104.

Terminal 121 is that supply comprises the terminal that the e-machine (such as camcorder (camcorder)) of content-data of image or voice data is connected, and also is the terminal of for example exporting with the content-data of DV form that camcorder was connected.

Decoded by DV decoder 122 from the content-data of terminal 121 supplies, and to mpeg encoder 123 outputs, as base band data.

Mpeg encoder 123 is encoded from the base band data of DV decoder 122 supplies by mpeg format, and exports it to stream damper 151.

Stream damper 151 keeps from the booking situation unit quantity of the coded content-data of mpeg encoder 123 supplies or the data from after a while the terminal of describing 131 being supplied, and exports it to HDD152.Coded content-data is recorded to HDD 152.In the process of recorded content data, microcomputer 101 is created the management information of the playback that is used for control content as requested in HDD 152, and this management information is according to the corresponding relation between this management information and content-data, and is recorded among the HDD152.

Terminal 131 is for example to export the terminal that camcorder connected of the content-data of the form that is different from the DV form.For example, output is by MPEG or be equal to the form compression and the camcorder of content encoded data can be connected to terminal 131.Therefore, the content-data of supplying from terminal 131 is supplied to stream damper 151, and need not to decode and encode by mpeg format once more.

In order under the control of microcomputer 101, to play the content that is write down, from HDD 152 to stream damper 151 output content data, and stream damper keeps from the predetermined playback unit quantity of the content-data (coded data) of HDD 152 supplies, and as requested it is exported to mpeg decoder 171.

Mpeg decoder 171 is decoded from the data encoded of stream damper 151 supplies, and exports the baseband images data of being decoded to video memory 172.The voice data of being decoded by mpeg decoder 171 is output to D/A converter 174.

Video memory 172 for example keeps the corresponding baseband images data of screen with predetermined quantity, and it is supplied to D/A converter 173.

D/A converter 173 is converted to the view data from the video memory supply can be by monitor 201 handled picture signals, and with them to monitor 201 outputs.This D/A converter 174 is converted to the voice datas of being supplied from mpeg decoder 171 can be by monitor 201 handled voice signals, and with them to monitor 201 outputs.

Based on the control signal from microcomputer 101, jpeg coder 192 obtains to remain on the view data in the video memory 172, and by jpeg format this view data of encoding.

For example, when the user who browses the image that shows as moving image on monitor 201 orders when catching image by remote controller 103, for example, microcomputer 101 control jpeg coders 192 come to obtain and the current corresponding view data of image that is displayed on the monitor 201 from video memory 172.

Be output to memory 193 by jpeg coder 192 coded image (rest image) data, and supply and records to HDD 152 by bus 104 from memory 193.

In order playing, under the control of microcomputer 101, to read from HDD 152, and be supplied to jpeg decoder 191 by the view data that jpeg format is coded by the coded view data of jpeg format.

Jpeg decoder 191 decoding from HDD 152 supplied by the coded view data of jpeg format, and data of being decoded to D/A converter 173 supplies.Then, D/A converter 173 is converted to the view data from jpeg decoder 191 supplies can be by monitor 201 handled picture signals, and to monitor 201 output image signals.

Therefore, recorder/player 100 can write down the content-data of being supplied by terminal 121 or terminal 131, and plays the content-data that is write down.In addition, recorder/player 100 can be caught the moving image of the content of just playing the user the desirable moment, and it is recorded as Still image data, and can play the Still image data that is write down.

In addition, can be added to the Still image data that is write down by recorder/player 100 such as date when taking rest image and information constantly.To describe such as the date when taking rest image and the interpolation of information constantly by recorder/player 100.

At first, be described in from by extract the content-data of terminal 121 supply and the situation of record rest image under such as the example of the interpolation of the information in the date when taking rest image and the moment.

To describe after a while, in recorder/player 100, from by the content-data of terminal 121 supply, extract and the process of record rest image in, date when photographic images and/or identify based on zero hour of chapters and sections constantly.

Fig. 2 is the figure of the example of diagramatic content chapters and sections.Fig. 2 illustrates the example of the content that for example comprises the moving image of being taken by camcorder, and line 301 instruction content data.In Fig. 2, at record or in playing, the left side of the moment from Fig. 2 flows to the right side.In this embodiment, be divided into a plurality of chapters and sections by line 301 indicated content-datas, such as chapters and sections 0, chapters and sections 1 and chapters and sections 2.

Chapters and sections are to be used to the management unit of the data of DVD video format or DVD VR form.In recorder/player 100, content-data by terminal 121 inputs according to the corresponding relation between management information and content-data, and is recorded among the HDD 152, this management information is created by microcomputer 101, is used at content-data chapters and sections being located.

In this case, chapters and sections comprise the data with the corresponding content of time period (image or image and sound) that is carved into the moment when the shooting end from when begin image taking by camcorder the time.In the example of Fig. 2, online 301 belows have provided to be taken constantly, and takes the moment of indication constantly when beginning to take chapters and sections.

In other words, take chapters and sections 0 and start from " 10:00 " constantly, end at (in the moment " 10:05 ") after five minutes.Take chapters and sections 1 and start from " 10:10 " constantly, end at (in the moment " 10:15 ") after ten minutes.Take chapters and sections 2 and start from " 11:03 " constantly, end at (in the moment " 11:05 ") after two minutes.Take chapters and sections 2 chapters and sections afterwards and start from " 11:05 " constantly.

To be described the shooting zero hour that how to identify chapters and sections after a while.

Provide Counter Value below the shooting in Fig. 2 constantly.Counter Value is from the message segment (piece) that provides continuously in chronological order of the beginning of the content-data of (such as a minute) at interval at the fixed time.When coming the played in order content with the order of chapters and sections 0, chapters and sections 1, chapters and sections 2 or the like in this case, the moment when beginning to play chapters and sections 0 is Counter Value " 0:00 ".The moment when the part (position of line more than 301) of play content is shown as Counter Value.Therefore, be " 0:05 " with the Counter Value of the starting position of the chapters and sections 1 that are played after five minutes moment when beginning to play chapters and sections 0.Counter Value with the starting position of the chapters and sections 2 that are played after 15 minutes moment when beginning to play chapters and sections 0 is " 0:15 ".

In recorder/player 100, for example, when in HDD 152, writing down the content-data of being imported by terminal 121, can create each of these Counter Values by microcomputer 101 based on signal from mpeg encoder 123 outputs.Then, as the part of management information of location chapters and sections in content-data, the information of setting up the corresponding relation between the starting position sum counter value of chapters and sections is created.

Fig. 3 is the figure that the example that is included in the information in the management information is shown, and this management information is the information that is based upon the corresponding relation between the starting position sum counter value of chapters and sections.As shown in Figure 3, provided the corresponding shooting moment sum counter value of section number and chapters and sections in corresponding mode.As mentioned above, refer to moment when beginning to take chapters and sections constantly in this shooting, and therefore refer to chapters and sections first image shooting constantly.

From the moving image of the content that just is being played, extracting rest image, and in the process of record data, can based on for shooting that every chapters and sections write down constantly the sum counter value identify the rest image that is extracted shooting constantly.

The data of the rest image that is extracted are encoded by jpeg format by jpeg coder 192, and are output to memory 193, and supply and records to HDD 152 by bus 104 from memory 193.

Described wherein by hour and the shooting explained of the unit that the divides example of sum counter value constantly, can by year, month, day phase for example or second unit explain and take sum counter value constantly.Perhaps, taking the moment or Counter Value can count with the unit that is different from the chronomere that is counted by common clock and explain.In other words, only when handling rest image, for example when showing rest image, comprise the shooting information constantly that can identify the rest image that from moving image, extracts necessarily.

With reference to the flow chart in the Figure 4 and 5, handle describing the still image capturing that is undertaken by recorder/player 100.When carrying out broadcast according to user's order, handle from terminal 121 supply and when being recorded in the processing of the content the HDD152.

In step S101, microcomputer 101 is play the moving image that is recorded in the content among the HDD 152.Here, as mentioned above, content-data is exported to stream damper 151 from HDD 152, and exports to mpeg decoder 171 from stream damper 151.Then, mpeg decoder 171 is decoded from 151 supplies of stream damper and coded data, and exports the baseband images data of being decoded to video memory 172.

In step S102, microcomputer 101 obtains the shooting moment Tx of the current chapters and sections of just playing.

In step S103, microcomputer 101 obtains the corresponding Counter Value ta of the shooting moment with the current chapters and sections of just playing.For example, based on reference to figure 3 described information, obtain Counter Value ta.

In step S104, microcomputer 101 has determined whether order capturing still image.If not, step S101 is returned in processing.Carry out subsequent treatment once more.

For example, when browsing the user who plays and be displayed on the moving image of the content on the monitor 201 by the processing among the step S101, when wanting that the current image that is just showing is left rest image, by the order of remote controller 103 to recorder/player 100 input instruction capturing still images.When the order of input instruction capturing still image, in step S104, determine to have ordered capturing still image, handle moving to step S105.

In step S105, microcomputer 101 carries out still image coding to be handled.Therefore, the image of playing and showing when order is caught is registered as Still image data.

With reference to the flow chart among the figure 5, with the details of the processing of the still image coding among the step S105 that describes among Fig. 4.

In step S121, microcomputer 101 control jpeg coders 192 obtain to remain on the view data in the video memory 172, and this view data is and the current corresponding view data of image that shows on monitor 201.

In step S122, microcomputer 101 obtains the Counter Value tb in the moment when playing by the view data that processing obtained in step S121.For example, based on the signal by mpeg decoder 171 outputs of the processing that is used to carry out play content, the Counter Value when being created in playback by microcomputer 101.

At step S123, microcomputer 101 calculates the shooting moment D of (being caught) rest image that will be recorded by following formula.

D＝(tb-ta）+Tx

Wherein, (tb-ta) refer to from when taking first image of chapters and sections the time be carved into time in the moment when the corresponding image of rest image taking and caught.By being added to moment Tx this time, calculate the shooting moment D of rest image when first image of taking chapters and sections.

With reference to figure 6, will further describe its details.In Fig. 6, come the instruction content data by line 301 as Fig. 2.Here, when when just playing chapters and sections 1, playing, ordered capturing still image (step S104) at the locational image of indicating by arrow 311.

Processing in step S102 and S103 obtains the moment " 10:10 " the shooting moment (taking the zero hour) Tx as chapters and sections 1, and obtains " 0:05 " as the Counter Value ta corresponding to moment Tx.

Then, in step S122, " 0:08 " during the image that obtains will to be caught by order when broadcast is as Counter Value tb.Therefore, apparently, passed through " 0:03 " from the moment when beginning to play chapters and sections 1 (the maybe moment when taking first image of chapters and sections 1).Therefore, with by the shooting of the indicated corresponding image in position of arrow 311 constantly D be identified as " 10:13 ".

Return with reference to figure 5, among the step S124 after the processing in step 123, microcomputer 101 is by being treated as the shooting of rest image constantly the shooting moment D that calculates by the processing in step S123, make the data of the rest image that jpeg coder 192 coding caught, and make HDD 152 record data encoded.Significantly,, come data, by jpeg format coding and records photographing moment D with rest image by embedding the part of shooting D conduct constantly with the photographing information of EXIF file format (exchangeable image file format).

In this way, from the moving image of being play, extract rest image, and identified, and be added in the data of rest image such as the information in the date when taking rest image and/or the moment.Then, record has the rest image of this information.

Data from the camcorder supply that for example is connected to terminal 121 described above are data of DV form, can supply the data of another form from the camcorder that is connected to terminal 121.In this case, can provide the decoder that adapts to this form to replace DV decoder 122.

Next, will be described under the situation of the rest image that content-data extracted and write down by terminal 131 supply, such as the example of the interpolation of the information in the date when taking rest image and the moment.

As mentioned above, terminal 131 be for example export the form that is different from the DV form content-data camcorder connected and for example export by MPEG or be equal to the form compression and the terminal that camcorder was connected of content encoded data.

In the camcorder that is connected to terminal 131, when taking its moving image, be added to image in the date, and the view data that has this information can be recorded in the recording medium such as shooting date and information constantly.For example, the content-data by camcorder output is by the coded content-data of mpeg format.For example, the information of being added as shown in Figure 7 (the information A RI DATA that is added) is by and coding multiplexing with content-data.

In Fig. 7, for example, RBP (with reference to byte location) refers to the relative byte location in grouping, and the information of being added to begin be " 0 ".Fig. 7 also is included in field name, description and the byte number of the byte location described in the RBP row.That of " reservation " refers to for the application in future and the field of reserving in the field name in Fig. 7 or the row of description.

The information of being added comprises additional record identifier, application message, record time information and video camera information.Additional record identifier can be used for be the identifier of the information of being added to Data Identification.Application message can comprise the trade name of having made given product.

As writing down time information, time zone and the record moment of record when each content of record in the field under field name " VOBU_LCL_TM_ZONE " and field name " VOBU_REC_TM ".The shooting that refers to content constantly at this record constantly and the shooting of the frame of the predetermined I-picture of coded view data constantly, and comprise the year, month, day phase, hour, divide and second.

Time zone during record can be a shift time of giving the UTC (universal coordinated time) of machine from defined by the user, and can be and the corresponding time difference of national time (local time) of using machine.

Information such as the condition that is provided with that is used to take (such as the F-number) is registered as video camera information.

For example, be based upon as shown in Figure 7 the information of being added and by the corresponding relation between each GOP (picture group) in the coded stream of mpeg format, and the information of being added from terminal 131 supplies.

In this example, as shown in Figure 8, GOP is constructed to from by a series of data segments of an I-picture the video flowing of the coded view data of mpeg format to next I-picture.In Fig. 8, " I ", " B " and " P " refer to I-picture, B-picture and P picture.The information of being added is as shown in Figure 7 added according to the data of " I (I-picture) " in Fig. 8, and supplies to recorder/player 100 from terminal 131.

For example, the information of being added as shown in Figure 7 is described as be in " the user data " in the sequence header included in the payload by PES (packetizing flows substantially) included in the mpeg format data encoded stream.Therefore, supply the information of being added from terminal 131, as the part of content-data.

Such as will add to by the camcorder that is connected to terminal 131 shooting information constantly in the view data, it is a kind of to be not limited to structure shown in Figure 7 that.Based on the standard of the machine that is connected to terminal 131, another information can be added to view data.In addition, the information that above-mentioned that be a kind of to be wherein to be added is stored in the example in the place from the data of terminal 131 supplies, and be not limited to be described to by that of " user data " in the mpeg format data encoded stream a kind of.In other words, only need to embed shooting information constantly, and do not influence coding or decoding processing on moving image about predetermined picture.

Coming by terminal 121 under the situation of recorded content, from the moving image of the content just play, extracting rest image, and write down this data.Here, based on the shooting of being write down constantly, can identify the shooting moment of the rest image that is extracted for every chapters and sections sum counter value.But, coming by terminal 131 under the situation of recorded content, based on constantly and the quantity of the frame of being play when from the moving image of the content just play, extracting rest image and writing down these data, can identify the shooting moment of the rest image that is extracted with reference to figure 7 recording of informations that add already described above.

In other words, the record in the information of being added refers to the moment when the I-picture taken in GOP constantly.Therefore, when providing order under the situation about just being played and come capturing still image at the picture that is not the I-picture, the shooting that can be carved into this image by based on the shooting of calculating in the number of frames during the playback that is played back to this image of I-picture from the I-picture time is institute's elapsed time constantly, and the shooting that identifies rest image constantly.

And in this case, the data of the rest image that is extracted are also encoded by jpeg format by jpeg coder 192, and are output to memory 193, and supply and records to HDD 152 by bus 104 from memory 193.

Although this described wherein with the year, month, day phase, hour, divide or second unit explain and take example constantly, can also be for example count and explain and take constantly with the unit that is different from the chronomere by common clock count.In other words, for example, when the demonstration of carrying out rest image is handled, only need to comprise shooting information constantly by its rest image that can identify from moving image to be extracted.

Next, with reference to the flow chart in figure 9 and 10, will another example of being handled by the still image capturing of recorder/player 100 be described.When playing from terminal 131 supply according to user's order and being recorded in the processing of the content the HDD 152, carry out this processing.

In step S201, microcomputer 101 is play the moving image that is recorded in the content among the HDD 152.Here, as mentioned above, this content-data is exported to stream damper 151 from HDD 152, and exports to mpeg decoder 171 from stream damper 151.Mpeg decoder 171 is decoded from the data encoded of stream damper 151 supplies, and exports the data of the baseband images of being decoded to video memory 172.

In step S202, microcomputer 101 obtains the shooting moment Ty as the I-picture of first picture of the current GOP that is just playing.With reference to the above-mentioned information of being added of figure 7, obtain to take Ty constantly based on for example.

In step S203, microcomputer 101 determines whether to have ordered capturing still image.If not, handle and turn back to step S201, and carry out subsequent treatment once more.

For example, when browsing the user who is play and be displayed on the moving image of the content on the monitor 201 by the processing in step S201 when wanting that the current image of just playing is left rest image, by the order of remote controller 103 to recorder/player 100 input instruction capturing still images.When the order of input instruction capturing still image, determine whether to have ordered capturing still image at step S203, and handle and move to step S204.

In step S204, microcomputer 101 carries out still image coding to be handled.Therefore, catch the image that time institute plays and show and be registered as Still image data when having ordered.

With reference to the flow chart among Figure 10, the details that the still image coding among the step S204 is handled among Fig. 9 will be described in.

In step S221, microcomputer 101 control jpeg coders 192 obtain to remain on the view data in the video memory 172, promptly with the current corresponding view data of image that shows on monitor 201.

In step S222, microcomputer 101 obtains frame counting information in the moment when playing by the view data that processing obtained in step S221.For example, frame counting information is following information, that is, this information can be based on the signal by mpeg decoder 171 outputs of the processing that is used to carry out play content, by sign from the moment when first picture (I-picture) of broadcast GOP up to the quantity of the shown frame of current time, and be provided.

In step S223, microcomputer 101 is based on about the information by the frame counter that processing obtained in step S222, calculate from when playing first picture (I-picture) of GOP the time be carved into the moment elapsed time tc of institute when the demonstration present image (or with captive image).In other words owing to specified number of frames about the information of frame counter, therefore show the needed time of this number of frames by calculating as the elapsed time tc of institute.

In step S224, microcomputer 101 calculates the shooting moment D of (being caught) rest image that will be recorded by following formula.

D＝tc+Ty

The elapsed time tc of institute refer to from when taking first image (picture) of GOP the time be carved into moment institute's elapsed time when the corresponding image of rest image taking and caught.Therefore, in other words, by being added to the shooting moment D that calculates rest image as the moment Ty of first image of taking chapters and sections this time.

Although described since about the information of frame counter can designated frame quantity thereby required time of display frame quantity by the example of calculating as the elapsed time tc of institute, yet can also by from mpeg decoder 171 to the information of microcomputer 101 supply about the timestamp of the picture that gives to be played, calculate the elapsed time tc of institute.

In step S225, microcomputer 101 is by being treated as the shooting of rest image constantly the shooting moment D that calculates by the processing in step S224, make the data of the rest image that jpeg coder 192 coding caught, and make HDD 152 record data encoded.Significantly, for example, by embed taking D constantly,, come data, encode and records photographing D constantly by jpeg format with rest image as the part of the photographing information of the file format (exchangeable image file format) of EXIF.

In this way, from the moving image of being play, extract rest image, and identified, and be added in the data of rest image such as the information in the date when taking rest image and/or the moment.Then, record has the rest image of this information.

Next, will describe such as will from by the content-data of terminal 131 supplies, extracting and another example of the interpolation of the information in the date during rest image of record and the moment when taking.Here, in this example, in recorder/player 100, provide terminal 131, as the terminal that camcorder connected of the content-data of exporting HDV (high definition video) form.

HDV is used for coming in the standard that writes down HDTV record images form such as the recording medium of DV tape with the compression efficiency that equates.As shown in figure 11, construct the content-data of the HDV form of supplying by terminal 131 with bag unit (Pack-Unit).

In Figure 11, a bag unit comprises AUX-A audio frame, bag-A, AUX-V frame of video, He Bao-V.Bag-A comprises four PES-A.Bag-V comprises three PES-V.Each of AUX-A audio frame, AUX-V frame of video, PES-A and PES-V is the grouping that is included in the bag unit, and is provided as by the defined PES of mpeg format (packetizing flows substantially).

Notice that bag-A and bag-V corresponding to it in an identical bag unit are called as bag-to (Pack-Pair).

PES-A and PES-V are storage and the sound of content and the grouping of corresponding voice data of image and view data.AUX-A audio frame, AUX-V frame of video are for example to store to be added to the packets of information of being added of voice data and view data.As shown in figure 11, there are four PES-A in an AUX-A audio frame, and there are three PES-V in an AUX-V frame of video.The PES-V storage I-picture of three PES-V or the view data of P-picture.The view data of two PES-V storage B-pictures subsequently.

Figure 12 is the figure that the detailed construction of the AUX-V frame of video among Figure 11 is shown.Figure 12 flatly illustrates the bit position from first bit (bit 0) to the 8th bit (bit 7).Figure 12 vertically illustrates from the byte location of first byte to the, 39 bytes.

As shown in figure 12, an AUX-V frame of video comprises 312 bytes (8 bits * 39).For example, first five bytes (first byte to the, five bytes) are the header information that comprises the information of describing keyword (keyword) and block length (length).

The 6th byte to the 16 bytes are bag-V information, and it is video mode that the tenth Eight characters saves the 31 byte, and its both storages are by the defined information of standard.

The 32 byte to the 35 bytes are time code (TTC), and the 36 byte to the 39 bytes are REC DATE.REC DATE comprises the information about the date when the image of content of shooting.Time code (TTC) comprises the information about the moment when the image of content of shooting.

More specifically, be about the date when the image of content of shooting or the information in the moment by each the data 401 to 424 of low four bits structure of data of 8 bits of the 32 to the 39 byte.

The information of the moon when information in the year when data 424 (year unit) are meant the image of settled content of shooting, data 423 (month unit) are meant the image of settled content of shooting.The information on the date when data 422 (day unit) are meant the image of settled content of shooting.Data 421 (time zone unit) are the shift times from the UTC that is defined machine by the user (universal coordinated time), and are about the information of description with the time zone of the corresponding time difference of national time (local time) of using machine.

Moment when data 404 (hour unit) are the image that specifies in when content of shooting " hour " information.The information of " branch " in the moment when data 403 (branch unit) are the image that specifies in when content of shooting.The information of " second " in the moment when data 402 (second unit) are the image that specifies in when content of shooting.

Data 401 (frame unit) are the information of time that is used to specify the more detailed unit of ratio " second " in the moment when the image of content of shooting the time, and can be the quantity of the frame that will be played.For example, when the moving image in a second comprises the image of 30 frames, increase progressively 1 by the described value of data 401 (frame unit) (quantity of frame) and mean and passed through 1/30 second.

In this way, with reference to time code (TTC) and the REC DATE (record date) in the AUX-V frame of video that is included in the content-data of HDV form, the date and the moment in the time of identifying the image when content of shooting.As above described with reference to Figure 11, in the content-data of HDV form, there are three PES-V in AUX-V frame of video, the date that is identified based on time code (TTC) and constantly and the REC DATE in each AUX-V frame of video be when take with a PES-V who is stored in corresponding three PES-V of AUX-V frame of video in the corresponding image of view data the time the date and the moment.

In other words, extraction is included in the AUX-V video data in the content data, based on date and the moment of time code (TTC) and REC DATE sign when the corresponding image of view data taking and be stored among the PES-V, carry out with reference to figure 9 and the identical processing of 10 described processing, rest image is extracted in permission from the moving image of being play, sign such as date when taking rest image and information constantly, this information is added in the data of rest image, and write down them.

Figure 13 is the figure that the structure example of PES is shown.In this example, PES is constructed to the data of 95 bytes, and first byte (byte location numbering: 5) be header.By analyzing the header of PES, whether can determine PES corresponding to one of AUX-A audio frame, AUX-V frame of video, PES-A and PES-V, and can extract the AUX-V frame of video that is included in the content data.

Figure 14 be illustrate with 101 performed by the microcomputer among Fig. 1, in order to play block diagram with the functional configuration example of the software of the content of HDV format record.

In Figure 14, the content-data that classified part 481 can the HDV form of playback record in HDD 152, and analyze the header of PES, thus PES is identified and is classified as one of AUX-A audio frame, AUX-V frame of video, PES-A and PES-V.

If this PES is PES-A or PES-V, then classified part 481 is to decoding output 482 these PES of output.482 controls of decoding output are supplied PES-A or PES-V by stream damper 151 to mpeg decoder 171.

If this PES is AUX-A audio frame or AUX-V frame of video, then classified part 481 is to analysis part 483 these PES of output.If from classified part 481 supply AUX-V frame of video, then analysis part 483 is based on time code (TTC) and the REC DATE of AUX-V frame of video, identifies the date and the moment when the corresponding image of view data taking and be stored among the PES-V.

Therefore, based on about date and information constantly when the corresponding image of view data taking and be stored among the PES-V who is identified by analysis part 483, carry out with reference to figure 9 and 10 processing of describing, from the moving image of being play the content of HDV form, extract rest image, sign is also added about the date when taking rest image and information constantly in the data of rest image, and record paper is relevant for the rest image of the information in the date and the moment.

Although described the obtained shooting moment of shooting moment Ty as the I-picture with reference to figure 9 and 10, this I-picture is first picture of the current GOP that is just playing, also the processing by in step S202 obtains shooting Ty constantly in this case, as the shooting time (comprising the date) of the view data of I among the PES-V who is stored in bag-V or P picture.

In addition, described with reference to Figure 10, in the processing of step S222 in the S224, calculating is from the elapsed time tc of demonstration institute that is played back to present image (or with captive image) of first picture (I-picture) of GOP after obtaining about the frame counting information of playback of image data, and the shooting that obtains (being caught) rest image that will be recorded D constantly, the processing in step S222 and S223 can be omitted in this case.

In other words, obtain to be stored in by the processing in step S202 I among the PES-V of bag-V or P picture view data shooting constantly, three PES-V (view data) are stored among bag-V as mentioned above.Therefore, the view data institute elapsed time from view data to the three PES-V of the PES-V of three PES-V can be considered enough weak points.Therefore, the shooting of the view data of a PES-V can be considered the shooting moment of the view data of the second or the 3rd PES-V constantly, and this has the low easily possibility of the user of reduction.Therefore, step S222 in Figure 10 and the processing among the S223 can be omitted.

Mention along band, described shooting based on the chapters and sections before the record and identified the date and/or the moment when from the content-data of being supplied by terminal 121, extracting rest image the zero hour with reference to figure 2, the example of the shooting zero hour (for example, as in the moment of the shooting among Fig. 2 in the described moment) that how to identify chapters and sections will be described below.

As mentioned above, when the content-data of being imported by terminal 121 is recorded among the HDD 152 in the recorder/player 100, by microcomputer 101 location chapters and sections.As mentioned above, each chapters and sections comprises and the corresponding content-data of time period that for example is carved into the moment when the shooting end from when begin image taking by camcorder the time.Therefore, for example, the view data of the content in chapters and sections be by camcorder from take the zero hour to the order of taking the finish time constantly shot image data continuously.

In other words, the shooting with the corresponding a plurality of image data sections of n chapters and sections is the shooting moment of order constantly.On the other hand, the finish time of the shooting of n chapters and sections, i.e. the zero hour of the shooting of the shooting of the last view data in the n chapters and sections moment and (n+1) chapters and sections, i.e. the shooting of first view data in (n+1) chapters and sections is discontinuous constantly.

The content-data of being imported by terminal 121 is the data of DV form.The data of DV form comprise a plurality of bags that are added to the view data (picture) about a frame that will describe after a while.Bag is the cell data of the data of system data in the data of storage DV form and five bytes.

Be called as " PC0 " in data as eight bits of first byte (first byte) in the bag of the data of five bytes.The data of eight bits of second byte are called as " PC1 ".The data segment of eight bits of the 3rd to the 5th byte is called as " PC2 " and arrives " PC4 ".

Distinguish the message segment that will be stored in the bag by the packet head value that is stored in " PC0 ".Bag with the bit stream " 01100010 " in packet head is a REC DATE bag.Bag with the bit stream " 01100011 " in packet head is a REC TIME bag.REC DATE bag is the bag of the information on the date of storage when being taken about the view data when the picture with this bag.REC TIME bag is the bag of the information in the moment of storage when being taken about the view data when the picture with this bag.

Figure 15 is the figure that the structure of REC DATE bag is shown.As shown in figure 15, the bit stream of packet head (" PC0 ") is " 01100010 "." PC1 " to " PC4 " comprises the information about the date when the captured image data.

More specifically, the data 501 to 504 of being constructed by low four bits of the data of eight bits of " PC1 " to " PC4 " are the information about the date when the described view data of shooting (image of content).

The information of the moon when information in the year when data 504 (year unit) are meant the image of settled content of shooting, data 503 (month unit) are meant the image of settled content of shooting.The information on the date when data 502 (day unit) are meant the image of settled content of shooting.Data 501 (time zone unit) are the shift times from the UTC that is defined machine by the user (universal coordinated time), and are about the information of description with the time zone of the corresponding time difference of national time (local time) of using machine.

Figure 16 is the figure that the structure of REC TIME bag is shown.As shown in figure 16, the bit stream of packet head (" PC0 ") is " 01100011 "." PC1 " to " PC4 " comprises the information about the moment when the captured image data.

More specifically, the data 521 to 524 of being constructed by low four bits of the data of eight bits of " PC1 " to " PC4 " are the information about the moment when the above-mentioned view data of shooting (image of content).

Moment when data 524 (hour unit) are meant the image of settled content of shooting " hour " information.The information of " branch " in the moment when data 523 (branch unit) are meant the image of settled content of shooting.The information of " second " in the moment when data 522 (second unit) are meant the image of settled content of shooting.

Data 521 (frame unit) are the information of time that is used to specify the more detailed unit of ratio " second " in the moment when the image of content of shooting the time, and can be the quantity of the frame that will be played.For example, when the moving image in a second comprises the image of 30 frames, increase progressively 1 by the described value of data 521 (frame unit) (quantity of frame) and mean and passed through 1/30 second.

In this way, when the content-data of being imported by terminal 121 was recorded among the HDD 152, microcomputer 101 can be analyzed the description in REC DATE bag and REC TIME bag, and obtained the shooting moment of the view data that will be recorded as requested.

When the content-data of being imported by terminal 121 was recorded among the HDD 152, microcomputer 101 monitored REC DATE bag and REC TIME bag, and detection has discontinuous date and view data constantly.For example, if based on be added to the current date that RECDATE bag and the REC TIME bag of the view data A that is recorded are obtained and constantly and the date that is obtained based on REC DATE bag and the REC TIME bag of the view data B that has just write down before being added to and constantly between passed through preset time section or longer, then detect discontinuous between view data A and the view data B.

Microcomputer 101 is recorded in the corresponding relation between discontinuous image data section and the new chapters and sections.In this case, for example, if view data A is registered as the view data of chapters and sections 1, then view data B is registered as the view data of chapters and sections 2.Microcomputer 101 records wrap the date and the moment that is obtained based on REC DATE bag that is added to view data B and REC TIME, as the moment when beginning to take chapters and sections 2.

Figure 17 be illustrate with 101 performed by the microcomputer among Fig. 1, in order to write down block diagram with the functional configuration example of the software of the content of DV format record.

In Figure 17, device driver 561 is device drivers of control DV decoder 122.When each DV decoder 122 was decoded for image (picture) data of a frame, device driver 561 output indications had been decoded to the signal of analysis part 562 about the view data of a frame.

If slave unit driver 561 has been supplied indication about the decoded signal of the view data of a frame, then analysis part 562 analyses are added to the REC DATE bag of view data and the description in the REC TIME bag.Then, analysis part 562 obtains the date and moment when the captured image data based on the analysis result about REC DATE bag and REC TIME bag.

Analysis part 562 is checked based on the information about the date and the moment that is obtained has discontinuous date and view data constantly.Have discontinuous date and view data constantly if detect, then this discontinuous view data is according to being recorded with the corresponding relation of new chapters and sections.In addition, wrap the date that is obtained and be recorded the moment of conduct when beginning to take new chapters and sections constantly based on REC DATE bag that is added to view data and REC TIME.Therefore, the shooting of chapters and sections can be identified the shooting moment " 10:00 " of chapters and sections 0 as shown in Figure 2, the shooting moment " 10:10 " of chapters and sections 1 and the shooting moment " 11:03 " of chapters and sections 2 zero hour, according to the shooting zero hour that is identified, chapters and sections are recorded.

Therefore, can be identified the zero hour with the corresponding chapters and sections of content-data of DV form.Therefore, by carrying out from the moving image of being play, to extract rest image, and can discern for example about date when taking rest image and information constantly with reference to figure 9 and 10 described processing.Therefore, the data with rest image of the information that is identified can be recorded.

Described wherein by the encoded example of the data of included moving image in the content-data that in HDD 152, write down of mpeg format, the present invention even can be applicable to following situation, if promptly as with reference to figure 2 and 3 described records shooting information constantly about moving image, if or as above with reference to figure 7 and 8 described records shooting information constantly, the data of then coming encoding moving pictures by other form about the predetermined picture in moving image.

Described the example of for example when playing the content-data that is recorded among the HDD 152, from moving image, extracting rest image, but the present invention is not limited to the situation of for example extracting rest image when playing the content-data that is recorded among the HDD 152 from moving image.For example, the present invention even can be applicable to following situation is for example shown in real time by the current quilt of the captured moving image of camcorder, and extract rest image from moving image.

Can carry out processing in series of steps by hardware and software.When the processing undertaken by software in the series of steps, the program that is included in the software is installed to the computer that is built-in with specific hardware or the general purpose personal computer 700 that for example wherein can realize function by installation procedure shown in Figure 180 from network or recording medium.

In Figure 18, CPU (CPU) 701 according to be stored among the ROM (read-only memory) 702 program or from storage area 708 to the program that RAM (random access memory) 703 reads, handle.As requested, RAM 703 also stores by CPU 701 and handles required data.

CPU 701, ROM 702 and RAM 703 are connected to each other by bus 704.Input/output interface 705 also is connected to bus 704.

Comprise keyboard and mouse importation 706, comprise display with for example CRT (cathode ray tube) and LCD (LCD) and loud speaker output 707, comprise the storage area 708 of hard disk for example and comprise modulator-demodulator and be connected to input/output interface 705 such as the communications portion 709 of the network interface unit of LAN card.Communications portion 709 communicates processing comprising on the network of internet.

As requested, driver 710 is connected to input/output interface 705, and as requested, is attached to wherein such as the removable medium 711 of disk, CD, magneto optical disk and semiconductor memory.As requested, be installed in the storage area 708 from its computer program of reading.

In order to carry out the processing in sequence step by software, from the program that comprises this software being installed such as the network of internet or such as the recording medium of removable medium 711.

Recording medium not only comprise with as shown in figure 18 part body discretely logging program and be distributed with program is sent to the user, comprise such as that of the removable medium 711 of disk (comprising floppy disk (registered trade mark)), CD (comprising CD-ROM (compact-disc-read-only memory) and DVD (comprising digital versatile disc)) and magneto optical disk (comprising MD (mini-disk) (registered trade mark)) a kind of, also comprise comprise record before be built in the part body and be distributed to user's the ROM 702 of program or storage area 708 in that of included hard disk a kind of.

The series of steps of carrying out above-mentioned processing in this manual comprises the step of the processing that will carry out in chronological order with described order, also comprises will walking abreast of needn't carrying out in chronological order or the processing that serial is carried out.

It should be appreciated by those skilled in the art that and depend on designing requirement and other factors, can carry out various modifications, combination, sub-portfolio and replacement, as long as they are in claims or its scope that is equal to.

The cross reference of related application

The present invention comprises and the Japanese patent application JP 2006-245949 theme of submitting in Japan Patent office on September 11st, 2006 and on October 2nd, 2006 respectively relevant with JP 2006-270960, and its full content is incorporated herein by reference.

Claims (9)

1. image-data processing apparatus comprises:

Recording section is used to write down the content-data that comprises by the coded motion image data of first form;

The moving picture decoding part is used for the content-data of playback record at described recording section, and the described motion image data of decoding;

The still image coding part is used for the motion image data of being decoded from by described moving picture decoding part, obtains the data with the corresponding rest image of image that shows at predetermined instant, and the Still image data of encoding and being obtained by second form; And

Time information is created part, is used for creating the information in the moment that is taken about described rest image based on the information of adding coded motion image data to.

2. image-data processing apparatus according to claim 1, wherein, described time information create part based on coded motion image data in the shooting of the corresponding moving image of each chapters and sections constantly with by the count information that the reproduction time of being divided motion image data by scheduled unit time is created, create the information in the moment that is taken about described rest image.

3. image-data processing apparatus according to claim 2 also comprises the moving image encoding part, is used for coming the encoding moving pictures data by described first form,

Wherein, being recorded in the motion image data that comprises in the content-data in the described recording section, is to write down after being encoded by described first form by described moving image encoding part as the data that DV (digital video) form provides.

4. image-data processing apparatus according to claim 1, wherein said time information create part based on the shooting of the image in the predetermined frame of multiplexing with described motion image data in coded motion image data and the described moving image that adds constantly with by described moving picture decoding partial decoding of h with reproduce the number of frames of described motion image data, create the information in the moment that is taken about described rest image.

5. image-data processing apparatus according to claim 4, wherein, being recorded in the described motion image data that is comprised in the content-data in the described recording section is the motion image data of coded by described first form in advance and supply.

6. image processing method comprises step:

Playback record comprises the content-data by the coded motion image data of first form and the described motion image data of decoding in tape deck;

From the motion image data of being decoded, obtain data with the corresponding rest image of image that shows at predetermined instant;

Based on the information of adding in the coded motion image data, create the information in the moment that is taken about described rest image; And

Together with the time information of being created, the Still image data of encoding and being obtained by second form.

7. computer-readable program comprises step:

The control playback record comprises the content-data by the coded motion image data of first form and the described motion image data of decoding in tape deck;

Control obtains the data with the corresponding rest image of image that shows at predetermined instant from the motion image data of being decoded;

Control is created the information in the moment that is taken about described rest image based on the information of adding in the coded motion image data; And

The time information of being created is followed in control, the Still image data of encoding and being obtained by second form.

8. a recording medium writes down according to the described program of claim 7.

9. image-data processing apparatus comprises:

Tape deck, record comprises the content-data by the coded motion image data of first form;

Moving image decoding apparatus, the content-data of playback record in described tape deck, and the described motion image data of decoding;

The still image coding device from the motion image data of being decoded by described moving image decoding apparatus, obtains the data with the corresponding rest image of image that shows at predetermined instant, and the Still image data of encoding and being obtained by second form; And

The time information creation apparatus based on the information of adding in the coded motion image data, is created the information in the moment that is taken about described rest image.

Images