JP2010063066A - Moving picture reproducing apparatus - Google Patents

Moving picture reproducing apparatus Download PDF

Info

Publication number
JP2010063066A
JP2010063066A JP2008229512A JP2008229512A JP2010063066A JP 2010063066 A JP2010063066 A JP 2010063066A JP 2008229512 A JP2008229512 A JP 2008229512A JP 2008229512 A JP2008229512 A JP 2008229512A JP 2010063066 A JP2010063066 A JP 2010063066A
Authority
JP
Japan
Prior art keywords
frame image
operation
image
state
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2008229512A
Other languages
Japanese (ja)
Inventor
Tomoyuki Ogawa
智之 小川
Original Assignee
Nikon Corp
株式会社ニコン
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nikon Corp, 株式会社ニコン filed Critical Nikon Corp
Priority to JP2008229512A priority Critical patent/JP2010063066A/en
Publication of JP2010063066A publication Critical patent/JP2010063066A/en
Application status is Pending legal-status Critical

Links

Images

Abstract

<P>PROBLEM TO BE SOLVED: To provide a moving picture reproducing apparatus in which a frame image preferable for a user is selected in accordance with contents of the frame image in a momentary pause operation. <P>SOLUTION: The moving picture reproducing apparatus includes an operation unit, a feature extraction unit and a frame image selection unit. The operation unit receives a moving picture reproducing operation including a pause operation. In the case that the operation unit receives pause operation during the reproduction of moving picture data constituted of a plurality of frame images, the feature extraction unit extracts features of an image for each frame image in accordance with predetermined procedures from the frame images under pausing before pausing and/or after pausing. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a moving image reproducing apparatus that reproduces moving image data including a plurality of frame images.

A moving image playback device is usually provided with a pause function for temporarily stopping a moving image being played back (see, for example, Patent Document 1).
JP 11-341425 A

  In the conventional pause function, of course, the frame image at the time of pause is reproduced and displayed. In this case, depending on the content of the frame image, an image that is undesirable from the viewpoint of the user may be reproduced and displayed.

  For example, when playing back a moving image of a person, a frame image in a blinking state continues continuously in a scene in which the face of the person is raised. In this case, depending on the timing of the user's pause operation, the user pauses with the eyes completely closed or with the eyes fully open. However, stochastically, it is often paused in other states (for example, a state where the eyes are half open). When paused in this state, a frame image with an unintentional facial expression of the person is selected and displayed on the monitor. Therefore, an undesirable result is obtained.

  In addition, the above description can be applied not only to a pause operation but also to a seek operation for starting playback of a moving image from a predetermined screen. That is, depending on the frame image at the start of playback, a frame image with half-open eyes may be selected as the frame image at the start of playback. In this state, a frame image of an unintentional facial expression of a person is first selected and displayed on the monitor, and then reproduction is started. Therefore, an undesirable result is obtained.

  SUMMARY OF THE INVENTION An object of the present invention is to provide a moving image playback apparatus in which a frame image preferable for a user is selected according to the contents of a frame image during a pause operation or a seek operation.

  The moving image reproduction apparatus according to the first invention includes an operation unit, a feature extraction unit, and a frame image selection unit. The operation unit receives an operation for reproducing a moving image including a pause operation. When the operation unit accepts the pause operation during the reproduction of moving image data composed of a plurality of frame images, the feature extraction unit is at the time of the pause, before the pause, and / or after the pause. Image features are extracted from the frame image for each frame image according to a predetermined procedure. The frame image selection unit selects a frame image at the time of final suspension based on the features extracted by the feature extraction unit.

  A moving image reproduction apparatus according to a second invention includes an operation unit, a feature extraction unit, and a frame image selection unit. The operation unit receives an operation for reproducing a moving image including a seek operation for starting reproduction of a moving image from a predetermined screen. When the operation unit accepts the seek operation, the feature extraction unit extracts image features according to a predetermined procedure from the frame images at the start of playback and before and / or after the start of playback. To do. The frame image selection unit selects a final frame image at the start of reproduction based on the features extracted by the feature extraction unit.

  In a third aspect based on the first aspect or the second aspect, the feature extraction unit extracts a face area from the frame image, and extracts eyes from the face area, and the degree of blinking And a blink detection unit for detecting. The frame image selection unit includes a blink determination unit that determines a first state in which the eyelid is closed or a second state immediately before switching from the state in which the eyelid is opened to the closing operation based on the degree of blinking. The frame image selection unit selects the frame image in the first state or the frame image in the second state as the frame image at the time of final pause or start of reproduction.

  In a fourth aspect based on the third aspect, the frame image selection unit can switch between the frame image in the first state and the frame image in the second state by a user input as a frame image at the time of pause or playback start. select.

  According to the moving image reproduction apparatus of the present invention, it is possible to select a frame image preferable for the user in accordance with the content of the frame image when performing a pause operation or a seek operation.

(First embodiment)
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a block diagram showing a configuration of a DVD (Digital Versatile Disc) player 1 which is an embodiment of a moving image reproducing apparatus. As shown in FIG. 1, the DVD player 1 includes a medium drive unit 2, a buffer memory 3, a decoder 4, an image memory 5, a display interface 6, a control unit 7, an operation unit 8, and a bus 9. Is provided. The DVD player 1 is connected to an external monitor 100 via a cable. In addition, a DVD disk 10 as a recording medium is loaded in the medium drive unit 2.

  The medium drive unit 2 includes a motor drive control unit (not shown) that drives the spindle motor. The medium drive unit 2 rotates the DVD disk 10 via a motor drive control unit, and includes a plurality of frame images encoded by an optical head unit (not shown) in accordance with, for example, the MPEG (Moving Picture Experts Group) standard. Read video data. Note that the MPEG standard is an example, and may be another standard, and is not particularly limited to the standard for moving image data.

  The buffer memory 3 is a memory that temporarily stores the moving image data read by the medium drive unit 2. The decoder 4 sequentially decodes the encoded frame images temporarily stored in the buffer memory 3. Thereby, the compressed frame image is expanded. The image memory 5 temporarily stores the decoded frame image.

  The display interface 6 provides an interface for displaying a moving image on the monitor 100.

  The control unit 7 is a processor that controls the DVD player 1. For example, in the case of moving image reproduction, the control unit 7 instructs the medium drive unit 2 to read out the moving image data and temporarily store it in the buffer memory 3. In the control unit 7, the feature extraction unit 7a and the frame image selection unit 7b are constructed by incorporating the program A shown in FIG.

  FIG. 2 is a schematic diagram of the program A executed by the control unit 7. The feature extraction unit 7 a includes a face detection unit 70 and a blink detection unit 71.

  The face detection unit 70 detects a face from the image displayed on the monitor 100. Further, the face detection unit 70 extracts feature points constituting the facial organ based on the detected face. The face detection unit 70 extracts facial feature points by a feature point extraction process described in Japanese Patent Laid-Open No. 2001-16573 as an example. Examples of feature points include eyebrows, eyes, face contour points, and the like.

  The blink detection unit 71 extracts facial eyes from the feature points extracted by the face detection unit 70, and detects the degree of blinking by blink detection processing described in, for example, Japanese Patent Application Laid-Open No. 2007-316762. As the blink detection process, for example, the degree of blink may be detected by a blink detection process described in JP 2000-235468 A.

  The frame image selection unit 7b determines, from the degree of blinking obtained by the blink detection unit 71, the first state in which the eyelid is closed or the second state immediately before switching from the state in which the eyelid is opened to the closing operation. Part 72 is provided. Then, the frame image selection unit 7b selects the frame image in the first state or the frame image in the second state as the final pause frame image (details will be described later).

  The operation unit 8 accepts operations such as moving image playback or stop, pause, fast forward, rewind, seek, and power on / off. The operation unit 8 receives user input through infrared communication using, for example, a remote controller for operation (not shown).

  Next, an example of the operation of the DVD player 1 which is an embodiment of the moving image reproduction apparatus will be described. Here, when the operation unit 8 receives an operation for reproducing a moving image by a user input, the control unit 7 reproduces a moving image at a frame rate of 60 fps, for example. In this case, a plurality of encoded frame images are temporarily stored in the buffer memory. Then, the frame image is decoded into a so-called FIFO (First-in First-out) equation. The decoded frame image is temporarily stored in the image memory 5. Then, the frame image is read from the image memory 5 and displayed on the monitor 100 via the display interface 6. In this state, when the operation unit 8 accepts a temporary stop, the following flowchart is executed. Note that the image memory 5 stores image data of a frame image displayed before the currently displayed frame image for a predetermined frame in preparation for a pause operation.

  FIG. 3 is a flowchart illustrating an example of an operation started after accepting a pause operation. This flowchart is based on the program A shown in FIG. 2, and the control unit 7 also functions as the feature extraction unit 7a (face detection unit 70 and blink detection unit 71) and frame image selection unit 7b (blink determination unit 72). Function.

  Step S101: Upon receiving a temporary operation from the operation unit 8, the control unit 7 reads a frame image currently displayed on the monitor 100.

  Step S102: The face detection unit 70 of the control unit 7 executes face detection processing.

  Step S103: The control unit 7 determines whether a face is detected. If a face is detected (step S103: Yes), the process routine proceeds to the process of step S104. On the other hand, a case where no face is detected (step S103: No) will be described later.

  Step S104: The blink detection unit 71 of the control unit 7 detects the upper eyelid edge of the face as a result of the eye extraction process from the feature points extracted by the face detection unit 70.

  Step S105: The blink detection unit 71 detects the degree of blink by blink detection processing described in Japanese Patent Application Laid-Open No. 2007-316762 as an example.

  FIG. 4 is a diagram illustrating an example of blink detection processing. FIG. 4 schematically shows image frames arranged in time series from FIG. 4A to FIG. 4J. Here, human blinking is approximately 100 to 150 msec, so a moving image of 60 fps corresponds to 6 to 10 frames. Therefore, if the blink detection unit 71 detects the degree of blinking for a frame instructed to be paused as necessary and several frames before and after the frame, the blink detection unit 71 is in a first state in which eyes are closed (a state in which the eyelid is closed ) And a frame in the second state where the eyes are completely open (a state immediately before the eyelid is switched from the open state to the closing operation) can be found.

  In FIG. 4, FIG. 4A corresponds to the frame image in the second state. Then, as the process proceeds from FIG. 4B to FIG. 4D, the eyelid closes, and the frame image in the first state is obtained in FIG. 4E. Further, as the process proceeds from FIG. 4 (f) to FIG. 4 (i), the eyelid opens, and the frame image in the second state is obtained in FIG. 4 (j).

  In this embodiment, the degree of blinking eyes is replaced with an evaluation value for determination. For example, the evaluation value of the frame image in the first state is set to 0.5, the evaluation value of the frame image in the second state is set to 1, and the other states (FIGS. 4B to 4D and FIG. The evaluation value of f) to FIG. Here, when a face is detected, the frame image in the second state is assumed to be a frame image displayed on the monitor 100 when paused.

  Step S106: The blink determination unit 72 of the control unit 7 first calculates the above-described evaluation value for the frame image at the time of pause.

  Step S107: If the evaluation value is 1 (step S107: Yes), the blink determination unit 72 proceeds to the process of step S108.

  Step S108: The frame image selection unit 7b of the control unit 7 selects the frame image in the second state as the frame image at the time of final suspension. Therefore, in this case, the frame image at the time of suspension is the frame image in the second state.

  Step S109: The control unit 7 causes the monitor 100 to display the frame image in the second state via the display interface 6. Then, this processing routine ends.

  If no face is detected in step S103 (step S103: No), the process proceeds to step S108, and the current frame image is set as the frame image at the time of pause. In step S <b> 109, the control unit 7 displays the current frame image on the monitor 100 via the display interface 6. Then, this processing routine ends.

  In step S107, if the evaluation value is not 1 (step S107: No), the blink determination unit 72 causes the process to proceed to step S101.

  In step S <b> 101, the control unit 7 reads the frame image immediately before the frame image at the time of suspension and performs face detection processing. For example, if the frame image at the time of suspension is the frame image of FIG. 4F in FIG. 4, the frame image of FIG. 4E temporarily stored in the image memory 5 is read. In this case, since the evaluation value is determined to be 0 when the process proceeds to step S107, the process returns to step S101 again.

  In this way, the control unit 7 determines the blinking degree of the frame image as shown in FIGS. 4 (d), 4 (c), and 4 (b), and finally the evaluation in FIG. 4 (a). The value is 1. Therefore, the control unit 7 displays the frame image of FIG. 4A on the monitor 100 via the display interface 6.

  In step S101, if a frame image in the second state cannot be obtained even if several frames before the frame image at the time of pause are read out, the frame images stored in the buffer memory 3 are sequentially read out. The same processing is performed.

  Therefore, if the control unit 7 reads out the frame image at the time of pause and the frame images before and after the frame image, the control unit 7 selects the frame image in the second state and displays it on the monitor 100 unless the scene of the moving image is suddenly switched. Can be made.

  In the above description, the frame image in the second state is the frame image at the time of pause, but the frame image in the first state may be the frame image at the pause. Further, the degree of blinking is determined based on the frame image at the time of suspension, and the frame image that is closest to the frame image with the eyes completely closed and the frame image with the eyes completely open is determined. It may be a frame image at the time of pause.

  Further, the frame image in the first state and the frame image in the second state are temporarily stored in the image memory 5, and the frame image in the first state and the frame image in the second state can be switched temporarily by user input. You may make it selectable as a time frame image. Thus, the monitor 100 can display either the first state frame image or the second state frame image according to the user's preference.

  As described above, according to the DVD player 1 which is an embodiment of the moving image reproducing apparatus, the frame image in the first state or the frame image in the second state is displayed on the monitor 100 during the pause, so the eyes are halfway. The frame image in the open state is not displayed on the monitor 100. Accordingly, a frame image (a frame image in the first state or a frame image in the second state) preferable for the user is selected according to the contents of the frame image.

  Next, a modification of the first embodiment will be described.

  In the first embodiment, the pause operation has been described as an example. However, the operation can be applied to a seek operation. In other words, when the user performs a seek operation for playback at a specified scene (time), if the human face is raised at the playback start scene, the eyes are opened halfway as in the pause operation. It may be in a state. In this case, the frame image in the first state or the frame image in the second state is displayed on the monitor 100 using the frame image of the scene at the start of playback and the frame images before and after the scene, in the same manner as described above. Can do.

Also, the frame image at the start of seek may be selected so as to be switchable between the frame image in the first state and the frame image in the second state by user input. Thus, the monitor 100 can display either the first state frame image or the second state frame image according to the user's preference.
<Supplementary items of the embodiment>
(1) In the present embodiment, the movement of the main subject focuses particularly on the eyelid opening / closing operation on the face of a person. This is an example, and for example, when a scene where a leaf crosses in front of a person pauses, a frame image in which the leaf hides the face of the person may be displayed on the monitor 100. In such a case, a configuration may be adopted in which one of the frames before and after the leaves do not hide the person's face is selected as the frame image at the time of pause.
(2) In the present embodiment, depending on the timing of pause, the scene may be paused at a scene change where the scene of the moving image is switched.
(3) In the present embodiment, the case where there is one main subject has been described. As a countermeasure when there are two or more subjects, for example, as a priority order, first, the second state is set for one main subject. And for other subjects, it may be determined whether the first state or the second state can be selected. Alternatively, the evaluation value may be divided into small stages, and a frame image having the maximum evaluation value may be selected. Alternatively, a configuration may be adopted in which a frame image in the first state or the second state is selected for each subject, temporarily stored in the image memory 5 and selected by the user.
(4) In this embodiment, the control unit 7 performs the face detection process, the blink detection process, and the blink determination process based on the image displayed on the monitor 100, but is temporarily stored in the image memory 5. You may perform directly with respect to the image data after an expansion | extension process was performed. The control unit 7 may display the frame image on the monitor 100, perform face detection processing, blink detection processing, and blink determination processing in parallel in real time, and store the results in the image memory. In this case, it is only necessary to refer to the image memory 5 for the image frame at the time of pause and the image frame before the pause, and the time until selection of the frame image to be reproduced can be shortened.
(5) The DVD player 1 of the present embodiment displays a moving image on the external monitor 100, but may be a monitor-integrated DVD player. Further, it may be a playback / recording type DVD player.
(6) The moving picture reproducing apparatus of the present invention is not limited to the DVD player 1 and may be a player with a built-in hard disk.

1 is a block diagram showing the configuration of a DVD player 1 that is an embodiment of a moving image playback apparatus. Schematic diagram of program A executed by control unit 7 A flowchart showing an example of an operation started after accepting a pause operation The figure which shows an example of blink detection processing

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... DVD player, 7a ... Feature extraction part, 70 ... Face detection part, 71 ... Blink detection part, 7b ... Frame image selection part, 72 ... Blink determination part

Claims (4)

  1. An operation unit that accepts an operation for moving image playback including a pause operation;
    When the operation unit accepts the pause operation during playback of moving image data composed of a plurality of frame images, from the frame images at the time of pause, before the pause, and / or after the pause, A feature extraction unit that extracts image features for each frame image according to a predetermined procedure;
    A frame image selection unit that selects a frame image at the time of final suspension based on the features extracted by the feature extraction unit;
    A moving image reproducing apparatus comprising:
  2. An operation unit for accepting an operation for reproducing a moving image including a seek operation for starting reproduction of a moving image from a predetermined screen;
    When the operation unit accepts the seek operation, a feature extraction unit extracts image features according to a predetermined procedure from frame images at the start of playback and before and / or after the start of playback. When,
    A frame image selection unit that selects a frame image at the start of final reproduction based on the features extracted by the feature extraction unit;
    A moving image reproducing apparatus comprising:
  3. In the moving image reproducing device according to claim 1 or 2,
    The feature extraction unit includes:
    A face detection unit for detecting a face region from the frame image;
    A blink detection unit that extracts eyes from the face region and detects the degree of blink;
    The frame image selection unit
    From the degree of blinking, a blink determination unit for determining a first state in which the eyelid is closed or a second state immediately before switching from the state in which the eyelid is opened to the closing operation,
    The moving image reproduction apparatus, wherein the frame image selection unit selects the frame image in the first state or the frame image in the second state as a frame image at the time of final pause or reproduction.
  4. In the moving image reproducing device according to claim 3,
    The frame image selection unit selects the frame image in the first state and the frame image in the second state so as to be switchable by a user input as the frame image at the time of the pause or the start of reproduction. Video playback device.
JP2008229512A 2008-09-08 2008-09-08 Moving picture reproducing apparatus Pending JP2010063066A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2008229512A JP2010063066A (en) 2008-09-08 2008-09-08 Moving picture reproducing apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2008229512A JP2010063066A (en) 2008-09-08 2008-09-08 Moving picture reproducing apparatus

Publications (1)

Publication Number Publication Date
JP2010063066A true JP2010063066A (en) 2010-03-18

Family

ID=42189338

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2008229512A Pending JP2010063066A (en) 2008-09-08 2008-09-08 Moving picture reproducing apparatus

Country Status (1)

Country Link
JP (1) JP2010063066A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011158399A1 (en) * 2010-06-15 2011-12-22 パナソニック株式会社 Content playback apparatus, content playback method, and content playback program
JP2014183559A (en) * 2013-03-21 2014-09-29 Casio Comput Co Ltd Notification control device, notification control method and program
EP2960905A1 (en) * 2014-06-25 2015-12-30 Thomson Licensing Method and device of displaying a neutral facial expression in a paused video

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09107517A (en) * 1995-10-11 1997-04-22 Hitachi Ltd Change point detection control method for dynamic image, reproduction stop control method based on the control method and edit system of dynamic image using the methods
JP2006217391A (en) * 2005-02-04 2006-08-17 Seiko Epson Corp Printing based on moving image

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09107517A (en) * 1995-10-11 1997-04-22 Hitachi Ltd Change point detection control method for dynamic image, reproduction stop control method based on the control method and edit system of dynamic image using the methods
JP2006217391A (en) * 2005-02-04 2006-08-17 Seiko Epson Corp Printing based on moving image

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011158399A1 (en) * 2010-06-15 2011-12-22 パナソニック株式会社 Content playback apparatus, content playback method, and content playback program
JP2014183559A (en) * 2013-03-21 2014-09-29 Casio Comput Co Ltd Notification control device, notification control method and program
EP2960905A1 (en) * 2014-06-25 2015-12-30 Thomson Licensing Method and device of displaying a neutral facial expression in a paused video

Similar Documents

Publication Publication Date Title
JP3897774B2 (en) Multimedia playback apparatus and menu screen display method
CN1305305C (en) Method and device of fast motion trick mode using non-progressive dummy predictive pictures
US5754770A (en) Information handling for interactive apparatus
KR101354311B1 (en) Image storage device, imaging device, image storage method, and recording medium
JP4331240B2 (en) Electronic apparatus and image display method
EP2294814B1 (en) Media reproduction for audio visual entertainment
US9143691B2 (en) Apparatus, method, and computer-readable storage medium for displaying a first image and a second image corresponding to the first image
US7466898B2 (en) Information processing apparatus and information processing method
JPWO2006082787A1 (en) Recording / reproducing apparatus, recording / reproducing method, recording medium storing recording / reproducing program, and integrated circuit used in recording / reproducing apparatus
US20070113182A1 (en) Replay of media stream from a prior change location
JP2003249057A (en) Enhanced navigation system using digital information medium
KR20070043618A (en) Image conversion apparatus, image signal processing apparatus, camera system and image signal processing method
JP2003507943A (en) System and method for performing fast forward and slow motion speed conversion in a video stream based on video content
KR20050061352A (en) Image displaying method and image displaying apparatus
US9781379B2 (en) Media recording for audio visual entertainment
EP1821306A2 (en) Image playback method, music processing method, image playback apparatus, and computer program product
JP2005065185A (en) Information signal processing apparatus, information signal processing method, information signal processing system, information signal processing method, information signal reproducing apparatus and information signal reproducing method
JP2009077227A (en) Imaging apparatus and its control method
US20110286720A1 (en) Electronic apparatus, video processing method, and program
CN101267522B (en) Information processing apparatus, imaging apparatus, image display control method
JP2010103843A (en) Electronic apparatus, and video display method
KR20050026850A (en) Image display method, image display program, and image display apparatus
JP3833653B2 (en) Information reproducing device, information reproducing device control method, content recording medium, control program, computer-readable recording medium containing control program
CN102906818A (en) Storing video summary as metadata
KR20080090934A (en) Normal speed reverse reproducing method and apparatus

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20110906

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20120223

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20120809

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20120814

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20121211