KR20110129087A - Method and apparatus for replaying video contents - Google Patents

Method and apparatus for replaying video contents Download PDF

Info

Publication number
KR20110129087A
KR20110129087A KR1020100048520A KR20100048520A KR20110129087A KR 20110129087 A KR20110129087 A KR 20110129087A KR 1020100048520 A KR1020100048520 A KR 1020100048520A KR 20100048520 A KR20100048520 A KR 20100048520A KR 20110129087 A KR20110129087 A KR 20110129087A
Authority
KR
South Korea
Prior art keywords
video content
interrupted
time
content
resume
Prior art date
Application number
KR1020100048520A
Other languages
Korean (ko)
Inventor
김상엽
Original Assignee
(주)휴맥스
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by (주)휴맥스 filed Critical (주)휴맥스
Priority to KR1020100048520A priority Critical patent/KR20110129087A/en
Publication of KR20110129087A publication Critical patent/KR20110129087A/en

Links

Images

Classifications

    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/91Television signal processing therefor
    • H04N5/93Regeneration of the television signal or of selected parts thereof

Abstract

PURPOSE: A method and apparatus for replaying video contents are provided to automatically play image by properly selecting a section before a watching stop point. CONSTITUTION: If elapsed time is greater than set reference time, a control unit determines an amount of contents before a replay target(S221). A control unit determines a replay restart location of the contents before the replay target(S222). If the elapsed time is shorter than the set reference time, a user watches the interrupted recorded program from an interrupted location(S229). A decoder comprises a picture according to a set play speed(S224).

Description

Method and apparatus for replaying video content {Method and apparatus for replaying video contents}

The present invention relates to a method and apparatus for playing again after an interruption such as interrupting playback of video content such as a broadcast program or a video file.

As broadcasting channels by terrestrial, cable, satellite broadcasting, etc. are diversified and people's daily life becomes busy, users may reserve a broadcast program to watch and watch it at a desired time, for example, at midnight time. If a situation occurs that requires the user to stop watching while watching TV, he or she may request to record the program being watched and then go out. Users often watch a program at a convenient time after recording the broadcast program. In addition, various on-line services, such as IPTV services, for video content have become common, and users are provided with an environment in which users can select and enjoy the desired video content anytime, regardless of time. .

In this way, if the video content is always prepared in the user's playback device or remote server, and the user is unable to continue watching according to the personal situation or the physical and mental state, the user stops the current content playback and moves to a later view. You can watch from the position you saw in the following. Since the position at which playback was previously interrupted is normally stored automatically or by bookmark designation by the playback apparatus, playback is resumed from the position at which it was previously interrupted at the time of the resume request. At this point, the user must remember what he saw previously in order to understand the scenes from the resumed playback. This mental effort takes some time and thus prevents the focus on the currently played content.

An object of the present invention is to provide a method and apparatus for automatically inducing a user's memory by automatically playing previous contents when replaying video contents.

Another object of the present invention is to provide a method and apparatus for selectively determining whether playback of a previous part is necessary when replaying video content and selectively applying automatic play of previous content.

Another object of the present invention is to provide a method and an apparatus for appropriately adjusting an automatic playback amount of a previous portion in a subsequent viewing of video content.

The object of the present invention is not limited to the explicit purpose described above, and of course includes achieving the effect that can be derived from the specific and exemplary description of the present invention.

According to an aspect of the present invention, there is provided a method of performing a requested operation on an image content, the method comprising: identifying a location on the image content at which a previous interruption has occurred for the image content for which the operation is requested; In response to a predetermined operation, automatically determining a resumption position to be the previous of the identified interrupted position and causing the video content to be played from the determined resumption position.

In one embodiment according to the invention, the requested operation is to request play for the video content from the interrupted location.

In one embodiment according to the present invention, the interrupt is any one of stopping play of the video content, bookmarking, stopping transmission or reception of the video content data through a communication network, and powering off the device.

According to an embodiment of the present invention, when the time when the operation is requested is greater than a preset time when the time elapsed from the time of the interruption, the video content is played from the determined resume position.

In an embodiment according to the present invention, the time at which the operation is requested is determined based on the time elapsed from the time at which the interrupt occurred, and the time or data amount of the section in which the resume position is earlier than the interrupted position is determined. In the present embodiment, the resuming position may be determined in proportion to the elapsed time or the amount of time in the section before the interrupted position.

In an embodiment according to the present invention, a section in which the resume position is earlier than the interrupted position is determined based on a preset time or ratio.

In one embodiment according to the present invention, the video content is played at a speed faster than the normal speed from the resume position to the interrupted position. In this embodiment, based on the time or size of the section from the resume position to the interrupted position, it is determined how fast the video content is to be played at the speed higher than the normal speed.

In one embodiment according to the present invention, the method comprises: graphic information indicating a section including the resume position and the interrupted position on a screen on which the video content is visually represented, the interrupted position and the current play; And outputting an indicator to determine the location to be. In the present embodiment, before and after the interrupted position on the graphic information may be displayed to be visually distinguished from each other.

In one embodiment according to the present invention, if the setting value for designating whether to "automatically play the previous content" is checked, and if the setting value designates the automatic playback of the previous content as 'activated', the video content from the determined resume position is determined. Play the content, and play the video content from a position corresponding to the requested operation, for example, from the interrupted position, if the previous content automatic play is not designated as 'activated'.

In one embodiment according to the present invention, the video content may include a recorded broadcast program, video content recorded on a portable recording medium, video content downloaded or streamed through a communication network, and video streaming through a communication network. One of the content.

According to an aspect of the present invention, an apparatus for processing image content includes: a receiver for acquiring image content, a storage unit for storing the acquired image content, and a decoder for decoding and outputting data of the image content And a control unit for performing a control operation for acquiring, storing, and / or decoding the video content according to a user's request, wherein the control unit is configured to respond to an operation requested for the video content. And automatically determine a resume position to be a transfer of the position on the image content that has been previously interrupted for the image content and allow the decoder to decode the image content from the determined resume position.

In one embodiment according to the present invention, the control unit, to determine the reference information required to determine the resume position before the interrupted position, and to determine the play method for the interval from the resume position to the interrupted position Receives and stores necessary standard information through input means.

According to another aspect of the present invention, an apparatus for providing image content through a communication network includes a storage unit for storing image content, and a method for providing data of the image content to a client device in a streaming manner. A first processor and a responsive position to be a transfer of a position on the video content where a previous interruption to the video content was received in response to a request for the video content from the client device; And a second processor for automatically determining and controlling the video content from the determined resume position to be transmitted to the client device in a streaming manner by the first processor.

In one embodiment according to the invention, the request from the client device is a request for transmission of the video content from the interrupted location. In addition, in one embodiment according to the present invention, the interrupt may be any one of bookmarking of the video content and interruption of transmission of the video content data through a communication network.

At least one embodiment of the present invention described above and the present invention described in detail below, when the user wants to watch video content that has been stopped arbitrarily or by other means, following the stopping point again, The section before the interruption is appropriately selected and automatically played to help the user's memory of the video content, thereby allowing the user to quickly understand and immerse the content content after the point of interruption and enjoy the video content sufficiently.

FIG. 1 illustrates an example of a configuration of a digital broadcast receiver in which a method of reproducing video content from a previous point of a playback stop point according to an embodiment of the present invention is implemented, and FIG. 2 is an embodiment of the present invention. According to the present invention, an example of a flowchart of a method of automatically reproducing video content, for example, from the point where playback was stopped at the time of resuming a recorded broadcast program, and FIG. 3 shows audio / video data provided as a digital broadcast signal. 4 illustrates an example of a structure of a packet for transporting A, FIG. 4 illustrates an example of a structure of a recorded program file for a recorded broadcast program configured according to an embodiment of the present invention, and FIG. 5 illustrates the present invention. According to an embodiment of the present invention, a relationship between each data position related to the video content to be decoded and the video data separated in each storage means is illustrated. According to an embodiment, an example of a structure of a recording file list in which information according to an interrupt is stored together is illustrated, and FIGS. 7A and 7B illustrate a previously interrupted position at which a play of video content is to be resumed according to an embodiment of the present invention. Fig. 8 schematically shows each example of determining a position earlier, and Fig. 8 shows a time elapsed after interrupting a position earlier than a previously interrupted position to resume playing of the video content according to an embodiment of the present invention. 9 illustrates an example of a method of determining and reflecting the same. FIG. 9 illustrates an example of displaying a previously interrupted position and a play resume position together on a screen when resuming play of video content according to an embodiment of the present invention. 10 is recorded in the video content to determine a position earlier than a previously interrupted position to resume playing the video content according to an embodiment of the present invention. FIG. 11 is a diagram illustrating a process of obtaining a ratio between time information and data size, and FIG. 11 is a list of video content played in a streaming method in which information according to an interrupt is stored together according to another embodiment of the present invention. 12 is an example of a structure of FIG. 12, and illustrates a relationship between each data position related to decoding of streamed video content and video data separated in each storage means, according to another embodiment of the present invention. It is shown.

An embodiment of a method and apparatus for replaying video content from a point where it was interrupted according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a method of replaying a recorded program, which is one of video contents, or contents provided online at a remote location, from an interrupted point, for example, a playback stop point, according to an embodiment of the present invention. The configuration of the digital broadcast receiver is shown.

The digital broadcast receiver of FIG. 1 is a signal demodulator 9 that tunes a desired signal band in a broadcast signal, for example, a terrestrial, cable or satellite broadcast signal, and demodulates a signal of the tuned band in a digital stream. And a transport stream (SPTS) belonging to a single program selected from a transport stream (MPTS: Multi-Program TS) of the multiplexed program in the demodulated digital stream and management information (for example, PSI). Demultiplexer 10 for selectively outputting TS) and transport packets of the transport stream of the output single program into video, audio, and PSI data (eg, PES packets) A parser 11, a hard disk 13 for storing data of video content such as a broadcast program, and a separate output through the parser 11 , Or the buffer memory 12 for temporarily storing PES packets and the like are loaded from the hard disk 13 or the main memory 17; A decoder 15 which decodes the data stored in the buffer memory 12 and restores and outputs the original video and audio signals, and is connected to a network by wire or wirelessly to transmit / receive data to / from a designated remote place through the network. A data communication unit 16 for performing a protocol capable of performing a protocol, a main memory 17 for temporarily storing data for operations such as program recording or playback, and a screen signal for generating a video signal for a character, a symbol, a graphic symbol, or the like. A generator 18, a mixer 19 for synthesizing and outputting a video signal, and controlling the decoding operation of the decoder 15 with respect to data stored in the buffer memory 12 according to a user request; And a control unit 20 for further controlling the operation of each constituent means. The controller 20 includes a system memory 20a for a control operation and / or a setting environment, a real time clock (RTC) 20b for tracking a current date and time, and the main memory 17. And a file management system 20c executed to manage data writing and reading to and from the hard disk 13 through a file structure. Meanwhile, the configuration illustrated in FIG. 1 may be integrated with a TV or may be configured in the form of a device added to a computer or a notebook.

The controller 20 receives a request from a user through a conventional user interface, for example, a keypad, a remote controller, a touch pad, and if necessary, controls the screen signal generator 18 to guide a response according to the request. To output an image signal. The video signal is visually represented by an electronic device having a normal screen output function, for example, a TV, a monitor, or the like.

Hereinafter, embodiments of the present invention will be described in detail with reference to the digital broadcast receiver of FIG. 1 as an example, but the principle of the present invention is not limited to the name of the device, and any device having a function of processing image content or the same. Applicable to all devices with software that performs the function.

FIG. 2 is an example of a flowchart of a method of automatically playing from a point where playback is stopped upon replay of video content such as a recorded broadcast program according to an embodiment of the present invention. Hereinafter, an operation according to an embodiment of the present invention performed by the apparatus of FIG. 1 will be described in detail in parallel with the flowchart illustrated in FIG. 2.

First, a recording operation of a broadcast program, which is an example in which video content is generated, will be described. In a digital broadcast receiver having a configuration as illustrated in FIG. 1, when a user designates recording of a desired broadcast program through a normal input means, information related to it (channel or transponder number, program broadcast time zone, etc.) It is stored as a "reserved recording item" in the non-volitile system memory 20a in the control unit 20. In the state where the reserved recording item is set, the control unit 20 continues to present the current date and time (hereinafter, referred to as "time") of the RTC (Real-Time Clock) 20b. If the reservation is started, the broadcast signal corresponding to the channel (and subchannel) designated in the reservation recording item is synchronized.

According to the above tuning command, the signal demodulation unit 9 demodulates and outputs an RF signal corresponding to a designated channel (or repeater) into a digital stream, and the demultiplexer 10 receives a plurality of signals in a received digital stream. If there is a program of, a transport stream carrying video, audio and / or data belonging to one program corresponding to the designated subchannel is selectively outputted. Evidence information for the demultiplexer 10 to selectively output only a transport stream corresponding to one program in a digital stream is obtained in a corresponding tuning channel before the output of the transport stream and the buffer memory 12 may be obtained. IDs, or PIDs, of transport packets (hereinafter, abbreviated as "TP") that are identified from program specific information (PAT, PMT, etc.) stored in the. More specifically, the demultiplexer (PM) is obtained by obtaining PMT information from the PID of the PMT identified from the PAT included in the transmission packets with PID = 0 and identifying the PIDs of the transmission packets for each type of video and audio obtained from the PMT. 10) outputs only the transmission packets having the identified PID. Of course, the value of the PID of the transmission packet to be sorted and output is set in the demultiplexer 10 by the controller 20 confirming the PSI.

The parser 11 removes the header of each transport packet and collects only payload data for the received transport packets, as shown in FIG. 3, so that the packetized elementary stream (PES) is stored on the buffer memory 12. The packet is configured (31) and classified into attributes (for example, video, audio, or data) on the buffer memory 12 with reference to the header information of the configured PES packet. The attribute of the PES packet can be known by the value recorded in the stream ID 32 of the PES packet header. The controller 20 requests the file management system 20c to generate one file and stores PES packets classified and stored in the buffer memory 12 in the generated file.

The file management system 20c allocates a storage space on the hard disk 13 in response to a file creation request, and sequentially processes the PES packets input as input arguments of a subsequent recording command to the allocated space. Record as. The file management system 20c temporarily stores the data requested in real time in the main memory 17 in order to improve the storage speed, and when the threshold of the storage capacity is reached, the file management system 20c performs the direct memory access (DMA) method. It may be moved to the allocated space of the hard disk 13. In this way, when the recording of the broadcast program of the designated reserved recording item is ended, the control unit 20, the recorded time zone (date and time to know the start and end) for recording the program, Recorded item information including the name of a channel (and subchannel) or a broadcaster corresponding to the channel, and the like, is associated with the recorded program or in the file of the recorded program through the file management system 20c. Record it. The control unit 20 registers the file name of the recording file generated as described above, for example, in the recording file list in the system memory 20a. The recording item information recorded in the file may be stored in the recording file list in association with the file name.

As another method of recording a broadcast program, a reserved recording designated program can be recorded by directly recording the transport stream output from the demultiplexer 10 into the hard disk 13 without being classified into PES packets. In the above embodiment, when the recorded program is played back, data of a file corresponding to the recorded program read from the hard disk 13 is applied to the decoder 15. Data read from the disk 13 is applied to the parser 11.

The above-described recording operation and the configuration of the recording item information after the end of the recording and the listing in the recording file list can also be performed after the recording by the user's "immediate recording" request, rather than the execution of the scheduled recording.

When the user requests playback of a recorded item, the controller 20 searches for a list of recorded files in the system memory 20a and searches for files (or registered recorded item information) listed in the list. The obtained recorded program list is output on the screen via the screen signal generator 18, and the file management system 20c is requested to open the recorded program file corresponding to one item selected therefrom. In response to the request, the file management system 20c reads from the storage space on the hard disk 13 of the file through the FAT (File Allocation Table) managed by the file and loads the file into the main memory 17. . The reading at this time is performed by the relative position value specifying the read position and the read command specifying the size of the data to be read, to the file management system 20c. Of course, the file management system 20c reads from the hard disk 13 when the position to be read in the file corresponds to before or after the data loaded in the main memory 17. 17) to load.

Since the control unit 20 knows the structure of a file in which a part of data is loaded in the main memory 17, the start position (relative position from the head of the file) in which the data of the broadcast program is stored in the structure. Decoding command is given to the decoder 15 while sequentially moving to the buffer memory 12. According to this decoding command, the decoder 15 applies PES packets sequentially stored in the buffer memory 12 to the corresponding internal decoding module according to the type, and decodes and outputs the video and audio signals. . Through this process, the broadcast program of the recording item selected by the user is visually and audibly expressed to the user. The decoder 15 manages a position to read data from the buffer memory 12 as an "out pointer". This out pointer is a cyclic pointer written to a specific position of the buffer memory 12, and the decoder 15 reads data from the position indicated by the out pointer and indicates a position to read next. Update the value of the out pointer. Of course, the control unit 20 also manages a cyclic in-pointer corresponding to the out pointer to move data to the buffer memory 12 and the buffer memory 12 indicated by the in pointer. The data will be moved to the position on the image. When the out pointer approaches the in pointer on a circular path, a call is made to the file management system 20c to read a next position of a file currently open, thereby transferring subsequent data to the buffer memory 12. Filled up.

On the other hand, the control unit 20, the start position where the broadcast program data is stored, that is, the relative position from the beginning of the file (corresponding to "addrNs-addr00" in the example of Figure 4) (after, "image And the relative position from the video start position of the last data moved to the buffer memory 12 (hereinafter referred to as "moving data position" (video_moved_pos)). Continually monitor). FIG. 5 exemplarily shows the relationship between the above-mentioned positions and the image data separated in the storage means.

During the process as described above, if the user requests an interruption (interuption) to the current playback, for example, stop playback, power off (off), bookmark, etc., the controller 20 The interrupt position of the video data currently being visually represented by the decoder 15 is calculated. For example, in a situation in which the user requests an interruption for playback, as illustrated in FIG. 5, the controller 20 may determine the movement data position (video_moved_pos) 51 and the decoder 15. The size 53 between the positions indicated by the out_pointer 52 in use (this size means the size of the spaced apart distance on the path 52b through which the out-pointer circulates). It is subtracted from the moving data position (video_moved_pos) 51 and regarded as the interrupted position (int_pos) 55. That is, in the example of FIG. 5, the distance away from the video starting position video_starting_pos with respect to the data 52a of the position to be read next by the decoder 15 is regarded as the video position where the interrupt has occurred.

According to the above embodiment, when the interrupt position 55 is calculated, the controller 20 indicates that the video start position and the interrupt position, the time at which the interaction obtained from the RTC 20b is generated, and the interrupt have occurred. The indicating status value is stored in association with the item on the recording file list (for example, the second item of FIG. 6) for which interrupt was requested, as illustrated in FIG. 6 (61). In another embodiment according to the present invention, the time at which the interruption occurred may not be recorded.

According to the above-described embodiment, when the recording item information is recorded on the recording file list, and only the data of the video content is stored in the recording program file, the video start position is always 0. The information field for the same image start position is removed.

After recording the information according to the interruption as shown in FIG. 6, the controller 20 performs an operation according to the interruption. For example, when the interruption is interrupted, the decoder 15 instructs the decoding to stop, and when the operation is powered off, it switches to the standby mode. If the bookmark is requested, the current playback operation is continuously performed. Perform.

After the operation according to the interruption, a command for the user to return to the state before the interaction through the menu screen properly provided by the control unit 20 through the screen signal generator 18, for example, When a command such as a replay or a bookmark play for a recorded program that has been stopped is requested through an input means (S201 of FIG. 2), the control unit 20 displays a list of recorded files as shown in FIG. 6 in which the command is requested. The recording item information is checked (S202). If the value of the status field 62 of the checked recording item information is a value indicating that an interrupt has not occurred, for example, 0, “No” or “FALSE” (S211), an initial position of the corresponding recording program is shown. Start playback from (S219). For reproducing, the file management system 20c is requested to be opened with the corresponding recorded file name, and the data of the off file is read from the beginning through a read command and moved to the buffer memory 12 to decode the decoder 15. Activate the function.

If the value of the checked status field 62 is 1, “Yes” or “TRUE” (S211), the controller 20 indicates that the current time indicated by the RTC 20b is the interrupt occurrence time of the corresponding recording item. Check how long has passed from (S212). If the elapsed time is shorter than a preset reference time, for example, 12 hours or 24 hours (S221), the controller 20 reads the interrupt position and the image start position of the corresponding recording item and adds them to each other in the corresponding recording file. Determine the location of the data to read. As mentioned above, in one embodiment of the present invention, there may be no image start position field. In this case, of course, the interrupt position is the position of the data to be read. The control unit 20 requests the file management system 20c to open with the corresponding recorded file name, and then requests a read command using the determined position as an input factor for the opened file to record the program data recorded from the position. After being read, the read data is moved to the buffer memory 12 to activate the decoding of the decoder 15. Accordingly, the decoder 15 decodes and outputs the data loaded in the buffer memory 12 from a valid data portion, for example, a group of pictures (GOP), for the video configuration. According to this process, if the elapsed time is shorter than the preset reference time, the user can watch the recording program interrupted previously from the interrupted position (S229).

If the elapsed time identified above is equal to or greater than the preset reference time (S221), the controller 20 determines the amount of the previous content to be played back in order to execute "automatic playback of the previous content". To this end, as illustrated in FIG. 7A, a predetermined ratio (prev_ratio) to the identified interrupt location (int_pos), for example, 0.8, 0.85 or 0.9 (is not limited to this figure, and somehow other The video start position (video_starting_pos) is added to the value 71 obtained by obtaining the value (a) to determine the position of the data to be read from the recorded file, that is, the position at which to resume play (S222). Using the resume position 72 (det_pos) determined as described above, the decoder 15 decodes the image while reading the data of the recording file and moving it to the buffer memory 12 in the same process as described above. When outputted, the viewer returns to the state before the interruption, that is, the play state, from the point 72, which is 73 degrees before the interrupted position, for example, the position 74 which was stopped playing. It is much easier, faster and more understandable to develop the contents of video contents after the interrupted position. In this embodiment, the amount of the previous content to be played before the interrupted position is determined according to the size of the amount previously viewed by the user. That is, the more the viewer has watched before the interruption, the greater the amount of previous content to be automatically played.

In another embodiment according to the present invention, the amount of previous content for "automatic playback of previous content" may be determined at a predetermined time. FIG. 7B is an example for explaining a previous portion interval determined according to the present embodiment, and the previous portion is, for example, 1 minute, 3 minutes, or 5 minutes (it is not limited to this value; If it is specified as), the designated previous amount time (cT) is determined from the total time (RT = te-ts) of the program (identified from the recording time information 41 in the recording item information of FIG. 4). Quotient cT / RT, and the quotient Δbackward_size corresponding to the ratio cT / RT with respect to the recorded program section size RL (identified from the data section 42 in the recording item information in FIG. 4). = RL * cT / RT) is obtained first (75). Then, the control unit 20 obtains the position 76 obtained by subtracting the obtained Δbackward_size from the interrupted position int_pos (if the subtracted position is earlier than the image starting position video_starting_pos), the image start is performed. The position is determined as the subtracted position.) The position 76 is added to the video starting position video_starting_pos to determine a position 77 (det_pos) of data to be read from the recorded file (S222). By using the position det_pos determined as described above, the decoder 15 causes the decoder 15 to decode and output the data by reading the data into the buffer memory 12 in the same process as described above. Playback is performed from the point 77 preceding the interrupted position, for example, the position int_pos which has been stopped, for a specified time, for example, 1 minute, 3 minutes or 5 minutes.

In the above-described embodiments, the " previous automatic playback " is performed when the time elapsed after the interruption exceeds the preset reference time. In another embodiment according to the present invention, the " previous automatic playback " may be performed by determining the previous contents amount in proportion to the time elapsed after the interruption. For example, when the position of data to be read from the recorded file is determined according to one of the above-described embodiments, the determined position is adjusted according to the graph illustrated in FIG. 8 with respect to the determined position i_det_pos. According to the graph illustrated in FIG. 8, the read position f_det_pos, which is finally determined when the elapsed time has passed 48 hours, becomes the first determined position i_det_pos, or else according to the proportional expression 81 for the given graph. The read position f_det_pos is determined (S222), and the program data is decoded from the determined final read position. The graph illustrated in FIG. 8 is just one embodiment, and other functional formulas corresponding to various types of graphs may be used to determine the final read position.

In one embodiment according to the present invention, when the control unit 20 reads and decodes the data from the previous position of the interrupt position, which is selected in one of the above-described embodiments, The screen signal generator 18 is controlled so that the user knows the relative relationship with the interrupted position so that a guide screen of an appropriate type is superimposed on the output image. 9 shows an example of a guide bar displayed on the screen accordingly. In the example of FIG. 9, the previously interrupted position 91 and the position 92 of the data currently being decoded and output are displayed on an appropriately sized guide bar. To some extent on the guide bar 94. At this time, the portion 93 which has not been reproduced previously may be visually distinguished from the previously reproduced portion, for example, in a different color. Each position marked on the guide bar 94 includes the data size of the previously recorded video file, the video starting position (video_starting_pos), the interrupted position on the file, the calculated previous playback position (det_pos or f_det_pos), and The distance between the positions (that is, the data size) and the size of the program data corresponding to the length of the guide bar 94 are determined.

In one embodiment according to the invention, the control unit 20, if the current decoding position exceeds the interrupted position 91 to some extent or reaches the end 99 of the guide bar 94, The screen signal generator 18 is controlled so that the guide bar 94 and the marks 91, 92, and 93 disappear on the screen.

In one embodiment according to the present invention, when the above-mentioned "automatically replaying the previous contents" is performed, a trick play (also referred to as a "shift play") may be performed for the previous amount to be automatically reproduced. . For example, the regeneration rate for the previous volume can be normal, 2 times, 3 times, or 4 times normal speed (not limited to this value, but other values can be used). To this end, the control unit 20 reads the data in the file from the determined position (det_pos or f_det_pos), and when the decoder 15 decodes the playing speed of the determined trick play when the decoding speed is not the normal speed, the playing speed is determined. Is set in the decoder 15 (S223). The decoder 20 composes and outputs a picture according to the set reproduction speed. For example, at 2x speed, one picture of 2 pictures is decoded, and at 4x speed, one picture of 4 pictures is decoded and output (S224). The decoding method of the decoder 15 according to trick play may take one of various known methods. During the above-described trick reproduction, as the data moves sequentially, the out pointer (out_pointer) of the decoder 15 operating in the buffer memory 12 is stored at the interrupt position int_pos on the recorded program. When the data at the pointed position is reached (S231), the control unit 20 commands the decoder 15 to play normally. Accordingly, the data of the program is expressed at the normal speed from the interrupted position (S231). According to the present embodiment, the user can recover the memory from the previous amount which is reproduced at a higher speed, and from the unviewed section, the user can enjoy the content that is normally expressed based on the restored memory.

In another embodiment according to the present invention, the reproduction speed may be designated as "automatic". If the playback speed is designated as "automatic", the control unit 20 automatically determines the playback speed according to the size of the previous amount of playback to be determined according to one of the above-described embodiments. For example, if the previous amount to be played is 5 minutes or more, the playback speed is determined to be 4 times speed, 3 times to 3 minutes to 5 minutes, 2 times speed to 1 minute to 3 minutes, and 1 minute or less to normal speed (S223). When the amount of previous playback to be calculated is not the unit of time, but the size (back_size) of the total program size (RL), multiplied by the recording time (RT) of the program (RT * back_size / RL) ) Is compared with each of the reference intervals (for example, 5 minutes or more, 3 to 5 minutes, 1 to 3 minutes, 1 minute or less) to determine the playback speed.

In one embodiment according to the present invention, the above-mentioned "previous automatic playback" may be selectively performed according to the playback environment information set by the user. If the user has set "ON" for the "Automatically Play Previous Content" item in the appropriate playback environment setting menu window provided by the control unit 20, the above-mentioned "Automatically Play Previous Content" is performed, and the "OFF" is performed. If it is set, playback is performed from the interrupted position without performing the above-mentioned "automatic replay of previous contents". In addition, when the user sets the "automatic replay of the previous contents" item to "ON", the controller 20 may request the user to set necessary parameters accordingly. For example, it is required to set the reference time, the playback speed, and the ratio (prev_ratio) or the predetermined time for determining the previous content, which are the conditions for performing the "Previous Auto Play", as described above. After storing the value of each variable in the system memory 20a, the variable values may be used when performing the "auto replay of previous contents".

In the above, the principles and concepts of the present invention have been described in detail using the recorded broadcast program as an example. However, the automatic playback of previous contents according to the present invention is not limited to recorded broadcast programs, and the above description is also applied to image contents recorded on various portable recording media such as optical or magneto-optical disks. can do. It may also be performed for a video file downloaded and played through a network. This will be described in more detail. The moving image file existing on the communication network is downloaded from any server through the data communication unit 16 and stored in the hard disk 13. The control unit 20 starts an appropriate web browser to allow a user to select a desired video content, that is, a video file on a communication network, and interprets the information provided from an external server through the web browser to generate the screen signal generator ( 18) to be displayed to the user through the information, the user can know the desired video content. When one video content item is selected on the displayed page, the control unit 20 transmits source information associated with the video content item, for example, a URL, to the communication network through the data communication unit 16, thereby transmitting the information. The video content of the designated item is downloaded in accordance with the designated server and protocol, and the downloaded data is stored by the file management system 20c on the hard disk 13 as a video file. For files stored in this manner, a download file list of the form shown in FIG. 6 may be created.

If the video content received through the data communication unit 20 is not in a format decodable by the decoder 15, the control unit 20 activates an appropriate codec provided in advance to activate the decoder ( 15 may be re-encoded in a decodable format and then stored as a video file.

For the moving image file stored as described above, the above-described reproduction process and the automatic reproduction of the previous content after the interruption may be applied as it is. The controller 20 analyzes the header of the downloaded video file to confirm the video starting position (video_starting_pos) in the file, and then the data after the position through the buffer memory 12 through the decoder 15 in the same manner as described above. ), And when there is an interruption such as stopping playback from the user, the relative position (int_pos) from the start position of the video at that time is placed in the header of the file or in the appropriate field in the list of downloaded files created in the form shown in FIG. Record it. Of course, the interruption is also stored in association with the file. Subsequently, if there is a request for continuing the pre-interruption of the file, that is, a request for resuming or replaying the file, after confirming that the file is interrupted, the control unit 20 performs the method described in the above embodiments. According to the determined amount of the previous content of the interrupted position (int_pos) and the position to read on the file (det_pos or f_det_pos) according to the determined amount. From this determined position, data is decoded and output by the decoder 15 so that playback is resumed from a point before the interrupted position. The reproduction of the previous contents at this time may proceed to the shift state as in the above-described embodiments. In the case of determining the amount of previous contents according to the example of FIG. 7B, when the total playback time of the video is known from the header of the video file, the controller 20 regards the playback time as RT of FIG. 7B. The value of Δbackward_size is calculated. Since the size of the file stored through the file management system 20c can be known, the RL of FIG. 7B can be known through this.

In another embodiment according to the present invention, the ratio of data size and time is determined from the size of the video data to be played and the presentation-related time information (hereinafter, abbreviated as PTS or DTS: " time stamp "). By doing this, Δbackward_size of FIG. 7B may be calculated. This embodiment can be applied when the total playback time is not known from the header of the stored video file because the ratio of size to time is determined from the actual playback. To this end, the controller 20 receives a timestamp of a packet to be decoded from the decoder 15 when playback of the corresponding video file is started. If necessary, the decoder 15 is controlled to activate the external output of the timestamp. Upon receiving the first time stamp TS0 output (t1 in FIG. 10), the controller 20 reads out an out_pointer (the decoder 15 reads out) on the buffer memory 12 at that time. The position fpos_0 on the file of the data of the data pointer) is calculated according to the method illustrated in FIG. 5 (at the size of the data (ie, position) (video_moved_pos) moved to the buffer memory 12 for continuous monitoring. The decoder 15 at that time in the same manner after a predetermined playback time, e.g., 1 minute, 3 minutes or 5 minutes has elapsed (t2 in FIG. 10). The output timestamp TSe and the position fpos_e in the file of the data indicated by the out pointer are calculated. Using each value obtained in this manner, as in FIG. 10, the ratio of the data size to time, r_size_to_time {= (fpos_e-fpos_0) * clk_f / (TSe-TS0)} (where clk_f is the decoder ( The value counted by this frequency as the frequency of the clock used by 15) corresponds to a timestamp, and when the difference between any two timestamps is divided by the corresponding frequency, the actual time is obtained. The r_size_to_time obtained as described above is recorded in the header of the video file or in an appropriate field of the download file list created as shown in FIG. 6 when the playback of the video file is interrupted. After that, if there is a "continue request before interruption", for example, a resume request, in applying the embodiment of FIG. 7B, the size corresponding to the time is multiplied by multiplying the recorded r_size_to_time by the previous amount of time. Decide That is, in the embodiment of FIG. 7B, Δbackward_size is obtained by multiplying cT by r_size_to_time. Determination of the position to be reproduced after obtaining? Backward_size and subsequent reproduction or shift reproduction are made in the same manner as in the above-described embodiment.

In the above-described embodiments, all of the image content is provided in the apparatus of FIG. The present invention can be applied to a case in which the video content is not provided in the apparatus and provided in a streaming manner.

Typically, services such as IPTV or VOD provide video content in a streaming manner. The selection of the video content in the IPTV or VOD service or the like is appropriately exchanged with the server of the corresponding service through the data communication unit 16 as selected on the service use screen provided by the control unit 20 and the use screen. Is done through. This process may be accompanied by a process such as authentication of the user. When one video content is selected through an appropriate information exchange and selection process, the content is received by the data communication unit 16 via a communication network, and the data communication unit 16 receives a header or the like added for transmission. Remove and transfer to the control unit 20. On the other hand, the control unit 20, just before the start of streaming data, the information uniquely designating the selected item, for example, the URL for the item, as shown in FIG. 11, the system memory 20a The streaming list item 111 is generated in the c) and recorded in the corresponding field of the item (111a).

The control unit 20 creates a temporary file in a read / write mode in the file management system 20c to temporarily store the received data, and allows the received data to be recorded in the file. Accordingly, the streaming data received through the data communication unit 16 is stored in the hard disk 13 and / or the main memory 17. Simultaneously with the write operation, the control unit 20 requests the file management system 20c to read from the beginning of the file and moves the data read accordingly to the buffer memory 12. At this time, the value of counting the data to be moved is reflected in the variable of streaming_push_pos illustrated in FIG. 12 (corresponding to video_moved_pos in FIG. 5 described above when managing the data of the stored file). Then, the decoding function of the decoder 15 is activated so that the moved data can be decoded.

After that, if an interruption such as a play interruption or a data reception error occurs for the video content currently being reproduced and output, the control unit 20 is currently reading the decoder 15 as described above. The interrupt location 123 is calculated by subtracting the size between the out pointer 121 and the last data location 122 moved to the buffer memory 12 from the streaming_pus_pos. The calculated position and the time at which the interrupt was requested are recorded in the corresponding fields of the generated streaming list item 111, respectively (111b). If the play on the video content currently being reproduced and output is completed until the end point, the controller 20 deletes the corresponding item 111 on the previously generated streaming list, thereby interrupting the play during play on the streaming list ( Only the information on the video content that has been interrupted (playback interruption, operation power off, bookmarking, interruption of reception due to communication failure, etc.) is maintained.

After the interruption to the video content, when the user selects one video content from the content server on the communication network through the same process as described above for the playback of the new video content or previously played video content, the control unit 20 Searches for the source information of the selected video content, for example, the URL, in the streaming list prepared in the form shown in FIG. If the same URL is not found, the corresponding URL is transmitted through the data communication unit 16 so that the received streaming data is decoded and output in the manner described above.

If the same URL is found, it checks the interrupted time for that URL, and decides whether to perform "previous automatic playback" based on the confirmed time. The determination of whether to perform the "previous automatic reproduction" and the determination of the position to reproduce the previous contents according to the determination are made according to one of the methods in the above-described embodiments or a combination thereof. In this way, when the position to play the previous content is determined, data streaming from the determined position is requested for the corresponding content, that is, the currently selected URL. If there is a request for streaming by transmitting the corresponding URL before the request for streaming position adjustment, the streaming data received until the position adjustment request is discarded. When the server supports shift playback (hereinafter, referred to as “shift streaming”) for streaming data, the controller 20 requests a shift (for example, a shift determined in the above-described manner) streaming. It may be. At this time, the control unit 20 includes the interrupted position (int_pos2 of FIG. 11) to be streamed at the normal speed, and the shift information, in addition to the position of the previous content to start streaming, when the streaming resume request. Upon receiving such a request, the server performs streaming of the corresponding content from the requested starting position, but transmits some pictures at a specified speed while skipping, and normally streams when the normal speed position is reached.

The embodiments described so far have been directed to a terminal for receiving and playing image content. However, the concept and principle of the present invention is not limited to the terminal, but stores the video content, and when a request from the client is applied, it is also applicable to a server streaming the same through a connected local or wide area network. Can be.

To do this, the server maintains a "streaming interrupt list." The streaming interrupt list includes self-identification information (e.g. path name and file name) of a content that is bookmarked or that streaming is not completed and is interrupted, i.e., interrupted while streaming, or stopped due to communication failure. Information identifying the terminal (or user of the terminal) requesting the information, for example, the IP address of the terminal, or login information (user name, etc.) is stored as an entry, and the interrupted time, the interrupted The location is also stored for that entry. For quick retrieval, it is desirable to manage these streaming interrupt lists by user.

Thereafter, when there is a resume request for a content (including a play request through bookmark selection) from the user, the server first checks from the streaming interrupt list whether the content has been interrupted for the user. If the content is not interrupted, normal streaming starts. If the content is listed in the streaming interrupt list for the user, the content is transferred according to any one of the above-described embodiments or a combination thereof. The location of content streaming is decided and the previous contents are automatically played. In addition, with respect to the previous content that is automatically streamed, the variable speed streaming may be performed as in the above-described embodiment.

It is possible to set whether or not to execute the "previous automatic playback" on the server described above for each user. For example, as described above, the variables related to “previous automatic playback” (whether the automatic playback of the previous contents, the reference time for performing the automatic playback of the previous contents, the playback speed, the ratio for determining the amount of the previous contents, or Provide a window for querying the user for a certain time, etc., and save the setting values inputted through the user to the user playback environment, and then, based on the stored variable values when replaying the interrupted content of the user, Auto play content ”.

In the description of the above embodiment, the server has been described as a single device, but the server may be composed of a plurality of sub devices and / or processors. For example, a front-end sub-device (or processor) dedicated to communication with a client terminal, a subscriber DB sub-device storing subscriber information and the streaming interrupt list, and a content DB sub storing video content. The device may be configured as a main sub-device (or processor) that provides the subscriber with the intended service by responding to a request received from each sub-device through an interconnected dedicated network and transmitting necessary control commands. Under such a configuration as a multi-device (or processor), the above-described operation of determining the streaming position for the operation for the "previous automatic playback" may be performed by checking the streaming interrupt list stored in the subscriber DB sub-device. The actual streaming is performed by the main sub-unit, and the actual streaming is streamed from the content DB sub-unit to the client terminal from the determined position via the transposition sub-unit by the command of the main sub-unit.

On the other hand, the present invention is not limited to the above-described typical preferred embodiments, but can be carried out in various ways without departing from the spirit and the subject matter of the present invention in various ways that can be carried out in the art Those of ordinary skill can easily understand. If such improvement, change, substitution or addition is carried out within the scope of the appended claims, the technical spirit should also be regarded as belonging to the present invention.

9: signal demodulator 10: demultiplexer
11: parser 12: buffer memory
13: hard disk 15: decoder
16: data communication section 17: main memory
18: Signal Generator 19: Mixer
20: control unit 20a: system memory
20b: Real Time Clock (RTC) 20c: File Management System

Claims (29)

  1. In the method for performing the requested operation on the image content,
    Identifying a location on the video content that was previously interrupted to the video content for which the operation was requested;
    In response to the requested operation, automatically determining a resumption location to be prior to the identified interrupted location and allowing the video content to be played from the determined resumption location; How it is done.
  2. The method of claim 1,
    The requested action is to request play for the video content from the interrupted location.
  3. The method of claim 1,
    The interrupt comprises stopping play for the video content, bookmarking, stopping transmission or reception of the video content data over a communication network, and powering off a device.
  4. The method of claim 1,
    The step of causing the video content to be played may be such that the video content is played from the determined resume position when the time when the operation is requested is greater than a preset time when the time when the operation is requested is greater than a preset time. Way.
  5. The method of claim 1,
    The step of causing the video content to be played may include determining a time or data amount of a section in which the resume position is earlier than the interrupted position, based on a time elapsed from the time when the operation is requested is the interrupted point. How.
  6. The method of claim 1,
    The step of causing the video content to be played may include determining a time or data amount of a section in which the resume position is earlier than the interrupted position based on the time or size of the section from the head of the video content to the interrupted position. How to do.
  7. The method of claim 1,
    And the step of causing the video content to be played, determines a section in which the resume position is earlier than the interrupted position based on a preset time or ratio.
  8. The method of claim 1,
    And the step of causing the video content to be played is such that the video content is played at a speed faster than a normal speed from the resume position to the interrupted position.
  9. The method of claim 8,
    The step of causing the video content to be played may include determining how to play the video content at a faster speed than the normal speed based on the time or size of the section from the resume position to the interrupted location. Way.
  10. The method of claim 1,
    Outputting graphic information indicating a section including the resume position and the interrupted position, and an indicator for identifying the interrupted position and the currently played position on a screen on which the image content is visually displayed; It further comprises a method.
  11. The method of claim 10,
    Wherein said outputting step displays before and after said interrupted position on said graphical information so as to be visually distinct from one another.
  12. The method of claim 1,
    The step of allowing the video content to be played,
    Checking a setting value for specifying whether to automatically play the previous content;
    If the setting value designates that the previous contents auto play is activated, the video content is played from the determined resume position, and if the previous contents automatic play is not designated as the activation, the video starts from the position corresponding to the requested operation. Causing the content to be played.
  13. The method of claim 1,
    The video content is one of a recorded broadcast program, video content recorded on a portable recording medium, video content downloaded or streamed through a communication network, and video content streaming through a communication network.
  14. An apparatus for processing video content,
    A receiver for acquiring image content;
    A storage unit for storing the obtained image content;
    A decoder for decoding and outputting data of the video content;
    A control operation for acquiring, storing and / or decoding the image content according to a user's request, and in response to the operation requested for the image content, a position on the image content that has been previously interrupted to the image content And a control unit for automatically determining a resumption position to be previously and of causing the video content to be decoded by the decoder from the determined resumption position.
  15. The method of claim 14,
    The requested action is to request play on the video content from the interrupted location.
  16. The method of claim 14,
    The interrupt comprises stopping play for the video content, bookmarking, powering off the device, and stopping the reception of the video content data over a communication network.
  17. The method of claim 14,
    The controller may be configured to cause the video content to be decoded from the determined resumption location when the time when the operation is requested is greater than a preset time that elapses from the time when the interrupt occurred.
  18. The method of claim 14,
    And the controller is further configured to determine a time or data amount of a section in which the resume position is earlier than the interrupted position, based on a time elapsed from the time when the operation was requested.
  19. The method of claim 14,
    And the controller is further configured to determine the time or amount of data in the section where the resuming position is earlier than the interrupted position, based on the time or size of the section from the head of the video content to the interrupted position.
  20. The method of claim 14,
    And the controller determines a section in which the resume position is earlier than the interrupted position based on a preset time or ratio.
  21. The method of claim 14,
    And the control unit causes the video content to be decoded by the decoder at a speed higher than a normal speed from the resume position to the interrupted position.
  22. The method of claim 21,
    And the control unit determines whether to decode the video content at a higher speed than the normal speed based on the time or size of the interval from the resume position to the interrupted position.
  23. The method of claim 14,
    It further comprises a screen signal generator for displaying text, graphic information and / or image on the screen,
    The controller may include graphic information indicating a section including the resume position and the interrupted position, and an indicator for identifying the interrupted position and the currently played position on the screen where the image content is visually represented. And control the screen signal generator to be output.
  24. 24. The method of claim 23,
    And the control unit controls the screen signal generation unit to visually distinguish before and after the interrupted position on the graphic information indicating a section including the resume position and the interrupted position.
  25. The method of claim 14,
    The control unit checks a setting value for designating whether or not to automatically play the previous content, and if the setting value designates to automatically play the previous content, the video content is decoded by the decoder from the determined resume position. And if the automatic playback of previous contents is not designated as active, causing the video content to be decoded by the decoder from a position corresponding to the requested operation.
  26. The method of claim 14,
    The video content is one of a recorded broadcast program, video content recorded on a portable recording medium, and video content downloaded or streamed through a communication network.
  27. The method of claim 14,
    The control unit receives, via input means, reference information necessary for determining the resume position before the interrupted position and reference information necessary for determining a play method for a section from the resume position to the interrupted position. A device that is to receive and store.
  28. An apparatus for providing image content through a communication network,
    A storage unit for storing image content;
    A first processor for providing data of the video content to a client device in a streaming method;
    In response to the request for the video content from the client device, automatically determining a resuming location that is a previous location of the location on the video content that was previously interrupted to the video content, and determining the resume. And a second processor for controlling the video content from a location to be transmitted to the client device in a streaming manner by the first processor.
  29. The method of claim 28,
    The request from the client device is to request transmission of the video content from the interrupted location,
    Wherein the interrupt comprises bookmarking the video content and stopping the transmission of the video content data through a communication network.
KR1020100048520A 2010-05-25 2010-05-25 Method and apparatus for replaying video contents KR20110129087A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020100048520A KR20110129087A (en) 2010-05-25 2010-05-25 Method and apparatus for replaying video contents

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020100048520A KR20110129087A (en) 2010-05-25 2010-05-25 Method and apparatus for replaying video contents

Publications (1)

Publication Number Publication Date
KR20110129087A true KR20110129087A (en) 2011-12-01

Family

ID=45498371

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020100048520A KR20110129087A (en) 2010-05-25 2010-05-25 Method and apparatus for replaying video contents

Country Status (1)

Country Link
KR (1) KR20110129087A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20140090033A (en) * 2013-01-08 2014-07-16 엘지전자 주식회사 Mobile terminal and control method thereof

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20140090033A (en) * 2013-01-08 2014-07-16 엘지전자 주식회사 Mobile terminal and control method thereof

Similar Documents

Publication Publication Date Title
JP2019041417A (en) System and method for improved audience measuring
US9930418B2 (en) Technique for delivering network personal video recorder service and broadcast programming service over a communications network
US10021446B2 (en) Multimedia stream processing system
US9800936B2 (en) Apparatus, systems and methods for accessing an initial portion of a media content event
US20200186892A1 (en) Systems and methods for providing a multi-perspective video display
US20170221520A1 (en) Systems and methods to play secondary media content
US10057655B2 (en) Systems and methods for generating time based preview image for a video stream
US9432745B2 (en) Playback of interactive programs
JP6072618B2 (en) Multimedia content search and recording reservation system
US10368119B2 (en) Method, device and computer program product for outputting a transport stream
US9241125B2 (en) Unified recording and pause buffer format
EP2749032B1 (en) System and method for memory jumping within stored instances of content
JP4980973B2 (en) Interactive media system and method for presenting pause time content
US7423662B2 (en) Method and system for electronic capture of user-selected segments of a broadcast data signal
US6971121B2 (en) Composite buffering
DE60217169T2 (en) Improvements in tv receivers
US8595768B2 (en) Enhanced program preview content
US8699861B2 (en) Recorded content management
KR101317436B1 (en) Network based instant replay and time shifted playback
US7320137B1 (en) Method and system for distributing personalized editions of media programs using bookmarks
KR100456441B1 (en) Method and Apparatus for Reproducing Past Images for Use in a Medium of Storage
JP4405523B2 (en) Content distribution system, server device and reception device used in the content distribution system
JP5099879B2 (en) Interactive television system with automatic switching from broadcast media to streaming media
RU2521491C2 (en) System for capture and selective playback of broadcast programmes
US8561115B2 (en) Video server and video distribution system using the same

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E601 Decision to refuse application