WO2015110005A1 - Television program image frame capturing device, television program image frame obtaining device, system and method - Google Patents

Television program image frame capturing device, television program image frame obtaining device, system and method Download PDF

Info

Publication number
WO2015110005A1
WO2015110005A1 PCT/CN2015/071206 CN2015071206W WO2015110005A1 WO 2015110005 A1 WO2015110005 A1 WO 2015110005A1 CN 2015071206 W CN2015071206 W CN 2015071206W WO 2015110005 A1 WO2015110005 A1 WO 2015110005A1
Authority
WO
WIPO (PCT)
Prior art keywords
image frame
television program
time
request
message
Prior art date
Application number
PCT/CN2015/071206
Other languages
French (fr)
Chinese (zh)
Inventor
祝蜀平
Original Assignee
夏普株式会社
祝蜀平
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 夏普株式会社, 祝蜀平 filed Critical 夏普株式会社
Priority to JP2016546515A priority Critical patent/JP6219531B2/en
Publication of WO2015110005A1 publication Critical patent/WO2015110005A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8146Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • H04N21/8153Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics comprising still images, e.g. texture, background image
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/4222Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44004Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/44Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/4448Receiver circuitry for the reception of television signals according to analogue transmission standards for frame-grabbing

Definitions

  • the invention relates to an image frame capturing device, a television program image frame acquiring device, a system and a method. More particularly, the present invention relates to a device, a user terminal, a system and method including such a device and a user terminal capable of accurately capturing an image frame in accordance with a user indication.
  • the television receiver upon receiving a command from a user terminal, the television receiver can intercept an image of the television program currently being played and then transmit it to the user terminal. In this way, the user can use the image when discussing the television program with other friends using the user terminal.
  • the command can be sent to the television receiver and the desired image can be received from the television receiver.
  • Patent Document 1 a method and system for obtaining a screen shot picture of a television program are disclosed.
  • the method stores a screen shot picture of a television program in a server, and the user operates the terminal when it is necessary to acquire a screen shot picture of the television program during the watching of the television.
  • the terminal obtains the screenshot of the TV program at the moment from the server, thereby facilitating the user to communicate with other users on the SNS community, thereby improving the user experience of the user.
  • an image processing apparatus and a user terminal device including: an image processing unit that processes an image signal; a display unit that displays the processed image; a user interface unit that receives a user who captures an image a screen capture unit that captures an image frame according to a user command; a storage unit that stores an image frame captured by the screen capture unit; and a control unit that controls the screen capture unit to capture an image frame that includes a point in time corresponding to the input of the user command Multiple image frames within.
  • Patent Document 1 requires a server to be arranged in a network, which is responsible for continuously capturing an image of a television.
  • the terminal acquires an image of the television from the server. Due to the continuous transmission of image data between the server and the TV, the network is heavily loaded.
  • the system architecture does not work in real time.
  • the server cannot immediately get the current screen capture image from the TV.
  • this method does not consider the case where there are multiple televisions. If you have more than one TV, you will need multiple servers. If only one server is used, the server requires additional operations to identify different TV sets. Whether adding servers or providing additional functionality to the server will increase costs.
  • Patent Document 2 The image processing apparatus disclosed in Patent Document 2 is capable of capturing an image frame corresponding to a point in time at which a user command is input.
  • the point in time at which the device recognizes the input of a user command may not be accurate enough.
  • this solution does not consider the case where there are multiple TVs.
  • Patent literature
  • the existing television screen capture image capture scheme has some problems and it is difficult to provide a good user experience.
  • the present invention has been made to solve the above problems, and an object thereof is to provide an apparatus and method capable of accurately capturing a television screen shot image according to a user's instruction, and capable of accurately capturing a television screen shot image without restricting the use of the user.
  • a television program image frame capture device comprising:
  • An image frame buffer module configured to buffer a plurality of image frames of a television program
  • a communication module configured to receive a request to capture an image frame from an external device, the request including information indicating a request transmission time
  • a time calibration module configured to determine a time of an image frame to be extracted according to a time difference between the television program image frame capture device and an external device and information indicating a request transmission time included in the request;
  • An image frame extraction module is configured to extract an image frame corresponding to the time determined by the time alignment module from the image frame buffer module.
  • the time alignment module is further configured to perform a calibration process with the external device to determine a time difference between the television program image frame capture device and the external device.
  • the calibration process comprises:
  • the frame image capturing apparatus television program sending a message to the external device, the message comprising a time stamp indication message sending time T 1,
  • the external device adds a timestamp T 2 to the message when receiving the message
  • the external device when the timestamp T 3 of the apparatus a feedback message to capture an image frame of the television program
  • the television program image frame capture device adds a timestamp T 4 when receiving the feedback message
  • the time calibration module determines that the time difference between the television program image frame capture device and the external device is ((T 2 -T 1 )+(T 3 -T 4 ))/2.
  • the time determined by the time calibration module includes a start time and an end time
  • the image frame extraction module includes an extracted image frame determination module configured to determine a difference between the start time and the end time As the length of time of the image frame to be extracted, if the length of time is less than a predetermined threshold, determining that the image frame to be extracted is an image frame corresponding to the start time in the image frame buffer module; Determining that the image frame to be extracted includes a plurality of image frames corresponding to the start time in the image frame buffer module to an image frame corresponding to the end time, the length of time is not less than the predetermined threshold Image frame.
  • the television program image frame capture device further comprises a signal decoding module configured to decode data of the television program and to buffer the decoded data in the image frame buffer module in the form of an image frame.
  • the communication module is further configured to broadcast information identifying the television program image frame capture device when the television program image frame capture device is powered on.
  • the communication module is further configured to, upon receiving a search request from the external device, feed back information identifying the television program image frame capture device to the external device.
  • the request for the captured image frame received by the communication module from the external device further includes information indicating the television program image frame capture device.
  • a television program image frame capture system configured to transmit a request for capturing an image frame to the television program image frame capturing device, the request including information indicating a request transmission time.
  • a television program image frame acquiring apparatus includes:
  • a user interface module configured to receive an image frame acquisition request input by the user, and determine a time when the image frame acquisition request is received;
  • a time calibration module configured to determine an image to be captured on the television program player based on a time difference between the television program image frame acquisition device and the television program player and a time at which the image frame acquisition request is received The time of the frame;
  • a communication module configured to send a request to the television program player to capture an image frame, the request including information indicating a time of the determined image frame to be captured.
  • the time alignment module is further configured to perform a calibration process with the television program player to determine a time difference between the television program image frame acquisition device and the television program player.
  • the calibration process comprises:
  • the television program image acquisition device to send a message frame to the TV program player, said message comprising a time stamp indication message sending time T 1,
  • the television program player adds a timestamp T 2 to the message upon receiving the message
  • the TV program player timestamp T 3 when the apparatus a feedback frame acquiring the message to the television program image
  • the television program image frame acquiring device adds a time stamp T 4 when receiving the feedback message
  • the time calibration module determines that the time difference between the television program image frame acquiring device and the television program player is ((T 2 -T 1 )+(T 3 -T 4 ))/2.
  • the user interface module is further configured to: determine a start time and an end time of the image frame acquisition request input by the user as the time when the image frame acquisition request is received.
  • the communication module is further configured to receive information identifying the television program player from the at least one television program player.
  • the information identifying the television program player is responsive to the communication mode The block was received while broadcasting the search request.
  • the request to capture an image frame further includes information indicating a television program player as a capture target.
  • a television program image frame capture system including:
  • the above television program image frame acquiring device
  • TV show player including:
  • An image frame buffer module configured to buffer a plurality of image frames of a television program
  • a communication module configured to receive a request to capture an image frame from the television program image frame acquisition device, the request including information indicating a time of an image frame to be captured;
  • An image frame extraction module configured to extract an image frame corresponding to a time of an image frame to be captured from the image frame buffer module
  • the communication module of the television program player transmits the extracted image frame to the television program image frame acquisition device.
  • a method for performing in a television program image frame capture device comprising:
  • An image frame corresponding to the determined time of the image frame to be extracted is extracted from the buffered plurality of image frames.
  • a method for performing in a television program image frame acquiring device comprising:
  • a request to capture an image frame is transmitted to the television program player, the request including information indicating a time of the determined image frame to be captured.
  • the television program image frame capturing apparatus the acquiring apparatus, and the method of the present invention, it is possible to accurately capture/acquire an image frame of a television program desired by the user. Furthermore, the present invention contemplates the presence of multiple television program players and eliminates the need to introduce additional equipment, reducing network burden and cost.
  • FIG. 1 is a schematic diagram showing an image frame capture system 1000 in accordance with a first embodiment of the present invention
  • FIG. 2 is a schematic diagram showing an image frame capture system 2000 in accordance with a second embodiment of the present invention.
  • FIG. 3 shows a schematic diagram of the operation of the time calibration module 1120 according to the first embodiment of the present invention
  • FIG. 4 shows a schematic diagram of the operation of the time calibration module 2220 in accordance with a second embodiment of the present invention
  • FIG. 5 is a diagram showing an operation of determining an image frame to be extracted according to an embodiment of the present invention.
  • FIG. 6 shows a schematic diagram of a situation in which a plurality of television program players exist in accordance with an embodiment of the present invention
  • FIG. 7 illustrates another schematic diagram of a situation in which a plurality of television program players exist in accordance with an embodiment of the present invention
  • FIG. 8 is a flowchart showing a television program image frame capturing method according to an embodiment of the present invention.
  • FIG. 9 is a flow chart showing a method of acquiring a television program image frame according to an embodiment of the present invention.
  • FIG. 1 is a schematic diagram showing an image frame capture system 1000 in accordance with a first embodiment of the present invention.
  • the image frame capture system 1000 includes a television program player 1100 and a user terminal 1200.
  • the television program player 1100 plays the television program for the user to watch. The user can input his or her request through the user terminal 1200 while watching the television program.
  • the television program player 1100 and the user terminal 1200 can communicate by wire or wirelessly.
  • the television program player 1100 may include a communication module 1110, a time calibration module 1120, an image frame extraction module 1130, and an image frame buffer module 1140.
  • the television receiver 1100 may also include other modules for performing conventional television program playback, such as signal decoding module 1150.
  • the user terminal 1200 can include a communication module 1210, a user interface module 1220, and a display module 1230.
  • User terminal 1200 can be, for example, a smart phone, a tablet PC, a desktop PC, a computer, or the like.
  • the user can input a request to the user terminal 1200 through the user interface module 1220, such as pressing a particular button, clicking a mouse, touching a display screen, or the like.
  • the communication module 1210 of the user terminal 1200 transmits a request to capture the image frame to the television program player 1100 over the network.
  • the request contains information indicating the request transmission time T s .
  • the communication module 1110 that receives the request to capture the image frame transmits information indicating the time T s to the time calibration module 1120.
  • the image frame extraction module 1130 extracts an image frame corresponding to the time of the image frame to be extracted determined by the time alignment module 1120 from the image frame buffer module 1140 that buffers the image frame of the played television program.
  • the signal decoding module 1150 decodes the analog or digital data of the television program while playing the television program, and buffers the decoded data in the image frame buffer module 1140 in the form of an image frame.
  • the communication module 1110 then transmits the extracted image frame to the user terminal 1200.
  • User terminal 1200 can display the received image frame on display module 1230.
  • a television program player may be a television, a computer, or a portable A computer, or even a mobile phone, that can play a television program and is capable of performing a corresponding operation.
  • FIG. 2 is a schematic diagram showing an image frame capture system 2000 in accordance with a second embodiment of the present invention.
  • the image frame capturing system 2000 according to the second embodiment of the present invention differs from the image frame capturing system 1000 according to the first embodiment only in the position of the time alignment module.
  • the television program player 1100 includes a time calibration module 1120.
  • the user terminal 2200 includes a time calibration module 2220.
  • the 1230 is functionally identical.
  • FIG. 3 shows a schematic diagram of the operation of the time calibration module 1120 in accordance with the first embodiment of the present invention.
  • the television program player 1100 transmits a calibration message to the user terminal 1200 via the communication module 1110, the calibration message including the system timestamp T 1 of the television receiver.
  • the user terminal 1200 adds the system timestamp T 2 of the user terminal to the calibration message.
  • FIG. 4 shows a schematic diagram of the operation of the time calibration module 2220 in accordance with the second embodiment of the present invention.
  • the operation of the time calibration module 2220 is the same as that of the time calibration module 1120.
  • a calibration message including the system timestamp T 1 of the user terminal is transmitted from the user terminal 2200 to the television program player 2100.
  • the television program player 2100 receives the calibration message, it adds the system time stamp T 2 of the television receiver to the calibration message.
  • the television program broadcast message 2100 After the television program broadcast message 2100 calibration the calibration process is completed when the message back to the user terminal 2200, its timestamp T 3.
  • the user terminal 2200 immediately adds a new timestamp T 4 upon receiving the feedback calibration message.
  • the user interface module 2230 receives an image frame acquisition input by the user when, for example, the user presses a specific button, clicks a mouse, touches a display screen, or the like.
  • Request and determine the current time which is the time at which the image frame acquisition request was received.
  • the time calibration module 2220 then transmits the determined request transmission time T e to the communication module 2210, which then transmits a request to the television program player 2100 to capture the image frame over the network, the request including the indication of the determined request transmission time. T e information.
  • the communication module 2110 that received the request forwards the request to the image frame extraction module 2120.
  • the image frame extraction module 2120 extracts an image frame corresponding to the request transmission time T e included in the request from the image frame buffer module 2130 that buffers the image frame of the played program.
  • the signal decoding module 2140 decodes the analog or digital data of the television program and buffers the decoded data in the image frame buffer module 2130 in the form of an image frame.
  • the communication module 2110 then transmits the extracted image frame to the user terminal 1200.
  • User terminal 1200 can display the received image frame on display module 2240.
  • the time offset between the television receiver and the user terminal can be eliminated whether the time calibration module is placed on the television receiver or on the user terminal. Thereby improving the accuracy of capturing the image frame desired by the user.
  • the time calibration module may perform a calibration process at startup or periodically, otherwise perform a calibration process, and then store the determined time difference for use in subsequent operations.
  • the user inputs a request through the user interface module, and an image frame when the user presses the request in the television program played on the television program player can be obtained.
  • the request entered by the user interface module can be a single screen shot command, i.e., a request to capture a current image frame, or a continuous screen capture command, i.e., a request to capture a plurality of consecutive image frames.
  • the user can press the command button on the user interface module at time T 0 to trigger the start of capturing the image frame and release the button at time T n to end the capture of the image frame.
  • the user interface module takes the start time and end time of the user input request as the time at which the request was received.
  • the information indicating the request transmission time in the request received by the television program player indicates a period of time instead of a point in time. In this example, as shown in FIG.
  • image frame extraction module 1130 can include an extracted image frame determination module 1132 configured to determine the length of the time period. If the length of the time period is less than a predetermined threshold, it is determined that the image frame to be extracted is an image frame in the buffered image frame corresponding to the start time of the time period. And if the length of the time period is not less than the predetermined threshold, determining that the image frame to be extracted includes the image frame corresponding to the start time of the time period in the buffered image frame to the end time of the time period Multiple image frames of the corresponding image frame.
  • FIG. 5 shows a schematic diagram of an operation of determining an image frame to be extracted, according to an embodiment of the present invention.
  • FIG. 6 shows a schematic diagram of a situation in which a plurality of television program players exist in accordance with an embodiment of the present invention. As shown in Figure 6, it is assumed that there are N television program players.
  • the communication module of the user terminal broadcasts a search request as needed.
  • the television program player receiving the search request will feed back a response message including its identification information, which may be, for example, the IP address of the television program player, the identifier id, the serial number, the manufacturer's information, the model, and the like.
  • the user terminal receiving the response message can identify each television program player and include information of the television program player as the capture target in the subsequently transmitted image frame acquisition request. Accordingly, the television program player that received the image frame capture request will identify the television program player indicated in the request, and if it is itself, perform an image frame capture operation, if not, ignore the request.
  • FIG. 7 illustrates another schematic diagram of a situation in which multiple television program players exist in accordance with an embodiment of the present invention.
  • the television program player broadcasts information identifying itself, such as the IP address of the television program player, the identifier id, the serial number, the manufacturer's information, the model, etc., periodically or when needed, for example, at power on.
  • the user terminal receiving the identification information can identify each television program player and include information of the television program player as the capture target in the subsequently transmitted image frame acquisition request. Accordingly, the television program player that received the image frame capture request will identify the television program player indicated in the request, and if it is itself, perform an image frame capture operation, if not, ignore the request.
  • the user terminal does not need to frequently broadcast a search request to search for a television program player with which it can communicate.
  • the television program player transmits its identification information upon power on to inform the user terminal of its presence. In this way, the waste of resources can be reduced.
  • FIG. 8 shows a flow diagram of a television program image frame capture method 800 in accordance with an embodiment of the present invention.
  • the method begins when the television program player plays the television program.
  • a plurality of image frames of the played television program are buffered.
  • a request to capture an image frame is received from the user terminal, the request including information indicating a request transmission time.
  • the time of the image frame to be extracted is determined according to the time difference between the television program image frame capturing device and the external device and the information indicating the request transmission time included in the request.
  • an image frame corresponding to the determined time of the image frame to be extracted is extracted from the buffered plurality of image frames.
  • the captured image frame can be returned to the requesting user terminal for display on the user terminal.
  • the television program player performing the method can perform a calibration process with the user terminal in advance to determine and save the time difference between the television program player and the user terminal for subsequent use.
  • the method further includes the step of determining a length of a time period of the image frame to be extracted, and if the length of the time period is less than a predetermined threshold, determining that the image frame to be extracted is the time An image frame corresponding to a start time of the segment; if the length is not less than the predetermined threshold, determining that the image frame to be extracted includes an image from the cached image frame corresponding to a start time of the time period Frames to a plurality of image frames of an image frame corresponding to an end time of the time period.
  • the method further includes the steps of: decoding the data of the television program and buffering the decoded data in the form of image frames.
  • the method can also be applied to situations where there are multiple television program players.
  • the television program player broadcasts its identification information when it is turned on, or feeds back its identification information to the user terminal when receiving a search request from the user terminal.
  • the user terminal will include identification information of the television program player as the capture target in the request of the captured image frame it transmits.
  • FIG. 9 shows a flow diagram of a television program image frame acquisition method 900 in accordance with an embodiment of the present invention.
  • the method begins when the user wants to capture the viewed image frame while watching the television program played by the television program player.
  • step S910 an image frame acquisition request input by the user is received through the user interface module, and the time at which the image frame acquisition request is received is determined.
  • step S920 determining an image frame to be captured on the television program player according to a time difference between the television program image frame acquisition device and the television program player and a time when the image frame acquisition request is received. time.
  • a request to capture an image frame is transmitted to the television program player, the request including information indicating a time of the determined image frame to be captured.
  • a television program player that receives a request to capture an image frame may capture an image frame of the time supported in the request and feed back the captured image frame. In this way, image frames that are played on the television program player when a request to capture an image frame is issued can be accurately captured.
  • the user terminal performing the method can perform a calibration process with the television program player in advance to determine and save the time difference between the user terminal and the television program player for subsequent use.
  • the request can be continuously entered.
  • the determined time of receiving the image frame acquisition request includes determining a start time and an end time of the image frame acquisition request input by the user as the time at which the image frame acquisition request is received.
  • the method can also be applied to situations where there are multiple television program players.
  • the user terminal can receive the identification information broadcast by the television program player to determine the television program player as the capture target.
  • the user terminal broadcasts the search request and receives the feedback identification information from the plurality of television program players in response.
  • the user terminal will include identification information of the television program player as the capture target in the request of the captured image frame it transmits.

Abstract

Disclosed are a television program image frame capturing device, an obtaining device, a system, and a method. The television program image frame capturing device comprises: an image frame buffer module, which is configured to buffer multiple image frames of a television program; a communication module, which is configured to receive a request from an external device for capturing an image frame, wherein the request comprises information indicating request sending time; a time calibration module, which is configured to determine time of the image frame to be captured based on a time difference between the television program image frame capturing device and the external device and the information comprised in the request for indicating the request sending time; and an image frame extraction module, which is configured to extract the image frame corresponding to the time determined by the time calibration module from the image frame buffer module. The time calibration module can also be arranged in the television program image frame capturing device. According to the devices, the system and the method of the present invention, television screenshot images can be captured accurately, without restricting the use of a user.

Description

电视节目图像帧捕获设备、电视节目图像帧获取设备、系统和方法Television program image frame capturing device, television program image frame acquiring device, system and method 技术领域Technical field
本发明涉及一种图像帧捕获设备、电视节目图像帧获取设备、系统和方法。更具体地,本发明涉及能够根据用户指示准确地捕获图像帧的设备、用户终端、包括这种设备和用户终端的系统以及方法。The invention relates to an image frame capturing device, a television program image frame acquiring device, a system and a method. More particularly, the present invention relates to a device, a user terminal, a system and method including such a device and a user terminal capable of accurately capturing an image frame in accordance with a user indication.
背景技术Background technique
当前,电视接收机被开发为能够提供越来越复杂的功能,以满足用户的各种需求。例如,在从用户终端接收到命令时,电视接收机能够截取当前正在播放的电视节目的图像,然后发送给用户终端。这样,用户能够在使用用户终端与其他好友讨论该电视节目时使用该图像。此外,当用户在观看电视节目时看到感兴趣的图像而需要保存时,可以向电视接收机发送命令并从电视接收机接收到所需的图像。Currently, television receivers have been developed to provide increasingly complex functions to meet the various needs of users. For example, upon receiving a command from a user terminal, the television receiver can intercept an image of the television program currently being played and then transmit it to the user terminal. In this way, the user can use the image when discussing the television program with other friends using the user terminal. In addition, when the user sees the image of interest while watching the television program and needs to save, the command can be sent to the television receiver and the desired image can be received from the television receiver.
在专利文献1中,公开了一种获得电视节目截屏图片的方法和系统,该方法把电视节目截屏图片存储在服务器中,用户在看电视过程中,在需要获取电视节目截屏图片时,操作终端,使得终端从服务器中获取此刻的电视节目截屏图片,从而便于用户在SNS社区上与其他用户进行电视节目内容的交流,从而提高了用户的用户体验。In Patent Document 1, a method and system for obtaining a screen shot picture of a television program are disclosed. The method stores a screen shot picture of a television program in a server, and the user operates the terminal when it is necessary to acquire a screen shot picture of the television program during the watching of the television. The terminal obtains the screenshot of the TV program at the moment from the server, thereby facilitating the user to communicate with other users on the SNS community, thereby improving the user experience of the user.
在专利文献2中,公开了一种图像处理设备和用户终端设备,该图像处理设备包括:图像处理单元,处理图像信号;显示单元,显示所处理的图像;用户接口单元,接收捕获图像的用户命令;屏幕捕获单元,根据用户命令来捕获图像帧;存储单元,存储屏幕捕获单元所捕获的图像帧;以及控制单元,控制屏幕捕获单元捕获包括与输入用户命令的时间点相对应的图像帧在内的多个图像帧。In Patent Document 2, an image processing apparatus and a user terminal device are disclosed, the image processing apparatus including: an image processing unit that processes an image signal; a display unit that displays the processed image; a user interface unit that receives a user who captures an image a screen capture unit that captures an image frame according to a user command; a storage unit that stores an image frame captured by the screen capture unit; and a control unit that controls the screen capture unit to capture an image frame that includes a point in time corresponding to the input of the user command Multiple image frames within.
但是,专利文献1公开的方法需要在网络中布置服务器,该服务器负责连续地捕获电视的图像。终端从该服务器获取电视的图像。由于在服务器和电视之间持续进行图像数据的传输,因此网络负载繁重。此外,该系统架构无法实时工作。当用户要捕获电视的当前截屏图像时,终端 向服务器发送请求,则服务器无法立即从电视获得当前截屏图像。另外,该方法并未考虑存在多个电视的情形。如果有不止一个电视机,则需要多个服务器。如果仅使用一个服务器,则该服务器需要额外的操作来识别不同的电视机。无论是增加服务器,还是给服务器提供额外的功能,都将增加成本。However, the method disclosed in Patent Document 1 requires a server to be arranged in a network, which is responsible for continuously capturing an image of a television. The terminal acquires an image of the television from the server. Due to the continuous transmission of image data between the server and the TV, the network is heavily loaded. In addition, the system architecture does not work in real time. When the user wants to capture the current screenshot of the TV, the terminal When a request is sent to the server, the server cannot immediately get the current screen capture image from the TV. In addition, this method does not consider the case where there are multiple televisions. If you have more than one TV, you will need multiple servers. If only one server is used, the server requires additional operations to identify different TV sets. Whether adding servers or providing additional functionality to the server will increase costs.
专利文献2公开的图像处理设备能够捕获与输入用户命令的时间点相对应的图像帧。但是,该设备所识别的输入用户命令的时间点可能不够精确。而且,该方案也未考虑存在多个电视的情形。The image processing apparatus disclosed in Patent Document 2 is capable of capturing an image frame corresponding to a point in time at which a user command is input. However, the point in time at which the device recognizes the input of a user command may not be accurate enough. Moreover, this solution does not consider the case where there are multiple TVs.
因此,需要一种能够根据用户指示准确地捕获图像帧的设备和方法。Therefore, there is a need for an apparatus and method that is capable of accurately capturing image frames in accordance with user instructions.
专利文献:Patent literature:
(1)中国专利申请CN201110363349.8,2012年4月18日;(1) Chinese patent application CN201110363349.8, April 18, 2012;
(2)欧洲专利申请EP11192649.9,2012年6月13日。(2) European Patent Application EP11192649.9, June 13, 2012.
发明内容Summary of the invention
如上所述,现有的电视截屏图像捕获方案存在一些问题,难以提供良好的用户体验。As described above, the existing television screen capture image capture scheme has some problems and it is difficult to provide a good user experience.
本发明是为了解决上述问题而提出的,其目的在于提供一种能够根据用户指示准确地捕获电视截屏图像的设备和方法,能够精确地进行电视截屏图像的捕获,且不对用户的使用进行限制。The present invention has been made to solve the above problems, and an object thereof is to provide an apparatus and method capable of accurately capturing a television screen shot image according to a user's instruction, and capable of accurately capturing a television screen shot image without restricting the use of the user.
根据本发明的第一方面,提供了一种电视节目图像帧捕获设备,包括:According to a first aspect of the present invention, a television program image frame capture device is provided, comprising:
图像帧缓存模块,被配置为缓存有电视节目的多个图像帧;An image frame buffer module configured to buffer a plurality of image frames of a television program;
通信模块,被配置为从外部设备接收捕获图像帧的请求,所述请求包含指示请求发送时间的信息;a communication module configured to receive a request to capture an image frame from an external device, the request including information indicating a request transmission time;
时间校准模块,被配置为根据所述电视节目图像帧捕获设备与外部设备之间的时间差以及所述请求中包含的指示请求发送时间的信息,确定要提取的图像帧的时间;以及a time calibration module configured to determine a time of an image frame to be extracted according to a time difference between the television program image frame capture device and an external device and information indicating a request transmission time included in the request;
图像帧提取模块,被配置为从所述图像帧缓存模块中提取与时间校准模块所确定的时间相对应的图像帧。 An image frame extraction module is configured to extract an image frame corresponding to the time determined by the time alignment module from the image frame buffer module.
优选地,所述时间校准模块还被配置为与所述外部设备执行校准过程,以确定所述电视节目图像帧捕获设备与所述外部设备之间的时间差。Advantageously, the time alignment module is further configured to perform a calibration process with the external device to determine a time difference between the television program image frame capture device and the external device.
优选地,所述校准过程包括:Preferably, the calibration process comprises:
所述电视节目图像帧捕获设备向所述外部设备发送消息,所述消息包括指示消息发送时间T1的时间戳,The frame image capturing apparatus television program sending a message to the external device, the message comprising a time stamp indication message sending time T 1,
所述外部设备在接收到所述消息时向消息添加时间戳T2The external device adds a timestamp T 2 to the message when receiving the message,
所述外部设备在向所述电视节目图像帧捕获设备反馈所述消息时添加时间戳T3The external device when the timestamp T 3 of the apparatus a feedback message to capture an image frame of the television program,
所述电视节目图像帧捕获设备在接收到反馈的消息时添加时间戳T4The television program image frame capture device adds a timestamp T 4 when receiving the feedback message,
其中,所述时间校准模块确定所述电视节目图像帧捕获设备与所述外部设备之间的时间差为((T2-T1)+(T3-T4))/2。The time calibration module determines that the time difference between the television program image frame capture device and the external device is ((T 2 -T 1 )+(T 3 -T 4 ))/2.
优选地,所述时间校准模块所确定的时间包括起始时间和结束时间,并且所述图像帧提取模块包括提取图像帧确定模块,被配置为确定所述起始时间和所述结束时间之差,作为要提取的图像帧的时间长度,如果所述时间长度小于预定阈值,则确定要提取的图像帧是所述图像帧缓存模块中与所述起始时间相对应的图像帧;如果所述时间长度不小于所述预定阈值,则确定要提取的图像帧包括所述图像帧缓存模块中从与所述起始时间相对应的图像帧到与所述结束时间相对应的图像帧的多个图像帧。Preferably, the time determined by the time calibration module includes a start time and an end time, and the image frame extraction module includes an extracted image frame determination module configured to determine a difference between the start time and the end time As the length of time of the image frame to be extracted, if the length of time is less than a predetermined threshold, determining that the image frame to be extracted is an image frame corresponding to the start time in the image frame buffer module; Determining that the image frame to be extracted includes a plurality of image frames corresponding to the start time in the image frame buffer module to an image frame corresponding to the end time, the length of time is not less than the predetermined threshold Image frame.
优选地,所述电视节目图像帧捕获设备还包括信号解码模块,被配置为对电视节目的数据进行解码,并将解码数据以图像帧的形式缓存在所述图像帧缓存模块中。Advantageously, the television program image frame capture device further comprises a signal decoding module configured to decode data of the television program and to buffer the decoded data in the image frame buffer module in the form of an image frame.
优选地,所述通信模块还被配置为在所述电视节目图像帧捕获设备开机时,广播标识所述电视节目图像帧捕获设备的信息。Advantageously, the communication module is further configured to broadcast information identifying the television program image frame capture device when the television program image frame capture device is powered on.
优选地,所述通信模块还被配置为在从所述外部设备接收到搜索请求时,向所述外部设备反馈标识所述电视节目图像帧捕获设备的信息。Advantageously, the communication module is further configured to, upon receiving a search request from the external device, feed back information identifying the television program image frame capture device to the external device.
优选地,所述通信模块从外部设备接收的所述捕获图像帧的请求还包括指示所述电视节目图像帧捕获设备的信息。Preferably, the request for the captured image frame received by the communication module from the external device further includes information indicating the television program image frame capture device.
根据本发明的第二方面,提供了一种电视节目图像帧捕获系统,包 括:上述电视节目图像帧捕获设备;以及外部设备,被配置为向所述电视节目图像帧捕获设备发送捕获图像帧的请求,所述请求包含指示请求发送时间的信息。According to a second aspect of the present invention, a television program image frame capture system is provided The television program image frame capturing device; and an external device configured to transmit a request for capturing an image frame to the television program image frame capturing device, the request including information indicating a request transmission time.
根据本发明的第三方面,提供了一种电视节目图像帧获取设备,包括:According to a third aspect of the present invention, a television program image frame acquiring apparatus includes:
用户接口模块,被配置为接收用户输入的图像帧获取请求,确定接收到所述图像帧获取请求的时间;a user interface module configured to receive an image frame acquisition request input by the user, and determine a time when the image frame acquisition request is received;
时间校准模块,被配置为根据所述电视节目图像帧获取设备与电视节目播放器之间的时间差以及接收到所述图像帧获取请求的时间,确定在所述电视节目播放器上要捕获的图像帧的时间;以及a time calibration module configured to determine an image to be captured on the television program player based on a time difference between the television program image frame acquisition device and the television program player and a time at which the image frame acquisition request is received The time of the frame;
通信模块,被配置为向所述电视节目播放器发送捕获图像帧的请求,所述请求包含指示所确定的要捕获的图像帧的时间的信息。A communication module configured to send a request to the television program player to capture an image frame, the request including information indicating a time of the determined image frame to be captured.
优选地,所述时间校准模块还被配置为与所述电视节目播放器执行校准过程,以确定所述电视节目图像帧获取设备与所述电视节目播放器之间的时间差。Advantageously, the time alignment module is further configured to perform a calibration process with the television program player to determine a time difference between the television program image frame acquisition device and the television program player.
优选地,所述校准过程包括:Preferably, the calibration process comprises:
所述电视节目图像帧获取设备向所述电视节目播放器发送消息,所述消息包括指示消息发送时间T1的时间戳,The television program image acquisition device to send a message frame to the TV program player, said message comprising a time stamp indication message sending time T 1,
所述电视节目播放器在接收到所述消息时向消息添加时间戳T2The television program player adds a timestamp T 2 to the message upon receiving the message,
所述电视节目播放器在向所述电视节目图像帧获取设备反馈所述消息时添加时间戳T3The TV program player timestamp T 3 when the apparatus a feedback frame acquiring the message to the television program image,
所述电视节目图像帧获取设备在接收到反馈的消息时添加时间戳T4The television program image frame acquiring device adds a time stamp T 4 when receiving the feedback message,
其中,所述时间校准模块确定所述电视节目图像帧获取设备与所述电视节目播放器之间的时间差为((T2-T1)+(T3-T4))/2。The time calibration module determines that the time difference between the television program image frame acquiring device and the television program player is ((T 2 -T 1 )+(T 3 -T 4 ))/2.
优选地,所述用户接口模块还被配置为:确定用户输入的图像帧获取请求的起始时间和结束时间,作为接收到所述图像帧获取请求的时间。Preferably, the user interface module is further configured to: determine a start time and an end time of the image frame acquisition request input by the user as the time when the image frame acquisition request is received.
优选地,所述通信模块还被配置为从至少一个电视节目播放器接收标识所述电视节目播放器的信息。Advantageously, the communication module is further configured to receive information identifying the television program player from the at least one television program player.
优选地,所述标识所述电视节目播放器的信息是响应于所述通信模 块广播搜索请求而接收到的。Preferably, the information identifying the television program player is responsive to the communication mode The block was received while broadcasting the search request.
优选地,所述捕获图像帧的请求还包括指示作为捕获目标的电视节目播放器的信息。Preferably, the request to capture an image frame further includes information indicating a television program player as a capture target.
根据本发明的第四方面,提供了一种电视节目图像帧捕获系统,包括:According to a fourth aspect of the present invention, a television program image frame capture system is provided, including:
上述电视节目图像帧获取设备;以及The above television program image frame acquiring device;
电视节目播放器,包括:TV show player, including:
图像帧缓存模块,被配置为缓存有电视节目的多个图像帧;An image frame buffer module configured to buffer a plurality of image frames of a television program;
通信模块,被配置为从所述电视节目图像帧获取设备接收捕获图像帧的请求,所述请求包含指示要捕获的图像帧的时间的信息;以及a communication module configured to receive a request to capture an image frame from the television program image frame acquisition device, the request including information indicating a time of an image frame to be captured;
图像帧提取模块,被配置为从所述图像帧缓存模块中提取与要捕获的图像帧的时间相对应的图像帧;An image frame extraction module configured to extract an image frame corresponding to a time of an image frame to be captured from the image frame buffer module;
其中,所述电视节目播放器的通信模块将所提取的图像帧发送给所述电视节目图像帧获取设备。The communication module of the television program player transmits the extracted image frame to the television program image frame acquisition device.
根据本发明的第五方面,提供了一种在电视节目图像帧捕获设备中执行的方法,包括:According to a fifth aspect of the present invention, a method for performing in a television program image frame capture device, comprising:
缓存电视节目的多个图像帧;Cache multiple image frames of a television program;
从外部设备接收捕获图像帧的请求,所述请求包含指示请求发送时间的信息;Receiving a request to capture an image frame from an external device, the request including information indicating a time of request to send;
根据所述电视节目图像帧捕获设备与所述外部设备之间的时间差以及所述请求中包含的指示请求发送时间的信息,确定要提取的图像帧的时间;以及Determining a time of an image frame to be extracted according to a time difference between the television program image frame capturing device and the external device and information indicating a request transmission time included in the request;
从缓存的多个图像帧中提取与所确定的要提取的图像帧的时间相对应的图像帧。An image frame corresponding to the determined time of the image frame to be extracted is extracted from the buffered plurality of image frames.
根据本发明的第六方面,提供了一种在电视节目图像帧获取设备中执行的方法,包括:According to a sixth aspect of the present invention, a method for performing in a television program image frame acquiring device, comprising:
接收用户输入的图像帧获取请求,确定接收到所述图像帧获取请求的时间;Receiving an image frame acquisition request input by the user, determining a time when the image frame acquisition request is received;
根据所述电视节目图像帧获取设备与电视节目播放器之间的时间 差以及接收到所述图像帧获取请求的时间,确定在所述电视节目播放器上要捕获的图像帧的时间;Obtaining time between the device and the television program player according to the television program image frame a difference and a time at which the image frame acquisition request is received, determining a time of an image frame to be captured on the television program player;
向所述电视节目播放器发送捕获图像帧的请求,所述请求包含指示所确定的要捕获的图像帧的时间的信息。A request to capture an image frame is transmitted to the television program player, the request including information indicating a time of the determined image frame to be captured.
根据本发明的电视节目图像帧捕获设备、获取设备和方法,能够精确地捕获/获取用户想要的电视节目的图像帧。此外,本发明考虑了存在多个电视节目播放器的情况,并且无需引入额外的设备,减少了网络负担和成本。According to the television program image frame capturing apparatus, the acquiring apparatus, and the method of the present invention, it is possible to accurately capture/acquire an image frame of a television program desired by the user. Furthermore, the present invention contemplates the presence of multiple television program players and eliminates the need to introduce additional equipment, reducing network burden and cost.
附图说明DRAWINGS
根据下文的描述,本发明的附加目标、特征和优点将会更加清楚。而且,根据参照附图的下述解释,本发明的优点将会是明显的,附图中:Additional objects, features, and advantages of the invention will be apparent from the description. Moreover, the advantages of the present invention will be apparent from the following description with reference to the accompanying drawings in which:
图1是示出了根据本发明第一实施例的图像帧捕获系统1000的示意图;1 is a schematic diagram showing an image frame capture system 1000 in accordance with a first embodiment of the present invention;
图2是示出了根据本发明第二实施例的图像帧捕获系统2000的示意图;2 is a schematic diagram showing an image frame capture system 2000 in accordance with a second embodiment of the present invention;
图3示出了根据本发明第一实施例的时间校准模块1120的工作示意图;FIG. 3 shows a schematic diagram of the operation of the time calibration module 1120 according to the first embodiment of the present invention;
图4示出了根据本发明第二实施例的时间校准模块2220的工作示意图;4 shows a schematic diagram of the operation of the time calibration module 2220 in accordance with a second embodiment of the present invention;
图5示出了根据本发明实施例的确定要提取的图像帧的操作的示意图;FIG. 5 is a diagram showing an operation of determining an image frame to be extracted according to an embodiment of the present invention; FIG.
图6示出了根据本发明实施例的存在多个电视节目播放器的情形的示意图;6 shows a schematic diagram of a situation in which a plurality of television program players exist in accordance with an embodiment of the present invention;
图7示出了根据本发明实施例的存在多个电视节目播放器的情形的另一示意图;FIG. 7 illustrates another schematic diagram of a situation in which a plurality of television program players exist in accordance with an embodiment of the present invention; FIG.
图8示出了根据本发明实施例的电视节目图像帧捕获方法的流程图;以及FIG. 8 is a flowchart showing a television program image frame capturing method according to an embodiment of the present invention;
图9示出了根据本发明实施例的电视节目图像帧获取方法的流程图。 FIG. 9 is a flow chart showing a method of acquiring a television program image frame according to an embodiment of the present invention.
具体实施方式detailed description
现在将通过示例性例子并参照附图来描述本发明的优选实施例。在整个说明书和附图中,相同的附图标记表示相同的组件。Preferred embodiments of the present invention will now be described by way of illustrative examples and with reference to the accompanying drawings. Throughout the specification and the drawings, the same reference numerals indicate the same components.
本发明提供了一种电视节目图像帧捕获方法和系统。图1是示出了根据本发明第一实施例的图像帧捕获系统1000的示意图。如图1所示,图像帧捕获系统1000包括电视节目播放器1100和用户终端1200。电视节目播放器1100播放电视节目,以供用户观看。用户可以在观看电视节目的同时,通过用户终端1200输入其请求。电视节目播放器1100与用户终端1200可以有线地或无线地通信。电视节目播放器1100可以包括通信模块1110、时间校准模块1120、图像帧提取模块1130以及图像帧缓存模块1140。电视接收机1100还可包括其他模块,用于进行常规的电视节目播放,例如信号解码模块1150。用户终端1200可以包括通信模块1210、用户接口模块1220以及显示模块1230。The invention provides a television program image frame capturing method and system. FIG. 1 is a schematic diagram showing an image frame capture system 1000 in accordance with a first embodiment of the present invention. As shown in FIG. 1, the image frame capture system 1000 includes a television program player 1100 and a user terminal 1200. The television program player 1100 plays the television program for the user to watch. The user can input his or her request through the user terminal 1200 while watching the television program. The television program player 1100 and the user terminal 1200 can communicate by wire or wirelessly. The television program player 1100 may include a communication module 1110, a time calibration module 1120, an image frame extraction module 1130, and an image frame buffer module 1140. The television receiver 1100 may also include other modules for performing conventional television program playback, such as signal decoding module 1150. The user terminal 1200 can include a communication module 1210, a user interface module 1220, and a display module 1230.
用户终端1200可以是例如智能电话、平板PC、桌面PC、计算机等。用户可以通过用户接口模块1220,例如按下特定按键、点击鼠标、触摸显示屏等,向用户终端1200输入请求。在接收到请求之后,用户终端1200的通信模块1210通过网络向电视节目播放器1100发送捕获图像帧的请求。该请求包含指示请求发送时间Ts的信息。接收到捕获图像帧的请求的通信模块1110向时间校准模块1120发送指示该时间Ts的信息。时间校准模块1120根据电视节目播放器1100与用户终端1200之间的时间差Td和时间Ts,确定在电视节目播放器的时间基准上的请求发送时间Te=Ts-Td,即要提取的图像帧的时间。图像帧提取模块1130从缓存有所播放的电视节目的图像帧的图像帧缓存模块1140中提取与时间校准模块1120所确定的要提取的图像帧的时间相对应的图像帧。信号解码模块1150在播放电视节目的同时,对电视节目的模拟或数字数据进行解码,并将解码数据缓以图像帧的形式缓存在图像帧缓存模块1140中。 User terminal 1200 can be, for example, a smart phone, a tablet PC, a desktop PC, a computer, or the like. The user can input a request to the user terminal 1200 through the user interface module 1220, such as pressing a particular button, clicking a mouse, touching a display screen, or the like. After receiving the request, the communication module 1210 of the user terminal 1200 transmits a request to capture the image frame to the television program player 1100 over the network. The request contains information indicating the request transmission time T s . The communication module 1110 that receives the request to capture the image frame transmits information indicating the time T s to the time calibration module 1120. The time calibration module 1120 determines the request transmission time T e =T s -T d on the time base of the television program player according to the time difference T d and the time T s between the television program player 1100 and the user terminal 1200, that is, The time of the extracted image frame. The image frame extraction module 1130 extracts an image frame corresponding to the time of the image frame to be extracted determined by the time alignment module 1120 from the image frame buffer module 1140 that buffers the image frame of the played television program. The signal decoding module 1150 decodes the analog or digital data of the television program while playing the television program, and buffers the decoded data in the image frame buffer module 1140 in the form of an image frame.
然后,通信模块1110将所提取的图像帧发送给用户终端1200。用户终端1200可以在显示模块1230上显示所接收的图像帧。The communication module 1110 then transmits the extracted image frame to the user terminal 1200. User terminal 1200 can display the received image frame on display module 1230.
根据本发明实施例的电视节目播放器可以是电视机、计算机、便携 式计算机、甚至移动电话等可以播放电视节目、并能够执行相应操作的设备。A television program player according to an embodiment of the present invention may be a television, a computer, or a portable A computer, or even a mobile phone, that can play a television program and is capable of performing a corresponding operation.
图2是示出了根据本发明第二实施例的图像帧捕获系统2000的示意图。根据本发明第二实施例的图像帧捕获系统2000与根据第一实施例的图像帧捕获系统1000的区别仅在于时间校准模块的位置。在根据第一实施例的图像帧捕获系统1000中,电视节目播放器1100包括时间校准模块1120。而在根据第二实施例的图像捕获系统2000中,用户终端2200包括时间校准模块2220。根据本发明第二实施例的图像帧捕获系统2000的电视节目播放器2100中的通信模块2110、图像帧提取模块2120、图像帧缓存模块2130、信号解码模块2140、用户终端2200中的通信模块2210、用户接口模块2230、显示模块2240与根据本发明第一实施例的通信模块1110、图像帧提取模块1130、图像帧缓存模块1140、信号解码模块1150、通信模块1210、用户接口模块1220、显示模块1230在功能上是相同的。2 is a schematic diagram showing an image frame capture system 2000 in accordance with a second embodiment of the present invention. The image frame capturing system 2000 according to the second embodiment of the present invention differs from the image frame capturing system 1000 according to the first embodiment only in the position of the time alignment module. In the image frame capture system 1000 according to the first embodiment, the television program player 1100 includes a time calibration module 1120. In the image capture system 2000 according to the second embodiment, the user terminal 2200 includes a time calibration module 2220. The communication module 2110, the image frame extraction module 2120, the image frame buffer module 2130, the signal decoding module 2140, and the communication module 2210 in the user terminal 2200 in the television program player 2100 of the image frame capture system 2000 according to the second embodiment of the present invention. The user interface module 2230, the display module 2240, and the communication module 1110, the image frame extraction module 1130, the image frame buffer module 1140, the signal decoding module 1150, the communication module 1210, the user interface module 1220, and the display module according to the first embodiment of the present invention. The 1230 is functionally identical.
图3示出了根据本发明第一实施例的时间校准模块1120的工作示意图。在校准过程中,电视节目播放器1100通过通信模块1110向用户终端1200发送校准消息,该校准消息包括电视接收机的系统时间戳T1。然后,用户终端1200在接收到校准消息时,向该校准消息添加用户终端的系统时间戳T2。当用户终端1200对校准消息处理完成之后将校准消息反馈给电视节目播放器1100时,其添加时间戳T3。电视节目播放器1100在接收到反馈的校准消息时立即添加新的时间戳T4。然后,时间校准模块1120可以计算电视节目播放器1100与用户终端1200之间的时间差为:Td=((T2-T1)+(T3-T4))/2。FIG. 3 shows a schematic diagram of the operation of the time calibration module 1120 in accordance with the first embodiment of the present invention. During the calibration process, the television program player 1100 transmits a calibration message to the user terminal 1200 via the communication module 1110, the calibration message including the system timestamp T 1 of the television receiver. Then, when receiving the calibration message, the user terminal 1200 adds the system timestamp T 2 of the user terminal to the calibration message. When the user terminal 1200 to complete the calibration process calibration message back to the TV program player message 1100, its timestamp T 3. The television program player 1100 immediately adds a new time stamp T 4 upon receiving the feedback calibration message. Then, the time calibration module 1120 can calculate the time difference between the television program player 1100 and the user terminal 1200 as: T d = ((T 2 - T 1 ) + (T 3 - T 4 ))/2.
图4示出了根据本发明第二实施例的时间校准模块2220的工作示意图。时间校准模块2220的工作原理与时间校准模块1120的工作原理相同。具体地,首先,由用户终端2200向电视节目播放器2100发送包括用户终端的系统时间戳T1的校准消息。电视节目播放器2100在接收到校准消息时,向该校准消息添加电视接收机的系统时间戳T2。在电视节目播放器2100对校准消息处理完成之后将校准消息反馈给用户终端2200时,其添加时间戳T3。用户终端2200在接收到反馈的校准消息时 立即添加新的时间戳T4。然后,时间校准模块2220可以计算用户终端2200与电视节目播放器2100之间的时间差为:Td=((T2-T1)+(T3-T4))/2。FIG. 4 shows a schematic diagram of the operation of the time calibration module 2220 in accordance with the second embodiment of the present invention. The operation of the time calibration module 2220 is the same as that of the time calibration module 1120. Specifically, first, a calibration message including the system timestamp T 1 of the user terminal is transmitted from the user terminal 2200 to the television program player 2100. When the television program player 2100 receives the calibration message, it adds the system time stamp T 2 of the television receiver to the calibration message. After the television program broadcast message 2100 calibration the calibration process is completed when the message back to the user terminal 2200, its timestamp T 3. The user terminal 2200 immediately adds a new timestamp T 4 upon receiving the feedback calibration message. The time calibration module 2220 can then calculate the time difference between the user terminal 2200 and the television program player 2100 as: T d = ((T 2 - T 1 ) + (T 3 - T 4 ))/2.
回到图2,在根据本发明第二实施例的图像帧捕获系统2000中,用户接口模块2230在例如用户按下特定按键、点击鼠标、触摸显示屏等时,接收到用户输入的图像帧获取请求,并确定当前时间,即接收到图像帧获取请求的时间。时间校准模块2220根据用户终端2200与电视节目播放器2100之间的时间差Td和请求发送时间Ts,确定在电视节目播放器的时间基准上的请求发送时间Te=Ts-Td,即要提取的图像帧的时间。然后,时间校准模块2220将所确定的请求发送时间Te发送给通信模块2210,通信模块2210随后通过网络向电视节目播放器2100发送捕获图像帧的请求,该请求包含指示所确定的请求发送时间Te的信息。接收到请求的通信模块2110向图像帧提取模块2120转发该请求。图像帧提取模块2120从缓存了所播放的节目的图像帧的图像帧缓存模块2130中提取与请求中包含的请求发送时间Te相对应的图像帧。信号解码模块2140对电视节目的模拟或数字数据进行解码,并将解码数据缓以图像帧的形式缓存在图像帧缓存模块2130中。然后,通信模块2110将所提取的图像帧发送给用户终端1200。用户终端1200可以在显示模块2240上显示所接收的图像帧。Referring back to FIG. 2, in the image frame capture system 2000 according to the second embodiment of the present invention, the user interface module 2230 receives an image frame acquisition input by the user when, for example, the user presses a specific button, clicks a mouse, touches a display screen, or the like. Request and determine the current time, which is the time at which the image frame acquisition request was received. The time calibration module 2220 determines the request transmission time T e =T s -T d on the time base of the television program player according to the time difference T d between the user terminal 2200 and the television program player 2100 and the request transmission time T s . That is the time of the image frame to be extracted. The time calibration module 2220 then transmits the determined request transmission time T e to the communication module 2210, which then transmits a request to the television program player 2100 to capture the image frame over the network, the request including the indication of the determined request transmission time. T e information. The communication module 2110 that received the request forwards the request to the image frame extraction module 2120. The image frame extraction module 2120 extracts an image frame corresponding to the request transmission time T e included in the request from the image frame buffer module 2130 that buffers the image frame of the played program. The signal decoding module 2140 decodes the analog or digital data of the television program and buffers the decoded data in the image frame buffer module 2130 in the form of an image frame. The communication module 2110 then transmits the extracted image frame to the user terminal 1200. User terminal 1200 can display the received image frame on display module 2240.
根据本发明的实施例,通过在图像帧捕获系统中设置时间校准模块,无论在电视接收机上还是在用户终端上放置时间校准模块,都可以消除电视接收机与用户终端之间的时间偏移,从而提高捕获用户想要的图像帧的精度。According to an embodiment of the present invention, by setting a time calibration module in an image frame capture system, the time offset between the television receiver and the user terminal can be eliminated whether the time calibration module is placed on the television receiver or on the user terminal. Thereby improving the accuracy of capturing the image frame desired by the user.
根据本发明的实施例,时间校准模块可以在启动时执行一次校准过程或者定期地、以其他方式执行校准过程,然后存储所确定的时间差,将其用于以后的操作中。According to an embodiment of the invention, the time calibration module may perform a calibration process at startup or periodically, otherwise perform a calibration process, and then store the determined time difference for use in subsequent operations.
在根据本发明第一和第二实施例的图像帧捕获系统中,用户通过用户接口模块输入请求,可以获得在电视节目播放器上播放的电视节目中、用户按下请求时的图像帧。In the image frame capturing system according to the first and second embodiments of the present invention, the user inputs a request through the user interface module, and an image frame when the user presses the request in the television program played on the television program player can be obtained.
根据一个示例,用户接口模块输入的请求可以是单次截屏命令,即 捕获当前图像帧的请求,或者是连续截屏命令,即捕获连续多个图像帧的请求。例如,用户可以在时间T0按下用户接口模块上的命令按键,触发开始捕获图像帧,并在时间Tn释放该按键,结束图像帧的捕获。在该示例中,用户接口模块将用户输入请求的起始时间和结束时间作为接收到请求的时间。这样,电视节目播放器接收到的请求中指示请求发送时间的信息指示了一段时间,而不是一个时间点。在该示例中,如图1所示,图像帧提取模块1130可以包括提取图像帧确定模块1132,被配置为确定该时间段的长度。如果该时间段的长度小于预定阈值,而确定要提取的图像帧是缓存的图像帧中与该时间段的起始时间相对应的图像帧。而如果该时间段的长度不小于所述预定阈值,则确定要提取的图像帧包括缓存的图像帧中从与该时间段的起始时间相对应的图像帧到与该时间段的结束时间相对应的图像帧的多个图像帧。According to one example, the request entered by the user interface module can be a single screen shot command, i.e., a request to capture a current image frame, or a continuous screen capture command, i.e., a request to capture a plurality of consecutive image frames. For example, the user can press the command button on the user interface module at time T 0 to trigger the start of capturing the image frame and release the button at time T n to end the capture of the image frame. In this example, the user interface module takes the start time and end time of the user input request as the time at which the request was received. Thus, the information indicating the request transmission time in the request received by the television program player indicates a period of time instead of a point in time. In this example, as shown in FIG. 1, image frame extraction module 1130 can include an extracted image frame determination module 1132 configured to determine the length of the time period. If the length of the time period is less than a predetermined threshold, it is determined that the image frame to be extracted is an image frame in the buffered image frame corresponding to the start time of the time period. And if the length of the time period is not less than the predetermined threshold, determining that the image frame to be extracted includes the image frame corresponding to the start time of the time period in the buffered image frame to the end time of the time period Multiple image frames of the corresponding image frame.
图5示出了根据本发明实施例的确定要提取的图像帧的操作的示意图。如图5所示,在用户在时间T0按下按键并在时间Tn释放该按键的情况下,假定预定阈值是800ms。如果Tn-T0<800ms,则要提取的图像帧是帧0。如果Tn-T0>=800ms,则要提取的图像帧包括从帧0到帧N的N+1个图像帧。FIG. 5 shows a schematic diagram of an operation of determining an image frame to be extracted, according to an embodiment of the present invention. 5, in a case where the time period T 0 the user pressing the button and releasing the button at time T n, the predetermined threshold is assumed to 800ms. If T n -T 0 <800ms, the image frame to be extracted is frame 0. If T n -T 0 >=800 ms, the image frame to be extracted includes N+1 image frames from frame 0 to frame N.
根据本发明的实施例,可以在存在多个电视节目播放器的情况下操作。图6示出了根据本发明实施例的存在多个电视节目播放器的情形的示意图。如图6所示,假定存在N个电视节目播放器。在该实施例中,用户终端的通信模块在需要时广播搜索请求。接收到搜索请求的电视节目播放器将反馈包括其标识信息的响应消息,该标识信息可以是例如电视节目播放器的IP地址、标识符id、序列号、制造商的信息、模型等信息。接收到响应消息的用户终端可以识别各个电视节目播放器,并在后续发送的图像帧获取请求中包括作为捕获目标的电视节目播放器的信息。相应地,接收到图像帧捕获请求的电视节目播放器将识别请求中指示的电视节目播放器,如果是自身,则执行图像帧捕获操作,如果不是,则忽略该请求。According to an embodiment of the present invention, it is possible to operate in the presence of a plurality of television program players. FIG. 6 shows a schematic diagram of a situation in which a plurality of television program players exist in accordance with an embodiment of the present invention. As shown in Figure 6, it is assumed that there are N television program players. In this embodiment, the communication module of the user terminal broadcasts a search request as needed. The television program player receiving the search request will feed back a response message including its identification information, which may be, for example, the IP address of the television program player, the identifier id, the serial number, the manufacturer's information, the model, and the like. The user terminal receiving the response message can identify each television program player and include information of the television program player as the capture target in the subsequently transmitted image frame acquisition request. Accordingly, the television program player that received the image frame capture request will identify the television program player indicated in the request, and if it is itself, perform an image frame capture operation, if not, ignore the request.
图7示出了根据本发明实施例的存在多个电视节目播放器的情形的另一示意图。如图7所示,假定存在N个电视节目播放器。在该实施例 中,电视节目播放器定期地、或者在需要时,例如在开机时,广播标识其自身的信息,例如电视节目播放器的IP地址、标识符id、序列号、制造商的信息、模型等。接收到标识信息的用户终端可以识别各个电视节目播放器,并在后续发送的图像帧获取请求中包括作为捕获目标的电视节目播放器的信息。相应地,接收到图像帧捕获请求的电视节目播放器将识别请求中指示的电视节目播放器,如果是自身,则执行图像帧捕获操作,如果不是,则忽略该请求。在用户始终保持用户终端开机的情况下,利用该实施例,用户终端不需要经常广播搜索请求来搜索能够与之通信的电视节目播放器。例如,电视节目播放器在开机时发送其标识信息,以向用户终端通知其存在性。这样,可以减少资源的浪费。FIG. 7 illustrates another schematic diagram of a situation in which multiple television program players exist in accordance with an embodiment of the present invention. As shown in Fig. 7, it is assumed that there are N television program players. In this embodiment The television program player broadcasts information identifying itself, such as the IP address of the television program player, the identifier id, the serial number, the manufacturer's information, the model, etc., periodically or when needed, for example, at power on. The user terminal receiving the identification information can identify each television program player and include information of the television program player as the capture target in the subsequently transmitted image frame acquisition request. Accordingly, the television program player that received the image frame capture request will identify the television program player indicated in the request, and if it is itself, perform an image frame capture operation, if not, ignore the request. With the user always keeping the user terminal powered on, with this embodiment, the user terminal does not need to frequently broadcast a search request to search for a television program player with which it can communicate. For example, the television program player transmits its identification information upon power on to inform the user terminal of its presence. In this way, the waste of resources can be reduced.
图8示出了根据本发明实施例的电视节目图像帧捕获方法800的流程图。如图8所示,在电视节目播放器播放电视节目时,该方法开始。在步骤S810,缓存所播放的电视节目的多个图像帧。接下来在步骤S820,从用户终端接收捕获图像帧的请求,所述请求包含指示请求发送时间的信息。在步骤S830,根据所述电视节目图像帧捕获设备与所述外部设备之间的时间差以及所述请求中包含的指示请求发送时间的信息,确定要提取的图像帧的时间。最后,在步骤S840,从缓存的多个图像帧中提取与所确定的要提取的图像帧的时间相对应的图像帧。FIG. 8 shows a flow diagram of a television program image frame capture method 800 in accordance with an embodiment of the present invention. As shown in Figure 8, the method begins when the television program player plays the television program. At step S810, a plurality of image frames of the played television program are buffered. Next, in step S820, a request to capture an image frame is received from the user terminal, the request including information indicating a request transmission time. In step S830, the time of the image frame to be extracted is determined according to the time difference between the television program image frame capturing device and the external device and the information indicating the request transmission time included in the request. Finally, in step S840, an image frame corresponding to the determined time of the image frame to be extracted is extracted from the buffered plurality of image frames.
这样,可以精确地捕获在发出捕获图像帧的请求时播放的图像帧。可以将所捕获的图像帧返回发出请求的用户终端,以便在用户终端上显示。In this way, it is possible to accurately capture an image frame that is played when a request to capture an image frame is issued. The captured image frame can be returned to the requesting user terminal for display on the user terminal.
在根据该实施例的方法中,执行该方法的电视节目播放器可以提前执行与用户终端的校准过程,以确定并保存电视节目播放器与用户终端的时间差,以供后续使用。In the method according to this embodiment, the television program player performing the method can perform a calibration process with the user terminal in advance to determine and save the time difference between the television program player and the user terminal for subsequent use.
如果接收到的时间是一段时间,则该方法还包括步骤:确定要提取的图像帧的时间段的长度,如果该时间段的长度小于预定阈值,则确定要提取的图像帧是与所述时间段的起始时间相对应的图像帧;如果所述长度不小于所述预定阈值,则确定要提取的图像帧包括所缓存的图像帧中从与所述时间段的起始时间相对应的图像帧到与所述时间段的结束时间相对应的图像帧的多个图像帧。 If the received time is a period of time, the method further includes the step of determining a length of a time period of the image frame to be extracted, and if the length of the time period is less than a predetermined threshold, determining that the image frame to be extracted is the time An image frame corresponding to a start time of the segment; if the length is not less than the predetermined threshold, determining that the image frame to be extracted includes an image from the cached image frame corresponding to a start time of the time period Frames to a plurality of image frames of an image frame corresponding to an end time of the time period.
在缓存电视节目的多个图像帧之前,该方法还包括步骤:对电视节目的数据进行解码,并将解码数据以图像帧的形式缓存。Before caching a plurality of image frames of the television program, the method further includes the steps of: decoding the data of the television program and buffering the decoded data in the form of image frames.
该方法还可应用于存在多个电视节目播放器的情形。在该情形下,电视节目播放器在开机时广播其标识信息,或者在从用户终端接收到搜索请求时向用户终端反馈其标识信息。用户终端将在其发送的捕获图像帧的请求中包括作为捕获目标的电视节目播放器的标识信息。The method can also be applied to situations where there are multiple television program players. In this case, the television program player broadcasts its identification information when it is turned on, or feeds back its identification information to the user terminal when receiving a search request from the user terminal. The user terminal will include identification information of the television program player as the capture target in the request of the captured image frame it transmits.
图9示出了根据本发明实施例的电视节目图像帧获取方法900的流程图。如图9所示,在用户观看电视节目播放器播放的电视节目的同时想要捕获所观看的图像帧时,该方法开始。在步骤S910,通过用户接口模块,接收用户输入的图像帧获取请求,并确定接收到所述图像帧获取请求的时间。接下来在步骤S920,根据所述电视节目图像帧获取设备与电视节目播放器之间的时间差以及接收到所述图像帧获取请求的时间,确定在所述电视节目播放器上要捕获的图像帧的时间。在步骤S930,向所述电视节目播放器发送捕获图像帧的请求,所述请求包含指示所确定的要捕获的图像帧的时间的信息。FIG. 9 shows a flow diagram of a television program image frame acquisition method 900 in accordance with an embodiment of the present invention. As shown in FIG. 9, the method begins when the user wants to capture the viewed image frame while watching the television program played by the television program player. In step S910, an image frame acquisition request input by the user is received through the user interface module, and the time at which the image frame acquisition request is received is determined. Next, in step S920, determining an image frame to be captured on the television program player according to a time difference between the television program image frame acquisition device and the television program player and a time when the image frame acquisition request is received. time. At step S930, a request to capture an image frame is transmitted to the television program player, the request including information indicating a time of the determined image frame to be captured.
接收到捕获图像帧的请求的电视节目播放器可以捕获请求中支持的时间的图像帧,并反馈所捕获的图像帧。这样,可以精确地捕获在发出捕获图像帧的请求时在电视节目播放器上播放的图像帧。A television program player that receives a request to capture an image frame may capture an image frame of the time supported in the request and feed back the captured image frame. In this way, image frames that are played on the television program player when a request to capture an image frame is issued can be accurately captured.
在根据该实施例的方法中,执行该方法的用户终端可以提前执行与电视节目播放器的校准过程,以确定并保存用户终端与电视节目播放器的时间差,以供后续使用。In the method according to this embodiment, the user terminal performing the method can perform a calibration process with the television program player in advance to determine and save the time difference between the user terminal and the television program player for subsequent use.
如果用户希望捕获一系列图像帧,则可以持续地输入请求。在该情况下,所确定的接收到图像帧获取请求的时间包括:确定用户输入的图像帧获取请求的起始时间和结束时间,作为接收到所述图像帧获取请求的时间。If the user wishes to capture a series of image frames, the request can be continuously entered. In this case, the determined time of receiving the image frame acquisition request includes determining a start time and an end time of the image frame acquisition request input by the user as the time at which the image frame acquisition request is received.
该方法还可应用于存在多个电视节目播放器的情形。在该情形下,用户终端可以接收电视节目播放器广播的标识信息,确定作为捕获目标的电视节目播放器。或者用户终端广播搜索请求,并作为响应从多个电视节目播放器接收到反馈的标识信息。用户终端将在其发送的捕获图像帧的请求中包括作为捕获目标的电视节目播放器的标识信息。 The method can also be applied to situations where there are multiple television program players. In this case, the user terminal can receive the identification information broadcast by the television program player to determine the television program player as the capture target. Or the user terminal broadcasts the search request and receives the feedback identification information from the plurality of television program players in response. The user terminal will include identification information of the television program player as the capture target in the request of the captured image frame it transmits.
虽然上面描述了根据本发明实施例的方法,当然,上述方法的步骤之间的顺序并不一定限制为如图所示。而且,根据本发明实施例的方法也不局限于上述步骤。而且,根据本发明实施例的设备并不局限于所示的结构,可以包括额外的模块。此外,所示的模块可以是分立的模块,或者以各种方式组合或分离为更多的模块。Although the method according to an embodiment of the present invention has been described above, of course, the order between the steps of the above method is not necessarily limited as shown. Moreover, the method according to an embodiment of the present invention is not limited to the above steps. Moreover, devices in accordance with embodiments of the invention are not limited to the structures shown, and may include additional modules. Moreover, the modules shown may be discrete modules or combined or separated into more modules in various ways.
虽然已经展示并描述了本发明的特定实施例和应用,应当理解,本发明不限于在此公开的精确配置和元件。在不偏离本发明的精髓和保护范围的前提下,可以在在此公开的本发明的方法和系统的配置、操作和细节上进行对本领域技术人员来说非常明显的各种修改、变形和变化。 While particular embodiments and applications of the invention have been shown and described, it is understood that the invention Various modifications, variations and changes obvious to those skilled in the art can be made in the configuration, operation and details of the method and system of the present invention disclosed herein without departing from the spirit and scope of the invention. .

Claims (32)

  1. 一种电视节目图像帧捕获设备,包括:A television program image frame capturing device, comprising:
    图像帧缓存模块,被配置为缓存有电视节目的多个图像帧;An image frame buffer module configured to buffer a plurality of image frames of a television program;
    通信模块,被配置为从外部设备接收捕获图像帧的请求,所述请求包含指示请求发送时间的信息;a communication module configured to receive a request to capture an image frame from an external device, the request including information indicating a request transmission time;
    时间校准模块,被配置为根据所述电视节目图像帧捕获设备与外部设备之间的时间差以及所述请求中包含的指示请求发送时间的信息,确定要提取的图像帧的时间;以及a time calibration module configured to determine a time of an image frame to be extracted according to a time difference between the television program image frame capture device and an external device and information indicating a request transmission time included in the request;
    图像帧提取模块,被配置为从所述图像帧缓存模块中提取与时间校准模块所确定的时间相对应的图像帧。An image frame extraction module is configured to extract an image frame corresponding to the time determined by the time alignment module from the image frame buffer module.
  2. 根据权利要求1所述的电视节目图像帧捕获设备,其中所述时间校准模块还被配置为与所述外部设备执行校准过程,以确定所述电视节目图像帧捕获设备与所述外部设备之间的时间差。A television program image frame capture device according to claim 1, wherein said time alignment module is further configured to perform a calibration process with said external device to determine between said television program image frame capture device and said external device The time difference.
  3. 根据权利要求2所述的电视节目图像帧捕获设备,其中所述校准过程包括:The television program image frame capture device of claim 2 wherein said calibration process comprises:
    所述电视节目图像帧捕获设备向所述外部设备发送消息,所述消息包括指示消息发送时间T1的时间戳,The frame image capturing apparatus television program sending a message to the external device, the message comprising a time stamp indication message sending time T 1,
    所述外部设备在接收到所述消息时向消息添加时间戳T2The external device adds a timestamp T 2 to the message when receiving the message,
    所述外部设备在向所述电视节目图像帧捕获设备反馈所述消息时添加时间戳T3The external device when the timestamp T 3 of the apparatus a feedback message to capture an image frame of the television program,
    所述电视节目图像帧捕获设备在接收到反馈的消息时添加时间戳T4The television program image frame capture device adds a timestamp T 4 when receiving the feedback message,
    其中,所述时间校准模块确定所述电视节目图像帧捕获设备与所述外部设备之间的时间差为((T2-T1)+(T3-T4))/2。The time calibration module determines that the time difference between the television program image frame capture device and the external device is ((T 2 -T 1 )+(T 3 -T 4 ))/2.
  4. 根据权利要求1所述的电视节目图像帧捕获设备,其中所述时间校准模块所确定的时间包括起始时间和结束时间,并且所述图像帧提取模块包括提取图像帧确定模块,被配置为确定所述起始时间和所述结束时间之差,作为要提取的图像帧的时间长度,如果所述时间长度小于预定阈值,则确定要提取的图像帧是所述图像帧缓存模块中与所述起始时 间相对应的图像帧;如果所述时间长度不小于所述预定阈值,则确定要提取的图像帧包括所述图像帧缓存模块中从与所述起始时间相对应的图像帧到与所述结束时间相对应的图像帧的多个图像帧。A television program image frame capture device according to claim 1, wherein said time determined by said time alignment module comprises a start time and an end time, and said image frame extraction module comprises an extracted image frame determination module configured to determine a difference between the start time and the end time, as a length of time of an image frame to be extracted, if the time length is less than a predetermined threshold, determining that an image frame to be extracted is in the image frame buffer module and Initial time Corresponding image frames; if the length of time is not less than the predetermined threshold, determining that the image frame to be extracted includes from the image frame corresponding to the start time in the image frame buffer module to A plurality of image frames of an image frame corresponding to the end time.
  5. 根据权利要求1所述的电视节目图像帧捕获设备,还包括信号解码模块,被配置为对电视节目的数据进行解码,并将解码数据以图像帧的形式缓存在所述图像帧缓存模块中。The television program image frame capture device of claim 1 further comprising a signal decoding module configured to decode data of the television program and to buffer the decoded data in the image frame buffer module in the form of an image frame.
  6. 根据权利要求1所述的电视节目图像帧捕获设备,其中所述通信模块还被配置为在所述电视节目图像帧捕获设备开机时,广播标识所述电视节目图像帧捕获设备的信息。The television program image frame capture device of claim 1, wherein the communication module is further configured to broadcast information identifying the television program image frame capture device when the television program image frame capture device is powered on.
  7. 根据权利要求1所述的电视节目图像帧捕获设备,其中所述通信模块还被配置为在从所述外部设备接收到搜索请求时,向所述外部设备反馈标识所述电视节目图像帧捕获设备的信息。The television program image frame capture device of claim 1, wherein the communication module is further configured to, when receiving a search request from the external device, feed back the television program image frame capture device to the external device Information.
  8. 根据权利要求1所述的电视节目图像帧捕获设备,其中所述通信模块从外部设备接收的所述捕获图像帧的请求还包括指示所述电视节目图像帧捕获设备的信息。The television program image frame capturing apparatus according to claim 1, wherein said request for said captured image frame received by said communication module from said external device further comprises information indicating said television program image frame capturing device.
  9. 一种电视节目图像帧捕获系统,包括:A television program image frame capture system comprising:
    根据权利要求1-8之一所述的电视节目图像帧捕获设备;以及A television program image frame capture device according to any one of claims 1-8;
    外部设备,被配置为向所述电视节目图像帧捕获设备发送捕获图像帧的请求,所述请求包含指示请求发送时间的信息。An external device configured to transmit a request to capture the image frame to the television program image frame capture device, the request including information indicating a request transmission time.
  10. 一种电视节目图像帧获取设备,包括:A television program image frame acquiring device includes:
    用户接口模块,被配置为接收用户输入的图像帧获取请求,确定接收到所述图像帧获取请求的时间;a user interface module configured to receive an image frame acquisition request input by the user, and determine a time when the image frame acquisition request is received;
    时间校准模块,被配置为根据所述电视节目图像帧获取设备与电视节目播放器之间的时间差以及接收到所述图像帧获取请求的时间,确定在所述电视节目播放器上要捕获的图像帧的时间;以及a time calibration module configured to determine an image to be captured on the television program player based on a time difference between the television program image frame acquisition device and the television program player and a time at which the image frame acquisition request is received The time of the frame;
    通信模块,被配置为向所述电视节目播放器发送捕获图像帧的请求,所述请求包含指示所确定的要捕获的图像帧的时间的信息。A communication module configured to send a request to the television program player to capture an image frame, the request including information indicating a time of the determined image frame to be captured.
  11. 根据权利要求10所述的电视节目图像帧获取设备,其中所述时间校准模块还被配置为与所述电视节目播放器执行校准过程,以确定所述电视节目图像帧获取设备与所述电视节目播放器之间的时间差。 A television program image frame acquiring apparatus according to claim 10, wherein said time alignment module is further configured to perform a calibration process with said television program player to determine said television program image frame obtaining device and said television program The time difference between the players.
  12. 根据权利要求11所述的电视节目图像帧获取设备,其中所述校准过程包括:The television program image frame acquiring apparatus according to claim 11, wherein said calibration process comprises:
    所述电视节目图像帧获取设备向所述电视节目播放器发送消息,所述消息包括指示消息发送时间T1的时间戳,The television program image acquisition device to send a message frame to the TV program player, said message comprising a time stamp indication message sending time T 1,
    所述电视节目播放器在接收到所述消息时向消息添加时间戳T2The television program player adds a timestamp T 2 to the message upon receiving the message,
    所述电视节目播放器在向所述电视节目图像帧获取设备反馈所述消息时添加时间戳T3The TV program player timestamp T 3 when the apparatus a feedback frame acquiring the message to the television program image,
    所述电视节目图像帧获取设备在接收到反馈的消息时添加时间戳T4The television program image frame acquiring device adds a time stamp T 4 when receiving the feedback message,
    其中,所述时间校准模块确定所述电视节目图像帧获取设备与所述电视节目播放器之间的时间差为((T2-T1)+(T3-T4))/2。The time calibration module determines that the time difference between the television program image frame acquiring device and the television program player is ((T 2 -T 1 )+(T 3 -T 4 ))/2.
  13. 根据权利要求10所述的电视节目图像帧获取设备,其中所述用户接口模块还被配置为:确定用户输入的图像帧获取请求的起始时间和结束时间,作为接收到所述图像帧获取请求的时间。The television program image frame acquiring apparatus according to claim 10, wherein said user interface module is further configured to: determine a start time and an end time of an image frame acquisition request input by the user as the image frame acquisition request is received time.
  14. 根据权利要求10所述的电视节目图像帧获取设备,其中所述通信模块还被配置为从至少一个电视节目播放器接收标识所述电视节目播放器的信息。The television program image frame acquiring apparatus according to claim 10, wherein said communication module is further configured to receive information identifying said television program player from at least one television program player.
  15. 根据权利要求14所述的电视节目图像帧获取设备,其中所述标识所述电视节目播放器的信息是响应于所述通信模块广播搜索请求而接收到的。The television program image frame acquiring apparatus according to claim 14, wherein said information identifying said television program player is received in response to said communication module broadcasting a search request.
  16. 根据权利要求14或15所述的电视节目图像帧获取设备,其中所述捕获图像帧的请求还包括指示作为捕获目标的电视节目播放器的信息。A television program image frame acquiring apparatus according to claim 14 or 15, wherein said request for capturing an image frame further comprises information indicating a television program player as a capturing target.
  17. 一种电视节目图像帧捕获系统,包括:A television program image frame capture system comprising:
    根据权利要求10-16之一所述的电视节目图像帧获取设备;以及A television program image frame acquiring apparatus according to any one of claims 10-16;
    电视节目播放器,包括:TV show player, including:
    图像帧缓存模块,被配置为缓存有电视节目的多个图像帧;An image frame buffer module configured to buffer a plurality of image frames of a television program;
    通信模块,被配置为从所述电视节目图像帧获取设备接收捕获图像帧的请求,所述请求包含指示要捕获的图像帧的时间的信息;a communication module configured to receive a request to capture an image frame from the television program image frame acquisition device, the request including information indicating a time of an image frame to be captured;
    以及 as well as
    图像帧提取模块,被配置为从所述图像帧缓存模块中提取与要捕获的图像帧的时间相对应的图像帧;An image frame extraction module configured to extract an image frame corresponding to a time of an image frame to be captured from the image frame buffer module;
    其中,所述电视节目播放器的通信模块将所提取的图像帧发送给所述电视节目图像帧获取设备。The communication module of the television program player transmits the extracted image frame to the television program image frame acquisition device.
  18. 一种在电视节目图像帧捕获设备中执行的方法,包括:A method performed in a television program image frame capture device, comprising:
    缓存电视节目的多个图像帧;Cache multiple image frames of a television program;
    从外部设备接收捕获图像帧的请求,所述请求包含指示请求发送时间的信息;Receiving a request to capture an image frame from an external device, the request including information indicating a time of request to send;
    根据所述电视节目图像帧捕获设备与所述外部设备之间的时间差以及所述请求中包含的指示请求发送时间的信息,确定要提取的图像帧的时间;以及Determining a time of an image frame to be extracted according to a time difference between the television program image frame capturing device and the external device and information indicating a request transmission time included in the request;
    从缓存的多个图像帧中提取与所确定的要提取的图像帧的时间相对应的图像帧。An image frame corresponding to the determined time of the image frame to be extracted is extracted from the buffered plurality of image frames.
  19. 根据权利要求18所述的方法,还包括:The method of claim 18, further comprising:
    与所述外部设备执行校准过程,以确定所述电视节目图像帧捕获设备与所述外部设备之间的时间差。A calibration process is performed with the external device to determine a time difference between the television program image frame capture device and the external device.
  20. 根据权利要求19所述的方法,其中所述校准过程包括:The method of claim 19 wherein said calibrating process comprises:
    所述电视节目图像帧捕获设备向所述外部设备发送消息,所述消息包括指示消息发送时间T1的时间戳,The frame image capturing apparatus television program sending a message to the external device, the message comprising a time stamp indication message sending time T 1,
    所述外部设备在接收到所述消息时向消息添加时间戳T2The external device adds a timestamp T 2 to the message when receiving the message,
    所述外部设备在向所述电视节目图像帧捕获设备反馈所述消息时添加时间戳T3The external device when the timestamp T 3 of the apparatus a feedback message to capture an image frame of the television program,
    所述电视节目图像帧捕获设备在接收到反馈的消息时添加时间戳T4The television program image frame capture device adds a timestamp T 4 when receiving the feedback message,
    其中,所述电视节目图像帧捕获设备与所述外部设备之间的时间差被确定为((T2-T1)+(T3-T4))/2。The time difference between the television program image frame capturing device and the external device is determined as ((T 2 -T 1 )+(T 3 -T 4 ))/2.
  21. 根据权利要求18所述的方法,其中所确定的时间包括起始时间和结束时间,并且所述方法还包括:确定所述起始时间和所述结束时间之差,作为要提取的图像帧的时间长度,如果所述时间长度小于预定阈值,则确定要提取的图像帧是与所述起始时间相对应的图像帧;如果所 述时间长度不小于所述预定阈值,则确定要提取的图像帧包括所缓存的图像帧中从与所述起始时间相对应的图像帧到与所述结束时间相对应的图像帧的多个图像帧。The method of claim 18, wherein the determined time comprises a start time and an end time, and the method further comprises: determining a difference between the start time and the end time as an image frame to be extracted a length of time, if the length of time is less than a predetermined threshold, determining that the image frame to be extracted is an image frame corresponding to the start time; Determining that the length of time is not less than the predetermined threshold, determining that the image frame to be extracted includes a plurality of image frames corresponding to the start time in the buffered image frame to an image frame corresponding to the end time Image frame.
  22. 根据权利要求18所述的方法,还包括:对电视节目的数据进行解码,并将解码数据以图像帧的形式缓存。The method of claim 18, further comprising: decoding the data of the television program and buffering the decoded data in the form of an image frame.
  23. 根据权利要求18所述的方法,还包括:在所述电视节目图像帧捕获设备开机时,广播标识所述电视节目图像帧捕获设备的信息。The method of claim 18, further comprising broadcasting information identifying the television program image frame capture device when the television program image frame capture device is powered on.
  24. 根据权利要求18所述的方法,还包括:在从所述外部设备接收到搜索请求时,向所述外部设备反馈标识所述电视节目图像帧捕获设备的信息。The method of claim 18, further comprising: feeding back information identifying the television program image frame capture device to the external device upon receiving a search request from the external device.
  25. 根据权利要求18所述的方法,其中从外部设备接收的所述捕获图像帧的请求还包括指示所述电视节目图像帧捕获设备的信息。The method of claim 18, wherein the request to capture the image frame received from the external device further comprises information indicative of the television program image frame capture device.
  26. 一种在电视节目图像帧获取设备中执行的方法,包括:A method performed in a television program image frame acquiring device, comprising:
    接收用户输入的图像帧获取请求,确定接收到所述图像帧获取请求的时间;Receiving an image frame acquisition request input by the user, determining a time when the image frame acquisition request is received;
    根据所述电视节目图像帧获取设备与电视节目播放器之间的时间差以及接收到所述图像帧获取请求的时间,确定在所述电视节目播放器上要捕获的图像帧的时间;Determining a time of an image frame to be captured on the television program player according to a time difference between the television program image frame acquiring device and the television program player and a time when the image frame acquisition request is received;
    向所述电视节目播放器发送捕获图像帧的请求,所述请求包含指示所确定的要捕获的图像帧的时间的信息。A request to capture an image frame is transmitted to the television program player, the request including information indicating a time of the determined image frame to be captured.
  27. 根据权利要求25所述的方法,还包括:The method of claim 25, further comprising:
    与所述电视节目播放器执行校准过程,以确定所述电视节目图像帧获取设备与所述电视节目播放器之间的时间差。A calibration process is performed with the television program player to determine a time difference between the television program image frame acquisition device and the television program player.
  28. 根据权利要求27所述的方法,其中所述校准过程包括:The method of claim 27 wherein said calibrating process comprises:
    所述电视节目图像帧获取设备向所述电视节目播放器发送消息,所述消息包括指示消息发送时间T1的时间戳,The television program image acquisition device to send a message frame to the TV program player, said message comprising a time stamp indication message sending time T 1,
    所述电视节目播放器在接收到所述消息时向消息添加时间戳T2The television program player adds a timestamp T 2 to the message upon receiving the message,
    所述电视节目播放器在向所述电视节目图像帧获取设备反馈所述消息时添加时间戳T3The TV program player timestamp T 3 when the apparatus a feedback frame acquiring the message to the television program image,
    所述电视节目图像帧获取设备在接收到反馈的消息时添加时间戳 T4The television program image frame acquiring device adds a time stamp T 4 when receiving the feedback message,
    其中,所述电视节目图像帧获取设备与所述电视节目播放器之间的时间差被确定为((T2-T1)+(T3-T4))/2。The time difference between the television program image frame acquiring device and the television program player is determined as ((T 2 -T 1 )+(T 3 -T 4 ))/2.
  29. 根据权利要求26所述的方法,其中,确定接收到所述图像帧获取请求的时间还包括:The method of claim 26, wherein determining the time at which the image frame acquisition request is received further comprises:
    确定用户输入的图像帧获取请求的起始时间和结束时间,作为接收到所述图像帧获取请求的时间。The start time and end time of the image frame acquisition request input by the user are determined as the time at which the image frame acquisition request is received.
  30. 根据权利要求26所述的方法,还包括:The method of claim 26, further comprising:
    从至少一个电视节目播放器接收标识所述电视节目播放器的信息。Information identifying the television program player is received from at least one television program player.
  31. 根据权利要求30所述的方法,其中所述标识所述电视节目播放器的信息是响应于所述通信模块广播搜索请求而接收到的。The method of claim 30 wherein said information identifying said television program player is received in response to said communication module broadcasting a search request.
  32. 根据权利要求30或31所述的方法,其中所述捕获图像帧的请求还包括指示作为目标的电视节目播放器的信息。 A method according to claim 30 or 31, wherein said request to capture an image frame further comprises information indicative of a television program player as a target.
PCT/CN2015/071206 2014-01-21 2015-01-21 Television program image frame capturing device, television program image frame obtaining device, system and method WO2015110005A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2016546515A JP6219531B2 (en) 2014-01-21 2015-01-21 Television program image frame capture device, television program image frame acquisition device, system and method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410027554.0A CN104796753A (en) 2014-01-21 2014-01-21 TV program picture frame capturing device and system, TV program picture frame obtaining device, and method
CN201410027554.0 2014-01-21

Publications (1)

Publication Number Publication Date
WO2015110005A1 true WO2015110005A1 (en) 2015-07-30

Family

ID=53561207

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/071206 WO2015110005A1 (en) 2014-01-21 2015-01-21 Television program image frame capturing device, television program image frame obtaining device, system and method

Country Status (3)

Country Link
JP (1) JP6219531B2 (en)
CN (1) CN104796753A (en)
WO (1) WO2015110005A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106713972A (en) * 2016-12-27 2017-05-24 Ut斯达康(深圳)技术有限公司 Integrated broadcast control platform video content screen capturing method and integrated broadcast control platform video content screen capturing device
CN112414400B (en) * 2019-08-21 2022-07-22 浙江商汤科技开发有限公司 Information processing method and device, electronic equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080074548A1 (en) * 2006-09-25 2008-03-27 Hideki Nagata Television image capturing system
CN101527690A (en) * 2009-04-13 2009-09-09 腾讯科技(北京)有限公司 Method for intercepting dynamic image, system and device thereof
CN102421012A (en) * 2011-11-16 2012-04-18 王白 Method and system for acquiring screenshot picture of television program
CN103369372A (en) * 2013-07-17 2013-10-23 广州珠江数码集团有限公司 Live television screen capturing system and live television screen capturing method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013029263A1 (en) * 2011-09-01 2013-03-07 Technicolor (China) Technology Co., Ltd. Method for capturing video related content

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080074548A1 (en) * 2006-09-25 2008-03-27 Hideki Nagata Television image capturing system
CN101527690A (en) * 2009-04-13 2009-09-09 腾讯科技(北京)有限公司 Method for intercepting dynamic image, system and device thereof
CN102421012A (en) * 2011-11-16 2012-04-18 王白 Method and system for acquiring screenshot picture of television program
CN103369372A (en) * 2013-07-17 2013-10-23 广州珠江数码集团有限公司 Live television screen capturing system and live television screen capturing method

Also Published As

Publication number Publication date
CN104796753A (en) 2015-07-22
JP2017509200A (en) 2017-03-30
JP6219531B2 (en) 2017-10-25

Similar Documents

Publication Publication Date Title
RU2597232C1 (en) Method for providing a video in real time and device for its implementation, as well as a server and a terminal device
US20130205322A1 (en) Method and system for synchronization of dial testing and audience response utilizing automatic content recognition
WO2015090095A1 (en) Information pushing method, device, and system
CN105100829B (en) Video content intercept method and device
WO2017166509A1 (en) Video playback control method and device
CN110741651A (en) Methods, systems, and media for presenting notifications indicating recommended content
CN105704504B (en) Method, device, equipment and storage medium for inserting push information in live video
CN102917247B (en) Automatically the method identifying television channel and TV programme
JP2016535351A (en) Video information sharing method, apparatus, program, and recording medium
JP6289651B2 (en) Method and apparatus for synchronizing playback on two electronic devices
US10812875B2 (en) Method and apparatus for generating information associated with a lapsed presentation of media content
US8893166B2 (en) Method of surveying watching of image content, and broadcast receiving apparatus and server employing the same
US20170289584A1 (en) Method and apparatus for transmitting and receiving additional information in a broadcast communication system
CN105100906A (en) Play control method and play control device
US9756393B2 (en) Recording option for advertised programs
US20150271417A1 (en) Tv system with improved video switching capabilities, and associated tv environment, server and terminal
CN104903844A (en) Method for rendering data in a network and associated mobile device
CN111050204A (en) Video clipping method and device, electronic equipment and storage medium
WO2015110005A1 (en) Television program image frame capturing device, television program image frame obtaining device, system and method
JP6125454B2 (en) MATCHING DEVICE, MATCHING SYSTEM, AND MATCHING METHOD
CN111698261B (en) Video playing method, device, equipment and storage medium based on streaming media
JP2016506166A (en) Method and system for displaying event messages for registered video channels
CN101997869A (en) Method and apparatus for requesting data, and method and apparatus for obtaining data
CN107820133B (en) Method, television and system for providing virtual reality video on television
JP6212719B2 (en) Video receiving apparatus, information display method, and video receiving system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15741099

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2016546515

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15741099

Country of ref document: EP

Kind code of ref document: A1