AU2008207660A1 - Review layouts - Google Patents

Review layouts Download PDF

Info

Publication number
AU2008207660A1
AU2008207660A1 AU2008207660A AU2008207660A AU2008207660A1 AU 2008207660 A1 AU2008207660 A1 AU 2008207660A1 AU 2008207660 A AU2008207660 A AU 2008207660A AU 2008207660 A AU2008207660 A AU 2008207660A AU 2008207660 A1 AU2008207660 A1 AU 2008207660A1
Authority
AU
Australia
Prior art keywords
video
time
windows
temporal parameters
video data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
AU2008207660A
Inventor
Rajanish Calisa
Andrew James Lo
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Priority to AU2008207660A priority Critical patent/AU2008207660A1/en
Publication of AU2008207660A1 publication Critical patent/AU2008207660A1/en
Abandoned legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223—Cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4314—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/432—Content retrieval operation from a local storage medium, e.g. hard-disk
    • H04N21/4325—Content retrieval operation from a local storage medium, e.g. hard-disk by playing back content from the storage medium
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334—Recording operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4854—End-user interface for client configuration for modifying image parameters, e.g. image brightness, contrast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8543—Content authoring using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML]

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Security & Cryptography (AREA)
  • User Interface Of Digital Computer (AREA)

Description

S&F Ref: 835254 AUSTRALIA PATENTS ACT 1990 COMPLETE SPECIFICATION FOR A STANDARD PATENT Name and Address Canon Kabushiki Kaisha, of 30-2, Shimomaruko 3 of Applicant: chome, Ohta-ku, Tokyo, 146, Japan Actual Inventor(s): Rajanish Calisa Andrew James Lo Address for Service: Spruson & Ferguson St Martins Tower Level 35 31 Market Street Sydney NSW 2000 (CCN 3710000177) Invention Title: Review layouts The following statement is a full description of this invention, including the best method of performing it known to me/us: 5845c(1386723_1) REVIEW LAYOUTS FIELD OF INVENTION The present invention relates generally to digital video recording and, in particular, to a method, apparatus and system for displaying video data. The present invention also relates to 5 a computer program product including a computer readable medium having recorded thereon a computer program for displaying video data. DESCRIPTION OF BACKGROUND ART Video recording units such as Video Cassette Recorders (VCR) and digital hard disk video recorders are well known and widely used. Video recording units are often used as part of a 10 video recording system. Conventionally, a video recording unit is connected to one or more cameras. The video recording unit retrieves video and image data from the cameras and stores the data on hard disk drives or tapes. There are many uses for video recording systems including video monitoring, surveillance and security. In recent years, video recording units have been implemented as software resident on 15 standard personal computer platforms. Such software implemented video recording units typically connect to one or more video cameras directly on an Internet Protocol (IP) based network using standard protocols such as hyper-text transport protocol (HTTP). Video data transmitted over the network is normally in a digitized format (e.g., Motion JPEG, MPEG-2, MPEG-4). 20 Software implemented video recording units typically support the playing back of recorded video data for review purposes. Such units can optionally playback one or more streams of recorded video data, synchronously. In a security environment, it is common for operators to leave their video recording systems unattended for periods of time. For example, operators may patrol a secure location 25 on foot or the video recording system may only be monitored during business hours. To review recorded video data of events that occurred whilst the video recording system was unattended, the operator typically needs to select the relevant cameras to display or open a layout comprising video windows for relevant cameras. The operator may then use playback controls to control the time of recorded video data being displayed. 30 A common video data review task involves the review of video data from a previous night. This may be performed daily. Another common video data review task involves reviewing - I - 835254_Final (1385998vl) video data from a previous weekend. This may be performed weekly. Still another common video data review task involves reviewing an event that occurred from multiple cameras on an ad hoc basis. Thus, a need clearly exists for a video recording system that simplifies the steps involved in 5 performing the common review tasks described above. SUMMARY OF THE INVENTION According to one aspect of the present invention there is provided a video system, comprising: 10 a recording unit for recording video data, together with a time reference, captured by one or more video sources connected to the system; a layout specification containing display parameters and temporal parameters; a display unit for displaying one or more video windows on a display device based on the display parameters; and 15 a playback unit for playing back the recorded video data in the one or more video windows based on the time reference, the temporal parameters and a current date and/or time when the recorded video data is played. According to another aspect of the present invention there is provided a method of displaying video data, comprising: 20 recording video data, together with a time reference, captured by one or more video sources; determining display parameters and temporal parameters; displaying one or more video windows on a display device based on the display parameters; and 25 displaying the recorded video data in the one or more video windows based on the time reference and the temporal parameters. According to another aspect of the present invention there is provided a computer readable medium, having a program recorded thereon, where the program is configured to make a computer execute a procedure to display video data, said program comprising: 30 code for recording video data, together with a time reference, captured by one or more video sources; code for determining display parameters and temporal parameters; - 2 - 835254_Final (1385998vl) code for displaying one or more video windows on a display device based on the display parameters; and code for displaying the recorded video data in the one or more video windows based on the time reference and the temporal parameters. 5 According to another aspect of the present invention there is provided a system for displaying video data, the comprising: a memory for storing data and a computer program; and a processor coupled to said memory executing said computer program, said computer program comprising instructions for: 10 recording video data, together with a time reference, captured by one or more video sources; determining display parameters and temporal parameters; displaying one or more video windows on a display device based on the display parameters; and 15 displaying the recorded video data in the one or more video windows based on the time reference and the temporal parameters. BRIEF DESCRIPTION OF THE DRAWINGS 20 Fig. 1 is a diagram showing a digital video recording system upon which embodiments described herein can be practiced; Fig. 2 is a diagram showing a software architecture of the client and the storage server of the system of Fig. 1; Fig. 3 is an example layout specification for a review layout;. 25 Fig. 4 is a flow diagram showing a method of displaying video data; Fig. 5 is a flow diagram showing a method of determining request times; Fig. 6 is a flow diagram showing a method of providing recorded video data back to the client of Fig. 1; - 3 - 835254_Final (1385998v1) Fig. 7 shows an example of a client graphical user interface comprising a normal layout of video windows; Fig. 8 shows the client graphical user interface of Fig. 7 comprising a review layout of video windows; 5 Fig. 9 shows the client graphical user interface of Fig. 7 comprising another review layout of video windows; Fig. 10 is a schematic block diagram of a general-purpose computer upon which the client of Fig. 1 can be practiced; and Fig. 11 is a schematic block diagram of a general-purpose computer upon which the 10 storage server of Fig. I can be practiced. DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION Where reference is made in any one or more of the accompanying drawings to steps and/or features, which have the same reference numerals, those steps and/or features have for the purposes of this description the same function(s) or operation(s), unless the contrary intention 15 appears. A method 400 (see Fig. 4) of displaying video data, is described below with reference to Figs. I to 11. A method 500 of determining request times is also described. Further, a method 600 of providing recorded video data is also described. In an exemplary embodiment, the methods 400, 500 and 600 may be implemented within a video recording system 100, such 20 as that shown in Fig. 1. The system 100 comprises video sources in the form of video cameras 103, 104 and 105 connected to an IP based communications network 1020, such as the Internet or an intranet. Each of the cameras 103, 104 and 105 is independently responsible for capturing video data. The system 100 also comprises a client 1000 for processing and displaying captured video 25 data. The client 1000 can display live video data from the cameras 103-105. As seen in Fig. 10, the client 1000 is preferably formed by a computer module 1001, input devices such as a keyboard 1002 and mouse 1003, output devices including a printer (not illustrated) a display device 1014 and loudspeakers 1017. A Modulator-Demodulator (Modem) transceiver device 1016 is used by the computer module 1001 for communicating to and from the -4- 835254_Final (1385998v) communications network 1020, for example connectable via a telephone line 1021 or other functional medium. The modem 1016 can be used to obtain access to the communications network 1020 implemented in the form of the Internet or any other network system, such as a Local Area Network (LAN) or a Wide Area Network (WAN). The modem 1016 may be 5 incorporated into the computer module 1001 in some implementations. The computer module 1001 typically includes at least one processor unit 1005, and a memory unit 1006, for example formed from semiconductor random access memory (RAM) and read only memory (ROM). The module 1001 also includes a number of input/output (1/0) interfaces including an audio-video interface 1007 that couples to the video display 1014 10 and loudspeakers 1017, an I/O interface 1013 for the keyboard 1002 and mouse 1003 and optionally a joystick (not illustrated), and an interface 1008 for the modem 1016 and printer (not illustrated). In some implementations, the modem 1016 may be incorporated within the computer module 1001, for example within the interface 1008. A storage device 1009 is provided and typically includes a hard disk drive 1010 and a floppy disk drive 1011. A 15 magnetic tape drive (not illustrated) may also be used. A CD-ROM drive 1012 is typically provided as a non-volatile source of data. The components 1005 to 1013 of the computer module 1001, typically communicate via an interconnected bus 1004 and in a manner, which results in a conventional mode of operation of a computer system as known to those in the relevant art. Examples of computers on which the described arrangements can be practised 20 include IBM-PC's and compatibles, Sun Sparcstations or alike computer systems evolved there from. The video recording system 100 also comprises a storage server 1100 connected to the communications network 1020. The storage server 1100 is used for recording (i.e., requesting and storing) video data captured by the cameras 103-105 for later viewing via the client 1000. 25 The video data is typically stored on a hard disk drive 1110 of the storage server 1100 as will be described below. The storage server 1100 is also used for accessing video data, for event handling and for the control of the system 100. The storage server 1100 may be used to store data corresponding to events that are generated by the cameras 103, 104 and 105. The storage server 1100 may also be used for creating and storing data corresponding to events such as 30 motion detection events. The video data stored on the storage server 1100 may be displayed using the client 1000. The storage server 1100 is shown in detail in Fig. 11. - 5 - 835254_Final (1385998v1) The storage server 1100 is preferably formed by a computer module 1101, input devices such as a keyboard 1102 and mouse 1103, output devices including a printer (not illustrated), a display device 1114 and loudspeakers 1117. A Modulator-Demodulator (Modem) transceiver device 1116 is used by the computer module 1101 for communicating to and from 5 the communications network 1020, for example connectable via a telephone line 1121 or other functional medium. The modem 1116 can be used to obtain access to the Internet, and other network systems, such as a Local Area Network (LAN) or a Wide Area Network (WAN), and may be incorporated into the computer module 1101 in some implementations. Similar to the computer module 1001, the computer module 1101 typically includes at least 10 one processor unit 1105, and a memory unit 1106, for example formed from semiconductor random access memory (RAM) and read only memory (ROM). The module 1101 also includes an number of input/output (1/0) interfaces including an audio-video interface 1107 that couples to the video display 1114 and loudspeakers 1117, an I/O interface 1113 for the keyboard 1102 and mouse 1103 and optionally a joystick (not illustrated), and an 15 interface 1108 for the modem 1116 and printer (not illustrated). In some implementations, the modem 1116 may be incorporated within the computer module 1101, for example within the interface 1108. A storage device 1109 is provided and typically includes the hard disk drive 1110 and a floppy disk drive 1111. A magnetic tape drive (not illustrated) may also be used. A CD-ROM drive 1112 is typically provided as a non-volatile source of data. The 20 components 1105 to 1113 of the computer module 1101, typically communicate via an interconnected bus 1104 and in a manner, which results in a conventional mode of operation of such a computer system as known to those in the relevant art. The methods 400 and 500 are preferably implemented as software, such as an application program executing within the computer module 1001 of the client 1000. In particular, the 25 steps of methods 400 and 500 are effected by instructions in the software that are executed by the processor 1005. The instructions may be formed as one or more code modules, each for performing one or more particular tasks. The software may be stored in a computer readable medium, including the storage devices described below, for example. The software is loaded into the computer module 1001 from the computer readable medium, and is then executed by 30 the processor 1005. A computer readable medium having such software or computer program recorded on it is a computer program product. The use of the computer program product in - 6 - 835254_Final (1385998vl) the computer preferably effects an advantageous apparatus for implementing the methods described herein. The method 600 is preferably implemented as software, such as an application program executing within the computer module 1101 of the storage server 1100. In particular, the 5 steps of method 600 are effected by instructions in the software that are executed by the processor 1105. The instructions may be formed as one or more code modules, each for performing one or more particular tasks. The software may be stored in a computer readable medium, including the storage devices described below, for example. The software is loaded into the computer module 1101 from the computer readable medium, and then executed by the 10 processor 1105. A computer readable medium having such software or computer program recorded on it is a computer program product. The use of the computer program product in the computer preferably effects an advantageous apparatus for implementing the methods described herein. Alternatively, the methods 400, 500 and 600 may be implemented as one or more 15 application programs executing within the same computer module. Fig. 2 is a diagram showing a preferred software architecture 200 for the client 1000 and the storage server 1100. The client 1000 comprises three software modules in the form of a layout unit 202, a display unit 203 and a playback unit 204. The software modules 202, 203 and 204 may be resident on the hard disk drive 1010 of the computer module 1001 and be 20 controlled in their execution by the processor 1005. The storage server 1100 comprises two software modules in the form of a recording unit 208 and an access unit 209. The software modules 208 and 209 may be resident on the hard disk drive 1110 of the computer module 1101 and be controlled in their execution by the processor 1105. The layout unit 202, executed by the processor 1005, is responsible for loading a layout 25 specification 301 (see Fig. 3). The layout specification 301 may be loaded from the memory 1006 and/or the hard disk drive 1010. If the layout specification 301 does not contain temporal parameters, the layout specification 301 is defined as a "normal layout". A normal layout (e.g., layout 715 shown in Fig. 7) as described herein refers to an arrangement of video windows (e.g., video windows 706, 708 and 710 shown in Fig. 7) displaying video data on the 30 display 1014 of the client 1000. The displayed video data is sourced from one or more video sources in the form of the cameras 103, 104, 105. The layout unit 202 is also responsible for providing display parameters to the display unit. If the layout specification 301 contains - 7 - 835254_Final (1385998v1) temporal parameters (e.g. temporal parameters 302, 304, 305 and 306 shown in Fig. 3) it is defined as a "review layout". A review layout (e.g. layout 815 shown in Fig. 8) as described herein refers to an arrangement of video windows (e.g., video windows 706, 708 and 710 shown in Fig. 8) 5 displaying video data on the display 1014 of the client 1000. The displayed video data is sourced from one or more video sources in the form of the cameras 103, 104, 105 and storage servers 1100. The layout unit 202 is also responsible for providing display and temporal parameters to the display unit 203 and playback unit 204, respectively. As described below, the temporal parameters may include time parameters defining a date and/or time used by the 10 video windows for playing back recorded video data. The display unit 203, executed by the processor 1005, is configured for displaying one or more video windows on the display device 1014 based on the display parameters provided by the layout unit 202. The display parameters are used to position and size the video windows in a layout. 15 The playback unit 204, executed by the processor 1005, is configured for playing back recorded video data in the one or more video windows based on time references and the temporal parameters. The playback unit 204 uses the temporal parameters provided by the layout unit 202 to determine one or more time references. The determined time references are used to request recorded video data, as represented by arrow 205, from the access unit 209. 20 The recording unit 208, executed by the processor 1105, is configured for recording video data captured by one or more of the cameras 103-105 (video sources) connected to the video recording system 100. In addition to the video data, the recording unit 208 records time references. The video data may be recorded together with the time references. The video data and time references may be stored, for example, in the memory 1106 and/or on the hard disk 25 drive 1110 of the storage server 1100. The time references represent absolute times that have some relationship to the video data being recorded. For example, the recording unit 208 may record a time reference representing a date and time when a portion of video data was captured by the cameras 103-105. The recording unit 208 may also record a time reference representing a date and time when video data was recorded by the recording unit 208. 30 The access unit 209, executed by the processor 1105, accesses recorded video data stored in the memory 1106 and/or hard disk drive 1110 by the recording unit 208 and returns the - 8 - 835254_Final (1385998vl) recorded video data, as represented by arrow 206, to the playback unit 204 in response to the request 205 from the playback unit 204. Fig. 3 shows an example layout specification 301 defining a review layout. The layout specification 301 is configured for containing display parameters and temporal parameters 5 defining how video windows of the particular review layout are displayed and what video data is displayed within those video windows. The layout specification 301 may be stored on the hard disk drive 1010 and/or memory 1006 of the client 1000. The layout specification 301 may be used by the client 1000 for determining the display parameters and the temporal parameters. The review layout defined by the layout specification 301 is named "Layout 1" as 10 seen in Fig. 3. The layout specification 301 is used by the client 1000 to display the video windows to the user. At least one of the temporal parameters in the layout specification 301 may be a global time parameter 302. The global time parameter 302 may be used to determine a global date and time for playing back recorded video data in all video windows in the review layout, when the review layout is displayed on the display 1014. 15 In addition, the temporal parameters in the layout specification 301 can optionally include one or more time parameters 304, 305, 306 associated with individual ones of the video windows. The time parameters 304, 305 and 306 associated with a particular video window are used to calculate dates and times for playing back recorded video data for that video window only, when the review layout is displayed on the display 1014. In the layout 20 specification 301, the time parameter 304 is an offset time, where '3h' represents an offset of three (3) hours from the current time. In the layout specification 301, the time parameter 305 is a time range, where '1000-1100' represents a starting time of (1000) hours and an ending time of (1100) hours in 24 hour time. In the layout specification 301, the time parameter 306 is a date and time, where '23/08/2007, 1000' is the date 23 August 2007 and time (1000) 25 hours in 24 hour time. The method 400 of displaying video data will now be described, by way of example, with reference to Fig. 4. As described above, the method 400 is preferably implemented in the form of one or more software modules including the layout unit 202, the display unit 203 and the playback unit 204. These software modules are resident on the hard disk drive 1010 of the 30 client 1000 and are controlled in their execution by the processor 1005. The method 400 begins at step 401, where the processor 1005 detects selection of a layout. For example, the user may use the keyboard 100 and/or mouse 1003 of the client 1000 to - 9 - 835254_Final (1385998vl) select the layout to view (e.g., using a layout selection option 705 on a menu bar 702 as seen in Fig. 7). In the present example, the layout selected by the user corresponds to the layout specification 301. At the next step 402, the layout specification 301 for the selected layout is loaded by the 5 layout unit 202. The layout specification 301 may be loaded from the memory 1006 and/or the hard disk drive 1010 of the client 1000. The layout unit 202 also opens the loaded layout. Then at step 403, if the processor 1005 determines that the layout specification 301 contains temporal parameters, the layout is a review layout and the method 400 proceeds to step 404. Otherwise, the layout is a normal layout and the method 400 proceeds to step 409. 10 The method 400 continues at the next step 404, where the layout unit 202, executed by the processor 1005, passes the temporal parameters 302, 304, 305 and 306 to the playback unit 204 and passes display parameters to the display unit 203. The temporal parameters 302, 304, 305 and 306 and display parameters may be stored in the hard disk drive 1010 and/or the memory 1006 of the client 1000. Also at step 404, the playback unit 204 uses the temporal 15 parameters 302, 304, 305 and 306 to determine request times used to request recorded video data from the access unit 209. A method 500 of determining request times, as executed at step 404, will be described below with reference to Fig. 5. At the next step 405, the playback unit 204, executed by the processor 1005, requests recorded video data, as represented by the arrow 205, from the access unit 209. The video 20 data is requested according to the request times determined in step 404. The playback unit 204 also requests live video data from any one of the cameras 103-105 that has one or more corresponding video windows in the review layout that does not have a temporal parameter associated with it or a global temporal parameter. As described above, if the processor 1005 determines that the layout specification 301 does 25 not contain any temporal parameters, then the method 400 proceeds to step 409. At step 409, the playback unit 204 requests live video data from each camera 103-105 that has one or more corresponding video windows specified in the layout specification 301. In response to the request from the playback unit 204 at steps 405, the access unit 209 retrieves recorded video data using the request times. The recorded video data may be 30 retrieved from the cameras 103-105 and stored in the hard disk drive 1110 and/or the memory 1106 of the storage server 1100. The retrieved video data is then returned, as represented by -10- 835254_Final (1385998v) the arrow 206, to the playback unit 204 where the video data may be stored on the hard disk drive 1010 and/or the memory 1006 of the client 1000. Accordingly, at step 406, the playback unit 204, executed by the processor 1005, receives the requested video data from the access unit 209. Then at the next step 407, the playback 5 unit 204 passes the retrieved video data to the display unit 203. At the next step 408, the display unit 203, executed by the processor 1005, displays the review layout using the display parameters from the layout specification 301 provided from the layout unit 202. The layout specification 301 including the display parameters may be retrieved from the memory 1006 and/or the hard disk drive 1010. 10 The display parameters are used to position and size the video windows of the review layout. For example, as seen in Fig. 3, a number of display parameters are listed under the title "Camera 1" 303 which corresponds to a video window. In the example, the title Camera 1 refers to the camera 103 which corresponds to the video window 706 seen in Fig. 7. The display parameters include "Xpos" 307 representing an x-axis position for the video window 15 706 when displayed on the display 1014. In the present example, the Xpos display parameter 307 is "0". The display parameters also include "Ypos" 308 representing a y-axis position for the video window 706 when displayed on the display 1014. In the present example, the Ypos display parameter 308 is "0". The display parameters also include a "Width" 309 and a "Height" 310 parameter which are equal to "320" and "240", respectively. Accordingly, the 20 video window 706 corresponding to Camera 1 103 is three hundred and twenty pixels wide and two hundred and forty pixels high. Returning to the method 400, also at step 408, the video data passed to the display unit 203 by the playback unit 204 is displayed within the video window 706 corresponding to "Camera 1" 103. 25 The method 500 of determining request times, as executed at step 404, will now be described with reference to Fig. 5. The method 500 is preferably implemented in the form of one or more software modules including the layout unit 202 and the playback unit 204. As described above, these software modules are resident on the hard disk drive 1010 of the client 1000 and are controlled in their execution by the processor 1005. 30 The method 500 begins at step 504, where if the playback unit 204, executed by the processor 1005, determines that there is a global temporal parameter 302 specified in the layout specification 301, then the method 500 proceeds to step 505. Otherwise the method 500 - 11 - 835254_Final (1385998v1) proceeds to step 508. As described above, the layout specification 301 may be stored in the memory 1006 and/or the hard disk drive 1010. In step 505, the playback unit 204 determines the time for requesting recorded video data for all video windows in the review layout. The request times are determined by the playback 5 unit 204 at step 505 depending on type of time parameters contained in the layout specification 301. The determined request times may be stored in the memory 1006 and/or the hard disk drive 1010. If the time parameter in the layout specification 301 represents a time of day, such as time parameter 302 (i.e., 0800 hrs) seen in Fig. 3, then the playback unit 204 needs to determine the current time. The current time is then used to determine if video 10 data for the time specified by the time parameter on the current day needs to be requested. The playback unit 204 determines that video data for the specified time on the previous day needs to be requested, if the specified time has not occurred on the current day. If the time parameter is an offset time, such as time parameter 304 seen in Fig. 3, then the playback unit 204 determines the current time and subtracts an offset represented by the time 15 parameter 304 from the current time. In the example of Fig. 3, the time parameter 304 is equal to "3h" representing an offset of three hours. A value resulting from the subtraction of the offset time parameter 304 represents a date and time for which the playback unit 204 needs to request recorded video data from the access unit 209. The time parameter can also be a time range, such as time parameter 305 seen in Fig. 3, 20 which specifies a start time for video windows when the corresponding layout is opened, and an end time when the playback unit 204 should stop playing back recorded video data. In this case, a timeline (e.g., timeline 704 shown in Fig. 7) associated with a video window (e.g., video window 701 shown in Fig. 7) may display only the time range specified in the layout specification 301. Alternatively, the timeline may display a normal time range from live video 25 data into some past time with the specified time range selected. When the play head 713 reaches the end time, the play head 713 may also return back to the start time and continue playing in a loop. The time range may be a global time range used by all video windows in the corresponding layout. Alternatively, time ranges may be associated with individual video windows. If the time parameter represents a date and time, such as the time parameter 306 30 seen in Fig. 3, then the playback unit 204 may use the time parameter 306 to request recorded video data. In this instance, the playback unit 204 does not need to perform any calculations in order to determine the request time. - 12 - 835254_Final (1385998vl) The method 500 continues at the next step 506, where the request time determined at step 505 is applied by the processor 1005 to all video windows in the review layout. The request time may be accessed by the processor 1005 from the memory 1006 and/or the hard disk drive 1010. For example, if the request time determined at step 505 is a time on the current day 5 (i.e., 0800 hrs), then the video data for that date and time is requested for all of the video windows in the review layout. At the next step 507, if the playback unit 204, executed by the processor 1005, determines that there are temporal parameters (e.g., 304) specified for individual video windows of the review layout, then the method 500 proceeds to step 508. Otherwise the method 500 10 concludes. In step 508, the playback unit 204 determines request times for individual video windows in the review layout. Again, the request times determined by the playback unit 204 at step 508 depend on the type of time parameter contained in the review layout specification 301. As described above, the time parameter may represent a time of day, an offset time, a time range 15 or a date and time. In each case, the playback unit 204 determines the request times in the same manner as for step 505. The determined request times may be stored in the memory 1006 and/or the hard disk drive 1010 of the client 1000. The method 500 continues at the next step 509, where the request times determined at step 508 are applied by the processor 1005 to the corresponding individual video windows in the 20 review layout. The method 600 of providing video data will now be described with reference to Fig. 6. The method 600 is preferably implemented in the form of one or more software modules including the recording unit 208 and the access unit 209. The software modules 208 and 209 are resident on the hard disk drive 1110 of the storage server 1100 and are controlled in their 25 execution by the processor 1105. The method 600 begins at step 601, where the access unit 209, executed by the processor 1105, waits for a request from the playback unit 204 to retrieve recorded video data. Upon the access unit 209 receiving the request, the method 600 proceeds to step 602. At step 602, the access unit 209 retrieves recorded video data from the hard disk drive 1110 and/or the 30 memory 1106 according to the request times provided by the playback unit 204. Then at the next step 603, the access unit 209 sends the retrieved recorded video data back to the playback - 13- 835254_Final (1385998vl) unit 204 where the recorded video data may be stored on the hard disk drive 1010 and/or the memory 1006. Fig. 7 shows an example of a client graphical user interface 700. The client graphical user interface 700 comprises a main window 701 divided into three (3) main sections including a 5 menu bar 702, a layout area 703 and a timeline 704. The menu bar 702 contains typical menu options found in desktop applications including options for selecting a layout 705 to display in the layout area 703. The layout area 703 is used to display one or more video windows 706, 708, 710 to the user for viewing live video data from the cameras 103-105 or recorded video data from the storage servers 1100. The video windows 706, 708 and 710 are positioned in 10 the layout area 703 according to the selected layout 715. Accordingly, Fig. 7 shows an example of one layout 715. Each video window 706, 708 and 710 has an indicator 707, 709, 711 to indicate whether the video data being displayed is live or recorded. The timeline 704 is used to display the range of time that can be accessed for each video window. The play head 713 indicates the time of the video data being displayed in each video 15 window. The range of time displayed on the timeline 704 typically starts on the right edge with a current "live" time 714 and extends to the left going backwards in time. Time labels 712 are displayed at suitable intervals along the timeline 704. The layout 715 in Fig. 7 is an example of a standard layout where all of the video windows 706, 708 and 710 in the layout area 703 start playing live video data when the layout 715 is 20 opened. A layout specification (e.g., 301) for the layout 715 of Fig. 7 would specify no time parameters. Fig. 8 shows a review layout 815 of the video windows 706, 708 and 710 in the graphical user interface 700. The video windows 706, 708 and 710 in the review layout 815 start playing back video data according to a time parameter associated with each of the video 25 windows 706, 708 and 710. In the example of Fig. 8, the time parameter is a global time parameter equal to "0400". Accordingly, the video windows 706, 708 and 710 start playing back video data from 0400 hours when the review layout 815 is opened. The time parameter is represented by indicators 803, 805 and 807 in each video window and the position of the play head 713 in the timeline. A layout specification (e.g., 301) for the review layout 815 shown in 30 Fig. 8 may specify a global time parameter (e.g., 302) of either 0400 hours or an offset parameter of three (3) hours before the current time of 0700 hours (i.e., LIVE). Alternatively, -14- 835254_Final (1385998vl) each video window 706, 708 and 710 in the review layout 815 may have its own time parameter (e.g., 304) of 0400 hours or an offset parameter of three (3) hours. A layout having a global time parameter (e.g., 302) of 0400 hours where some or all video windows have their own time parameters (e.g., 304) of 0400 hours will have the same result 5 when the layout is opened. Accordingly, the video windows 706, 708 and 710 start playing back video data from 0400 hours when the review layout is opened. Fig. 9 shows another review layout 915 of the video windows 706, 708 and 710. The review layout 915 in Fig. 9 is an example of a review layout where each video window 706, 708 and 719 in the review layout 915 starts playing back video data starting from a different L0 time, upon the review layout 915 being opened. This is represented by different times in indicators 903, 905 and 907 displayed for each video window 706, 708 and 710, respectively, and different positions for each play head 908, 909, 910 in the timeline 704. In the example of Fig. 9, each video window 706, 708 and 710 has a different time parameter (e.g., 304) specified in the layout specification 915. A layout having a global time parameter (e.g., 302) 15 used by one of the video windows 706 (e.g. 0100 hours) and individual time parameters (e.g., 304) for the other two video windows 708 and 710 (e.g., 0200 hours and 0300 hours) would have the same result when the layout 915 is opened. When a review layout contains different time parameters for different video windows, as per the review layout 915, each video window 706, 708 and 710 will start playing back video 20 data at a different time. This means that the position of a play head on the timeline 704 for each video window will be different allowing recorded video data to be viewed asynchronously. This could either be represented by displaying multiple play heads 908, 909 and 910 on the timeline 704, as in the example of Fig. 9, or changing the position of a single play head depending on which video window is selected. 25 The methods described above provide a number of advantages over prior art methods. Firstly, recorded video data for more than one camera can be played back from a specific time simply by opening a review layout. Secondly, the methods improve workflow by reducing the number of manual steps required to review video data. To review video data on more than one video window, existing methods require at least four clicks compared with a single click 30 for the present invention. The described methods allow more accurate start times to be viewed compared with dragging a play head to a position on a timeline. Industrial Applicability - 15- 835254_Final (1385998v) It is apparent from the above that the arrangements described are applicable to the computer and data processing industries. The foregoing describes only some embodiments of the present invention, and modifications and/or changes can be made thereto without departing from the scope and spirit 5 of the invention, the embodiments being illustrative and not restrictive. For example, events may be used as triggers to generate review layouts. Further, review layouts may be associated with events so that clicking on an event displayed on the time line 704 results in an associated review layout being opened. In the context of this specification, the word "comprising" means "including principally but 10 not necessarily solely" or "having" or "including", and not "consisting only of'. Variations of the word "comprising", such as "comprise" and "comprises" have correspondingly varied meanings. - 16 - 835254_Final (1385998v1)

Claims (30)

1. A video system, comprising: a recording unit for recording video data, together with a time reference, captured by 5 one or more video sources connected to the system; a layout specification containing display parameters and temporal parameters; a display unit for displaying one or more video windows on a display device based on the display parameters; and a playback unit for playing back the recorded video data in the one or more video 10 windows based on the time reference, the temporal parameters and a current date and/or time when the recorded video data is played.
2. The video system according to claim 1, wherein the temporal parameters include a global time used by the video windows. 15
3. The video system according to claim 1, wherein the temporal parameters include one or more times associated with individual ones of the video windows.
4. The video system according to claim 3, wherein the temporal parameters include a 20 global time for use by the video windows.
5. The video system according to claim 1, wherein the temporal parameters include a global date and time used by the video windows. 25
6. The video system according to claim 1, wherein the temporal parameters include one or more dates and times associated with individual ones of the video windows.
7. The video system according to claim 6, wherein the temporal parameters include a global date and time for use by the video windows. 30
8. The video system according to claim 1, wherein the temporal parameter is a global time range used by all video windows. - 17 - 835254_Final (1385998vl)
9. The video system according to claim 1, wherein the temporal parameters include one or more time ranges associated with individual video windows. 5
10. The video system according to claim 9, wherein the temporal parameters include a global time range for use by the video windows.
11. The video system according to claim 1, wherein the temporal parameter is a global time offset used by the video windows. 10
12. The video system according to claim 1, wherein the temporal parameters include one or more time offsets associated with individual ones of the video windows.
13. The video system according to claim 12, wherein the temporal parameters include a 15 global time offset for use by all video windows.
14. A method of displaying video data, comprising: recording video data, together with a time reference, captured by one or more video sources; 20 determining display parameters and temporal parameters; displaying one or more video windows on a display device based on the display parameters; and displaying the recorded video data in the one or more video windows based on the time reference and the temporal parameters. 25
15. The method according to claim 14, wherein the temporal parameters include a global time used by the video windows.
16. The method according to claim 14, wherein the temporal parameters include one or 30 more times associated with individual ones of the video windows. -18- 835254_Final (1385998vl)
17. The method according to claim 16, wherein the temporal parameters include a global time for use by the video windows.
18. The method according to claim 14, wherein the temporal parameters include a global 5 date and time used by the video windows.
19. The method according to claim 14, wherein the temporal parameters include one or more dates and times associated with individual ones of the video windows. 10
20. The method according to claim 19, wherein the temporal parameters include a global date and time for use by the video windows.
21. The method according to claim 14, wherein the temporal parameter is a global time range used by all video windows. 15
22. The method according to claim 14, wherein the temporal parameters include one or more time ranges associated with individual video windows.
23. The method according to claim 22, wherein the temporal parameters include a global 20 time range for use by the video windows.
24. The method according to claim 14, wherein the temporal parameters include a global time offset used by the video windows.
25 25. The method according to claim 14, wherein the temporal parameters include one or more time offsets associated with individual ones of the video windows.
26. The method according to claim 25, wherein the temporal parameters include a global time offset for use by all video windows. 30 -19- 835254_Final (1385998vl)
27. A computer readable medium, having a program recorded thereon, where the program is configured to make a computer execute a procedure to display video data, said program comprising: code for recording video data, together with a time reference, captured by one or more 5 video sources; code for determining display parameters and temporal parameters; code for displaying one or more video windows on a display device based on the display parameters; and code for displaying the recorded video data in the one or more video windows based 10 on the time reference and the temporal parameters.
28. A system for displaying video data, the comprising: a memory for storing data and a computer program; and a processor coupled to said memory executing said computer program, said computer 15 program comprising instructions for: recording video data, together with a time reference, captured by one or more video sources; determining display parameters and temporal parameters; displaying one or more video windows on a display device based on the display 20 parameters; and displaying the recorded video data in the one or more video windows based on the time reference and the temporal parameters.
29. A method of displaying video data, said method being substantially as herein before 25 described with reference to any one of the embodiments as that embodiment is shown in the accompanying drawings. DATED this 1st Day of September 2008
30 CANON KABUSHIKI KAISHA Patent Attorneys for the Applicant SPRUSON&FERGUSON - 20 - 835254_Final (1385998vl)
AU2008207660A 2008-09-01 2008-09-01 Review layouts Abandoned AU2008207660A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2008207660A AU2008207660A1 (en) 2008-09-01 2008-09-01 Review layouts

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
AU2008207660A AU2008207660A1 (en) 2008-09-01 2008-09-01 Review layouts

Publications (1)

Publication Number Publication Date
AU2008207660A1 true AU2008207660A1 (en) 2010-03-18

Family

ID=42040707

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2008207660A Abandoned AU2008207660A1 (en) 2008-09-01 2008-09-01 Review layouts

Country Status (1)

Country Link
AU (1) AU2008207660A1 (en)

Similar Documents

Publication Publication Date Title
AU2007237206B2 (en) Method, apparatus and system for displaying video data
US6307550B1 (en) Extracting photographic images from video
AU2005200888B2 (en) Visualising camera position in recorded video
JP4757303B2 (en) Method, apparatus and computer-readable program for storing video data in a video file
US8819732B2 (en) System and method in a television system for providing information associated with a user-selected person in a television program
US9141190B2 (en) Information processing apparatus and information processing system
US20070260677A1 (en) Methods and systems for displaying videos with overlays and tags
US8031230B2 (en) Recorded content display program and recorded content display apparatus
US20070276910A1 (en) Conferencing system with desktop sharing
US8300098B1 (en) Techniques for providing access to video data using a network attached storage device
WO2007019514A3 (en) Network panoramic camera system
US20100235391A1 (en) Accessing item information for an item selected from a displayed image
WO2013052552A1 (en) System to merge multiple recorded video timelines
US11425342B2 (en) Systems and methods for media projection surface selection
US7451473B2 (en) Video distribution method and video distribution system
US8824872B2 (en) Display control apparatus, reproduction system, and recording medium in which display control is performed based on a detected event
AU2008207660A1 (en) Review layouts
US20210092489A1 (en) Method and apparatus for playing a 360-degree video
US20120243848A1 (en) Augmented Reality System for Re-Casting A Seminar with Private Calculations
CN113784169B (en) Video recording method and device with barrage
AU2006252090A1 (en) Dynamic Layouts
CN101426136A (en) High resolution stream media information processing system and method thereof
AU2006252142B2 (en) Video rate determination
US20140037263A1 (en) Video and data collection and display system

Legal Events

Date Code Title Description
MK4 Application lapsed section 142(2)(d) - no continuation fee paid for the application