JP2013243531A - Imaging device, imaging processing method and program, and imaging processing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To distribute an image rich in variety by simply utilizing an existing imaging function in performing real-time streaming distribution of a moving image being captured.SOLUTION: When an imaging device 1 performs real-time streaming distribution of a moving image being captured by an imaging unit thereof to a management server 6 via a portable terminal device 2 and a communication network (wireless communication network 3 and the Internet 5), if a predetermined operation is performed during the streaming distribution, the imaging device 1 replaces the moving image being distributed with an image corresponding to the predetermined operation, and distributes the image for a predetermined period of time.

Description

  The present invention relates to an imaging apparatus provided with moving image photographing means, an imaging processing method, a program, and an imaging processing system.

  In general, as a video distribution system using an imaging device such as a digital compact camera or a video camera having a moving image shooting function, for example, as disclosed in Patent Document 1, a moving image shot by an imaging device is communicated. A technique is disclosed in which, when transmitted to a management server via a network, the management server transmits a received moving image to a reproduction terminal, thereby enabling the terminal to perform streaming reproduction of the moving image in real time.

JP 2004-32228 A

  However, the technique disclosed in Patent Document 1 described above is a technique that enables real-time streaming distribution of moving images. For example, it is expensive and heavy equipment to be able to view a variety of moving images. Because the equipment is required, the playback video in the streaming distribution by the individual is a reproduction of the captured image as it is, and only the playback video with little change can be seen, which is insufficient as a communication means It was.

  An object of the present invention is to make it possible to distribute a variety of images simply by utilizing an existing shooting function when streaming a moving image being shot in real time.

In order to solve the above-described problems, an imaging apparatus of the present invention
An imaging apparatus provided with a moving image shooting means,
A delivery means for streaming the moving image taken by the moving picture photographing means in real time via a communication network;
A discriminating unit for discriminating whether or not a predetermined operation has been performed during streaming delivery of a moving image by the distributing unit;
Distribution control means for performing distribution control for causing the distribution means to distribute an image corresponding to the predetermined operation for a predetermined time via the communication network when it is determined that the predetermined operation has been performed by the determination means;
It is an imaging device characterized by comprising.

In order to solve the above-described problem, the imaging processing method of the present invention provides:
Streaming the moving image captured by the moving image capturing means in real time via a communication network;
Determining whether a predetermined operation is performed during streaming distribution of the moving image;
Performing distribution control for distributing an image corresponding to the predetermined operation for a predetermined time via the communication network when it is determined that the predetermined operation has been performed;
It is the imaging processing method characterized by including this.

In order to solve the above-described problems, the program of the present invention
Against the computer,
A function for streaming a moving image captured by a moving image capturing means in real time via a communication network;
A function of determining whether a predetermined operation is performed during streaming distribution of the moving image;
A function of performing distribution control for distributing an image corresponding to the predetermined operation for a predetermined time via the communication network when it is determined that the predetermined operation has been performed;
It is a program for realizing.

In order to solve the above-described problem, the imaging processing system of the present invention
An imaging device that captures a moving image, a management device that receives a moving image captured by the imaging device via a communication network, and a receiving-side terminal device that receives the moving image from the management device via a communication network An imaging processing system comprising:
The imaging apparatus includes a distribution unit that performs real-time streaming distribution of a moving image captured by a moving image capturing unit via a communication network, and whether a predetermined operation has been performed during streaming distribution of the moving image by the distribution unit. A distribution unit that distributes an image corresponding to the predetermined operation to the distribution unit for a predetermined time via the communication network when the determination unit determines that a predetermined operation has been performed. Distribution control means for performing control,
The management device receives a moving image that is streamed in real time from the imaging device and an image corresponding to the predetermined operation, and streams the image to the terminal device in real time.
An imaging processing system characterized by the above.

  According to the present invention, when streaming a moving image that has been shot in real time, it is possible to distribute a variety of images simply by utilizing existing functions, and also to popularize streaming distribution by individuals. Can contribute.

1 is a block diagram showing a communication network system (imaging processing system) that can be used by an imaging apparatus 1; FIG. 3 is a block diagram illustrating basic components of the imaging apparatus 1. The figure for demonstrating the various flags temporarily memorize | stored in the work memory 13b. The figure which showed the example of a display in the receiving side terminal, when a moving image and a still image are synthesize | combined and delivered. The flowchart which showed the streaming delivery process of a moving image. 6 is a flowchart following the operation of FIG. 6 is a flowchart following the operation of FIG. The figure for demonstrating the still image delivery in the streaming delivery of a moving image. The figure for demonstrating the moving image and still image alternate delivery in the streaming delivery of a moving image. The figure for demonstrating the moving image and still image synthetic | combination delivery in the streaming delivery of a moving image. The figure for demonstrating the still image delivery and chasing delivery in the streaming delivery of a moving image. The figure for demonstrating the still image delivery in the thinning-out streaming delivery of a high speed photography moving image. The figure for demonstrating slow motion delivery in the thinning-out streaming delivery of a high speed imaging | photography moving image. The figure for demonstrating slow motion delivery and chasing delivery in the thinning-out streaming delivery of a high speed imaging | photography moving image.

Embodiments of the present invention will be described below with reference to FIGS.
FIG. 1 is a block diagram illustrating a communication network system (imaging processing system) that can be used by an imaging apparatus.
The imaging processing system is a communication network system that distributes a moving image captured by the imaging apparatus 1 in real time via a wide-area communication network (public communication network). This imaging device 1 is a digital compact camera capable of shooting moving images in addition to still images. In addition to basic functions such as imaging functions, timing functions, and sound collection functions, still images are shot even during movie shooting. It has a still-in movie function that enables it and a high-speed movie shooting function that enables high-speed movie shooting, and also transmits and receives data (moving images, still images, audio, etc.) to and from the mobile terminal device 2. It has a short distance communication function, a streaming distribution function for streaming a captured moving image, still image, and collected sound via short distance communication.

  A mobile terminal device 2 that can transmit and receive data to and from the imaging device 1 via short-range communication is, for example, a multi-function mobile phone called a smartphone, whose basic functions are a call function, an e-mail function, When it is connected to a wireless communication network (mobile communication network) 3 via a nearby base station (not shown), it has an Internet connection function (Web access function), a short-range communication function, etc. Thus, it becomes possible to make a call with another mobile terminal device 4. In addition, when the mobile terminal device 2 is connected to the Internet 5 via the wireless communication network 3, the mobile terminal device 2 can be accessed and browsed.

  In addition, the mobile terminal device 2 can be connected to a management device (management server) 6 that provides a video sharing service via the wireless communication network 3 and the Internet 5, and the moving image captured by the imaging device 1 can be captured. When receiving and acquiring via short-range communication, streaming distribution is performed in real time to the management server 6 via a communication network (wireless communication network 3 and Internet 5). The management server 6 is a server device on the supplier side that provides a video sharing service, has a chat function and a video posting function between member users (viewers and viewers), and receives a moving image received from the mobile terminal device 2. Is streamed in real time to a receiving terminal (a terminal device on the viewer or viewer side) such as a PC (personal computer) 7 on the viewer or viewer side, a television receiver 8, or another portable terminal device 4. I am doing so. Thus, the imaging processing system includes an imaging device 1 that captures a moving image, a management server 6 that receives the moving image captured by the imaging device 1 via a communication network, and a moving image that is transmitted from the management server 6 to the communication network. It is the structure provided with the terminal device 4, 7, 8 of the receiving side which receives via.

FIG. 2 is a block diagram illustrating basic components of the imaging apparatus 1.
The control unit 11 operates by supplying power from the power source unit (secondary battery) 12 and controls the overall operation of the imaging apparatus 1 according to various programs in the storage unit 13. Are provided with a CPU (Central Processing Unit) and a memory (not shown). The storage unit 13 includes, for example, a ROM, a flash memory, and the like, and stores programs, various applications, and the like for realizing the present embodiment in accordance with operation procedures illustrated in FIGS. Program memory 13a and work memory 13b that temporarily stores various information necessary for the operation of the imaging apparatus (for example, flags, soft timer measurement values, etc.), as will be described later, chasing distribution Buffer 13c and slow motion distribution buffer 13d. The storage unit 13 may include a removable portable memory (recording medium) such as an SD card or an IC card, and is connected to a network via a communication function (not shown). The state may include a storage area on a predetermined server device side.

  Although not shown in the figure, the operation unit 14 includes a mode change key for switching a shooting mode for enabling shooting, a playback mode for playing back a shot image, and the like to instruct to start shooting as a push button type key. The control unit 11 includes an input that is output from the operation unit 14 corresponding to the operation key. In accordance with the operation signal, for example, mode change processing, shooting processing, shooting condition setting processing, and the like are performed.

  Although not shown, the imaging unit 15 constitutes a camera unit capable of photographing a subject with high definition by forming a subject image from an optical lens on an imaging element (CCD, CMOS, etc.). (Zoom lens), image sensor, strobe, various sensors, analog processing unit, and digital processing unit. The imaging unit 15 converts the photoelectrically converted image signal (analog value signal) into digital value data after color separation and gain adjustment for each of the RGB color components. The digitally converted image data is subjected to color interpolation processing (demosaic processing) and displayed in full color on the display unit 16. In the present embodiment, autofocus processing (AF processing), exposure adjustment processing (AE processing), auto white balance adjustment processing (AWB), image compression processing, image restoration processing, and the like can also be executed. The imaging unit 15 normally performs moving image shooting at 30 frames per second (30 fps), but when high-speed shooting is instructed, for example, the frame rate is 240 frames per second (240 fps), seconds High-speed shooting such as 120 frames (120 fps) is possible.

  The display unit 16 is, for example, a monitor screen that displays a captured image (live view image) with a high-definition liquid crystal display or an organic EL (Electro Luminescence) display having screens with different aspect ratios (width 4: height 3). (Live View screen) or a playback screen for playing back captured images. The sound collecting unit 17 records ambient sounds when the image capturing unit 15 captures a moving image. The control unit 11 associates the captured moving image with the collected sound, and is a portable memory in the storage unit 13. (For example, an SD card). Hereinafter, only image distribution will be described, and description of audio distribution will be omitted. The short-range wireless communication unit 18 is capable of high-speed and large-capacity communication. For example, a non-contact type IC card or a wireless LAN (Local Area Network) module is used. Are distributed to the mobile terminal device 2.

FIG. 3 is a diagram for explaining various flags temporarily stored in the work memory 13b.
The work memory 13b stores a still image distribution flag F1 and a chasing playback flag F2 for streaming distribution processing of moving images. The still image distribution flag F1 is a distribution method of how to distribute a still image instead of the moving image being distributed when the moving image captured by the imaging unit 15 is distributed in real time. Flag to specify. In the present embodiment, when any one of three types of distribution methods prepared in advance as still image distribution methods is arbitrarily selected and designated by a user operation, the still image distribution flag F1 is set to the specified distribution. The value indicates the method.

  The control unit 11 generates a normal moving image for distribution from the captured moving image in real time, and distributes the normal moving image for distribution generated in real time by streaming through the communication network in real time. When a predetermined operation is performed during distribution, an image corresponding to the predetermined operation is streamed via a communication network instead of a normal moving image generated in real time. Yes. That is, the control unit 11 determines whether or not a predetermined operation has been performed during streaming distribution of the moving image, and when the predetermined operation is performed, distributes an image corresponding to the predetermined operation. The video is distributed for a predetermined time (for example, for 2 to 3 seconds) instead of the moving image in the middle, and thereafter, the streaming distribution of the moving image is resumed to return to the normal state. If the predetermined operation described above is an operation for instructing still image shooting, the distribution method is determined by referring to the still image distribution flag F1 when the still image shooting operation is performed. To deliver still images for a predetermined time.

  As described above, in this embodiment, when a still image shooting operation is performed during streaming distribution of a moving image, an operation for distributing a still image for a predetermined time instead of the moving image being distributed (real-time stop motion) Like to do. Here, the predetermined time for distributing the still image is an elapsed time (set time) after starting the distribution of the still image, and is not limited to 2 to 3 seconds, for example, 3 seconds, 4 seconds, 5 seconds, etc. It may be. In the present embodiment, an arbitrary time can be set as the above-mentioned predetermined time by the key operation of the operation unit 14, and the time from the release button pressing operation (shooting start operation) until the pressing is released is also predetermined. Although the time is set, either one of the pressing time and the set time (the shorter one) is set as the predetermined time.

  In the illustrated example, “0” of the still image distribution flag F1 designates a distribution method for continuously distributing only the same still image, and “1” indicates a distribution method for alternately distributing still images and moving images. Designated, and “2” is a flag that designates a delivery method for synthesizing and delivering a moving image and a still image. FIG. 4 shows a display example at the receiving terminal that has received the composite image when the value of the still image distribution flag F1 is “2”, that is, when the moving image and the still image are combined and distributed. In the figure, the composite image is displayed in a state where the still image display area is superimposed on a part of the moving image display area.

  The chasing playback flag F2 indicates that an undelivered moving image that has not been distributed by distributing an image corresponding to a predetermined operation for a predetermined time instead of a moving image that is being distributed for streaming before resuming normal streaming distribution, This is a flag indicating whether or not to perform chasing distribution (follow-up distribution: high-speed thinning distribution) after the predetermined time has elapsed. Here, “0” of the chasing playback flag F2 designates that the chasing delivery is not executed, and “1” is a flag that designates that the chasing delivery is executed. In order to make it possible to realize such chasing distribution, in the present embodiment, undistributed moving images are temporarily stored in the chasing distribution buffer 13c.

  On the other hand, in the present embodiment, frames (images) are thinned out because the frame rate greatly exceeds the throughput of the communication network at high-speed shooting such as 240 frames (240 fps) and 120 frames (120 fps) per second. Streaming distribution (thinning distribution) is performed. For example, in the case of high-speed shooting at a frame rate of 120 frames per second (120 fps), an image is generated every 8.33 ms, but because the image is generated four times faster than streaming delivery, it is 1/4. Thus, streaming distribution is performed at 33.33 ms by setting the frame rate to 30 fps by performing image thinning (distribution once per four frames). When a predetermined operation is performed during thinned streaming distribution of such a high-speed captured moving image, if the predetermined operation is an operation instructing slow motion playback distribution, the high-speed captured by the imaging unit 15 The captured moving image is distributed as a slow motion image for a predetermined time instead of the moving image being distributed.

  That is, for example, a moving image captured at a high speed of 120 frames per second (120 fps) is thinned out to a frame rate (for example, 30 fps) that can be distributed at the communication speed of the communication network, and streaming distribution (decimation of high-speed captured moving images is performed). When a slow motion playback operation is performed as a predetermined operation when streaming delivery is being performed, high-speed captured moving images are sequentially stored in the slow motion delivery buffer 13d, and the slow motion delivery buffer 13d The high-speed captured moving image is distributed for a predetermined time instead of the moving image being thinned streaming-distributed.

  As described above, in the present embodiment, when a slow motion playback operation is performed during high-speed shooting streaming distribution, high-speed shooting is performed as streaming distribution without thinning for a predetermined time instead of streaming distribution (thinning distribution). An operation for distributing moving images (real-time slow motion) is performed. Here, the predetermined time during which the slow motion distribution is performed is a time determined according to the number of frames in which the high-speed captured moving image can be stored in the slow motion distribution buffer 13d or an operation for instructing to stop the slow motion distribution. It is time until. After such slow motion playback distribution, the thinned streaming distribution of the high-speed captured moving image is resumed to return to the normal state. Further, in order to enable the above-mentioned chasing distribution even during slow motion distribution, undistributed moving images that have not been distributed in slow motion are temporarily stored in the chasing distribution buffer 13c.

  Next, the operation concept of the imaging apparatus according to the present embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. Further, it is possible to sequentially execute the operation according to the above-described program code transmitted via a transmission medium such as a network. In other words, in addition to the recording medium, an operation unique to the present embodiment can be executed using a program / data supplied externally via a transmission medium. 5 to 7 are flowcharts showing an outline of the operation of the characteristic part of the present embodiment in the entire operation of the imaging apparatus. When the flow of FIGS. Return to the main flow (not shown).

  FIG. 5 to FIG. 7 are flowcharts showing a streaming distribution process that is started when moving image streaming distribution is designated by a user operation. Hereinafter, the streaming distribution process will be specifically described with reference to FIGS. 8 to 12 are diagrams for explaining real-time stop motion as an operation of streaming distribution of moving images, and FIGS. 13 and 14 are real-time slow motions as an operation of streaming distribution of moving images. It is a figure for demonstrating a motion.

  First, the control unit 11 of the imaging device 1 stores in the storage unit 13 an image that is streamed in real time to the management server 6 via the mobile terminal device 2 and the communication network (wireless communication network 3 of the public communication network, the Internet 5). An operation of sequentially recording and saving data in a portable memory (for example, an SD card) is started (step S1 in FIG. 5). Next, for streaming distribution of moving images, it is checked whether or not high-speed shooting is designated in advance by a user operation (step S2). If high-speed shooting is not instructed (NO in step S2), the flow of FIG. Move on. In this case, since the imaging unit 15 normally performs moving image shooting at 30 fps, processing for streaming distribution (normal distribution) of moving images captured at intervals of 33.33 ms is started (step S14).

  In this way, during streaming distribution of moving images, it is checked whether a predetermined operation (still image shooting operation) has been performed (step S15), or whether other operations have been performed (step S16). ). If another operation is performed (YES in step S16), a process corresponding to the operation is performed (step S17). For example, when an operation for instructing suspension of streaming distribution is performed, the streaming distribution suspension process is performed, and then the process proceeds to step S15 described above. However, when an operation for instructing termination of streaming distribution is performed, streaming operation is performed. In order to end the distribution, the flow of FIGS. 5 to 7 is exited (not shown).

  Also, when a predetermined operation (still image shooting operation) is performed during streaming delivery (YES in step S15), still image acquisition that acquires a frame image captured by the imaging unit 15 during the still image shooting operation as a still image Processing is performed (step S18). Then, referring to the still image distribution flag F1, after determining the distribution method of this still image (step S19), as an image corresponding to a predetermined operation (still image shooting operation) instead of the moving image being distributed, A timer that starts a still image distribution process for distributing a still image acquired at the time of still image shooting operation according to a distribution method indicated by the value of the still image distribution flag F1 and measures an elapsed time after starting the distribution of the still image The operation (not shown) is started (step S20).

  Then, it is checked whether the value of the chasing playback flag F2 is “1” (step S21). If the value of the chasing playback flag F2 is “0” (NO in step S21), the above-mentioned timer times out. That is, that is, whether or not a predetermined time has elapsed since the start of still image distribution (step S23), or an operation to stop still image distribution (for example, release button release operation) is performed. Or the like is checked (step S24). Thereafter, until time-out (YES in step S23) or until a still image distribution stop operation is performed (YES in step S24), the process returns to step S23 and the still image distribution process is continued.

  Here, when a predetermined time has elapsed since the timeout occurred (YES in step S23) or when a still image distribution stop operation is performed (YES in step S24), whether the value of the chasing playback flag F2 is “0”? However, since the value is “0” (NO in step S25), the still image distribution is stopped and the moving image streaming distribution is resumed to return to the normal state (step S27). ). Thereafter, the process proceeds to step S2 in FIG.

  8 to 10 are diagrams for explaining a still image distribution method in the streaming distribution operation (real-time stop motion). FIG. 11 is a diagram for explaining chasing playback in the streaming delivery operation (real-time stop motion). In the figure, the upper-side captured moving image indicates a moving image captured at an interval of 33.33 ms by the imaging unit 15, and the lower-stage streaming image is streamed at an interval of 33.33 ms. An image to be displayed is shown. In the figure, the numerical values in the rectangles are frame numbers assigned to identify a series of moving images. In the illustrated example, frame numbers “10” to “35” are illustrated.

  Further, FIG. 8 is a diagram for explaining a distribution method when the value of the still image distribution flag F1 is “0”. When the value of the still image distribution flag F1 is “0”, streaming distribution of moving images is performed. When a predetermined operation (still image shooting operation) is performed during this time, the frame image (still image) shot during the still image shooting operation is distributed for a predetermined time instead of the moving image being distributed. In the illustrated example, a still image shooting operation is performed at the timing when the frame number of the captured moving image is “12”. In the figure, “a” indicates an image (frame number “12”) that was captured during the still image shooting operation. (Hereinafter the same). In the example shown in the figure, this image (still image) is distributed between frame numbers “12” to “19” at intervals of 33.33 ms instead of the moving image. The case where it returns to streaming delivery of is illustrated.

  FIG. 9 is a diagram for explaining a distribution method when the value of the still image distribution flag F1 is “1”. When the value of the still image distribution flag F1 is “1”, the moving image is being streamed. When a predetermined operation (still image shooting operation) is performed, a frame image (still image) and a moving image captured during the still image shooting operation are alternately distributed for a predetermined time instead of the moving image being distributed. In the case shown in the figure, when a still image shooting operation is performed at the timing when the frame number of the captured moving image is “12”, an image (still image) and a moving image captured at the time of the still image shooting operation are 33.33 ms. Between frame numbers “12” to “19” at intervals of “a”, “13”, “a”, “15”, “a”, “17”, “a”, “19” In this example, the distribution is then returned to the streaming distribution of moving images from the moving image / still image alternate distribution.

  FIG. 10 is a diagram for explaining a distribution method when the value of the still image distribution flag F1 is “2”. When the value of the still image distribution flag F1 is “2”, the moving image is being streamed. When a predetermined operation (still image shooting operation) is performed, an image is generated by combining the frame image (still image) shot during the still image shooting operation with the moving image instead of the moving image being distributed. Deliver the composite image for a predetermined time. In the case shown in the figure, a still image shooting operation is performed at the timing when the frame number of the captured moving image is “12”, and the image (still image) captured during the still image shooting operation is combined with the moving image. Images are generated sequentially at intervals of 33.33 ms, and each composite image “12 + a”, “13 + a”,..., “18 + a”, “19 + a” is distributed between frame numbers “12” to “19”. In this example, the moving image / still image synthesis distribution is returned to the moving image streaming distribution.

  On the other hand, when the still image distribution process (step S20 in FIG. 6) is started as described above, if the value of the chasing playback flag F2 is “1” (YES in step S21), the captured moving image is thinned out. The write operation for sequentially storing in the chasing distribution buffer 13c is started (step S22). If the value is “0” (NO in step S21), the writing to the chasing distribution buffer 13c is skipped. FIG. 11 shows a case where the value of the still image distribution flag F1 is “0”, as in FIG. 8, and when a still image shooting operation is performed at the timing when the frame number of the shooting moving image is “12” as shown in FIG. The control unit 11 starts an operation of distributing an image (still image) captured at the time of still image capturing operation at intervals of 33.33 ms instead of the captured moving image being distributed. In this case, since the value of the chasing playback flag F2 is “1”, the shooting operation is thinned out (thinned in the example in the figure) and the writing operation of sequentially storing the chasing delivery buffer 13c is started. In the case shown in the figure, the chasing distribution buffer 13c sequentially contains images of frame numbers “12”, “14”, “16”, “18”,. The case where it memorize | stores is illustrated.

  If the value of the chasing playback flag F2 is “1” (YES in step S25), the chasing playback distribution (high-speed thinning distribution) is performed while sequentially reading the moving images in the chasing distribution buffer 13c instead of the still image distribution. The process proceeds to step S26. In the case of FIG. 11, the still image distribution ends at the timing of the frame number “19” and the chasing playback distribution starts at the timing of “20”, and each image in the chasing distribution buffer 13c is 33. .Sequentially read out at 33 ms intervals for chasing playback distribution.

  As a result, the first image (image with the frame number “12”) in the chasing distribution buffer 13c is read and distributed at the timing of the frame number “20” of the captured moving image, and the second image (frame) The image with the number “14”) is read and distributed at the timing “21”, and the third image (the image with the frame number “16”) is read and distributed at the timing “22”. The fourth image (image with frame number “18”) is read and distributed at the timing “23”, and so on. Note that the chasing distribution buffer 13c sequentially stores the captured moving images, so that high-speed chasing can be performed according to the thinning amount.

  The writing operation to the chasing distribution buffer 13c and chasing reproduction distribution are continued until the captured moving image is caught up. That is, in the example of FIG. 11, it is the case of frame number “28” that catches up with the captured moving image, so that each of the frame numbers “12”, “14”,. The images are sequentially stored, and the above-described writing operation and chasing playback distribution are continued until the “26” image is distributed. Thus, when the captured moving image catches up, the chasing playback distribution process ends at that point. Then, the process proceeds to step S27 to resume the normal state by restarting the streaming distribution of the moving image. Thereafter, the process proceeds to step S2 in FIG.

  On the other hand, when high-speed shooting of a moving image is instructed (YES in step S2 in FIG. 5), since high-speed shooting is performed at the frame rate (120 fps) in the imaging unit 15, every 8.33 ms. However, since the interval at which images are generated is four times faster than streaming delivery, streaming delivery (decimation delivery) is performed with 1/4 image skipping (step S3). In this way, during streaming delivery (thinning delivery) of high-speed shooting, it is checked whether or not a still image shooting operation has been performed as a predetermined operation (step S4), and slow motion playback is instructed as another predetermined operation. It is checked whether or not an operation has been performed (step S28 in FIG. 7), or whether or not another operation has been performed (step S29). Now, when another operation is performed (step S29). And YES), processing corresponding to the operation is performed (step S30). For example, when an operation for instructing to pause streaming distribution is performed, after performing streaming distribution suspension processing, the process proceeds to step S4 in FIG. 5 described above, but an operation for instructing termination of streaming distribution has been performed. Sometimes, the flow of FIGS. 5 to 7 is exited (not shown) in order to end the streaming distribution.

  Further, when a predetermined operation (still image shooting operation) is performed during streaming distribution of high-speed shooting (YES in step S4 in FIG. 5), an image shot by the imaging unit 15 during the still image shooting operation is a still image. (Step S5). Then, with reference to the still image distribution flag F1, after determining the distribution method of this still image (step S6), the still image is still captured as an image corresponding to a predetermined operation (still image shooting operation) instead of the moving image being distributed. The still image distribution processing for distributing the image (still image) acquired at the time of image shooting operation according to the distribution method indicated by the value of the still image distribution flag F1 is started, and the elapsed time from the start of the distribution of the still image is set. The timer operation to be measured is started (step S7).

  12 to 14 are diagrams showing operations when high-speed shooting is instructed. In the figure, the high-speed captured moving image on the upper side indicates a moving image captured at an interval of 8.33 ms by the imaging unit 15, and the thinned streaming image (1) on the middle side indicates the high-speed An image obtained by thinning a photographic moving image to ¼ is shown, and by this ¼ thinning, each image has an interval of 33.33 ms. The thinned streaming image (2) on the lower side indicates an image that is actually distributed, and each image is distributed at an interval of 33.33 ms. In the figure, the numerical values in the rectangles are frame numbers assigned to specify a series of moving images, and in the example shown, frame numbers “10” to “59” are shown.

  Further, FIG. 12 shows a case where the value of the still image distribution flag F1 is “0” when the still image shooting operation is performed in the streaming distribution operation (real-time stop motion) as in FIG. When a still image shooting operation is performed during thin-out streaming distribution of speed shooting, an image (still image) shot during the still image shooting operation is distributed for a predetermined time instead of the moving image being distributed. In the example shown in the figure, when a still image shooting operation is performed at the timing of the frame number “18”, this still image is distributed at intervals of 33.33 ms between the frame numbers “18” to “50”. Then, the case where it returns to the thinning-out streaming delivery from this still image delivery to high-speed imaging is illustrated.

  Next, it is checked whether or not the value of the chasing playback flag F2 is “1” (step S8). If the value is 1 (YES in step S8), the thinned-out streaming image (1) is thinned by half. Then, the write operation for sequentially storing in the chasing distribution buffer 13c is started (step S9), but if it is “0” (NO in step S8), the writing to the chasing distribution buffer 13c is skipped. It is checked whether the timer has timed out, that is, whether a predetermined time has elapsed since the start of still image delivery (step S10), or whether an operation to stop still image delivery has been performed (step S10). Step S11).

  Thereafter, the still image distribution process is continued until a time-out occurs (YES in step S10) or until a still image distribution stop operation is performed (YES in step S11). However, when a time-out occurs (YES in step S10) or When the still image distribution stop operation is performed (YES in step S11), it is checked whether the value of the chasing playback flag F2 is “0” (step S12). If the value is “0” (in step S12). NO), the process proceeds to step S39 in FIG. 7 to return to the normal state by stopping still image distribution and restarting streaming distribution (thinning distribution). Thereafter, the process proceeds to step S2 in FIG.

  If the value of the chasing playback flag F2 is “1” (YES in step S12), instead of still image distribution, streaming distribution is performed at intervals of 33.33 ms while sequentially reading the moving images in the chasing distribution buffer 13c. The process proceeds to the chasing playback distribution process (step S13). In this case, the writing operation to the chasing distribution buffer 13c and the chasing reproduction distribution are continued until the high-speed shooting moving image is caught up. Then, when the chasing playback is over by the chasing playback catching up with the high-speed shooting moving image, the high-speed shooting streaming delivery (thinning delivery) is resumed to return to the normal state (step S39 in FIG. 7).

  Further, when a slow motion playback operation is performed as a predetermined operation during thin streaming distribution of high-speed shooting (YES in step S28 in FIG. 7), the high-speed shooting moving image is sequentially stored in the slow motion distribution buffer 13d. In addition to starting the writing operation (step S31), in place of the thinned-out distribution, the moving image is sequentially read out from the slow motion distribution buffer 13d, and the operation of performing the slow motion distribution (streaming distribution) at an interval of 33.33 ms is started (step S31). S32).

  FIG. 13 shows a case where the slow motion playback operation is performed at the timing of the frame number “18” in the streaming delivery operation (real-time / slow motion) of high-speed shooting. In the case shown in the figure, the slow motion distribution buffer 13d has images with frame numbers “19”, “20”, “21”, and “22” as high-speed captured moving images captured at intervals of 8.33 ms. The images “19”, “20”, “21”, and “22” that are sequentially stored and sequentially read from the slow motion delivery buffer 13d are delivered in slow motion at intervals of 33.33 ms. Is illustrated.

  As a result, the first image (image with the frame number “19”) in the slow motion distribution buffer 13d is read and distributed at the timing of the frame number “22” of the high-speed moving image, and the second image is distributed. The image (image with frame number “20”) is read and distributed at timing “26”, and the third image (image with frame number “21”) is read at timing “30”. The fourth image (the image with the frame number “22”) is read and distributed at the timing “34”.

  Then, it is checked whether or not the value of the chasing playback flag F2 is “1” (step S33). FIG. 13 shows the case where chasing playback is not designated, and the value is “0” (step S33). In step S36, it is checked whether there is a remaining capacity (free capacity) in the slow motion distribution buffer 13d (step S35), or whether an operation to stop the slow motion playback has been performed (step S36). ) Slow motion playback is continued until there is no remaining capacity in the slow motion distribution buffer 13d (NO in step S35) or until a slow motion playback stop operation is performed (YES in step S36).

  Now, when there is no remaining capacity in the slow motion delivery buffer 13d (NO in step S35) or when a slow motion playback stop operation is performed (YES in step S36), the value of the chasing playback flag F2 is “0”. If the value is “0” (NO in step S37), the slow motion playback distribution is stopped and the high-speed shooting streaming distribution (thinning distribution) is resumed. (Step S39). Thereafter, the process proceeds to step S4 in FIG. In the case of FIG. 13, the case where the slow motion distribution is performed when the frame number of the high-speed shooting moving image is “19” to “34” and then returns to the high-speed shooting streaming distribution (thinning distribution). doing.

On the other hand, if the value of the chasing playback flag F2 is “1” (YES in step S33), the thinned-out streaming image (1) is thinned out (for example, thinned down to 1/2) and sequentially stored in the chasing distribution buffer 13c. The write operation to be started is started (step S34). after that,
In step S37, it is detected that the value of the chasing playback flag F2 is “1”, the process proceeds to step S38, and instead of slow motion playback distribution, the moving image in the chasing distribution buffer 13c is sequentially read out for 33.33 ms. Moves to chasing playback distribution (high-speed thinning distribution) that performs streaming distribution at intervals. In this case, the writing operation to the chasing distribution buffer 13c and the chasing reproduction distribution are continued until the high-speed shooting moving image is caught up.

  FIG. 14 shows a case where the slow motion playback operation is performed at the timing of the frame number “18” in the high-speed shooting streaming delivery operation (real-time slow motion) as in FIG. The value of F2 is “when 1”. In the case shown in the drawing, each image of frame numbers “26”, “34”, and “42” obtained by further thinning out the thinned streaming image (1) to 1/2 in the chasing distribution buffer 13c from the time of the slow motion playback operation. The case where is sequentially stored is illustrated.

  In this way, when chasing distribution is performed instead of slow motion reproduction distribution, each image in the chasing distribution buffer 13c is sequentially read out at intervals of 33.33 ms and chased reproduction distribution is performed. As a result, the first image (image with frame number “26”) in the chasing distribution buffer 13c is read out and distributed at the timing of frame number “38” of the high-speed shooting moving image, and the second image. (Image with frame number “34”) is read and distributed at timing “42”, and the third image (image with frame number “42”) is read and distributed at timing “46”. Is done. In this case, in the example of FIG. 14, the catch-up playback distribution process is terminated at this point because the frame number “50” is reached, and the flow moves to step S39 to resume the high-speed shooting streaming distribution (decimation distribution). To return to the normal state. Thereafter, the process proceeds to step S4 in FIG.

  On the other hand, during the distribution of the image as described above, the operation of sequentially recording and storing the distributed moving image and the image corresponding to the predetermined operation in the portable memory (for example, SD card) in the storage unit 13 is performed. As a result of continuing from the start to the end of distribution (while executing the flow of FIGS. 5 to 7), the portable memory in the storage unit 13 was distributed from the start of distribution to the end of distribution. All images are recorded and saved as they are.

  As described above, in the present embodiment, the imaging device 1 performs streaming distribution of the moving image captured by the imaging unit 15 in real time via the mobile terminal device 2 and the communication network (the wireless communication network 3 and the Internet 5). In this state, when a predetermined operation is performed during the streaming distribution, an image corresponding to the predetermined operation is distributed for a predetermined time, so that the moving image being shot is distributed in real time. In this case, a variety of images can be distributed simply by utilizing existing functions, and it is possible to contribute to the spread of streaming distribution by individuals.

  When a predetermined operation is performed during streaming distribution, an image corresponding to the predetermined operation is distributed for a predetermined time instead of the moving image being distributed. The images replaced with the moving images being distributed can be viewed for a limited time.

  When a still image shooting operation is performed as a predetermined operation, the captured still image is distributed for a predetermined time instead of the moving image being distributed. It is possible to switch from moving images to still image distribution by simply performing an operation.

  When a still image shooting operation is performed, a synthesized image obtained by synthesizing a still image within a predetermined display area of a moving image being distributed is distributed for a predetermined time instead of the moving image being distributed. The (viewer) can view both a still image and a moving image at the same time.

  When a still image shooting operation is performed, the moving image being delivered and the still image are distributed alternately for a predetermined time, so that the viewer (viewer) can view both the still image and the moving image. At the same time.

  An undelivered moving image that has not been distributed during still image distribution is temporarily stored in the chasing distribution buffer 13c, and after distribution of the still image, based on the undistributed moving image stored in the chasing distribution buffer 13c. Since the chasing distribution is performed, the viewer (viewer) can view the moving image within the interruption period even if the distribution of the still image is interrupted.

  The chasing distribution buffer 13c thins out and stores undelivered moving images that were not distributed during the distribution of still images, so that high-speed chasing distribution according to the decimation is possible.

  Since an arbitrary time can be set as the above-mentioned predetermined time by the key operation of the operation unit 14, still image distribution that continuously distributes a single still image, and a combined image that combines and distributes still images in a moving image It is possible to arbitrarily control the time for performing distribution and alternate distribution in which still images and moving images are alternately distributed according to the intention of the user.

  Since the time from the release button pressing operation (shooting start operation) to the release of the pressing is also set to the predetermined time, the predetermined time can be changed by pressing the release button.

  When a slow motion delivery operation that instructs delivery in a slower motion than the moving image being delivered is performed, the slow motion image is delivered for a predetermined time instead of the moving image being delivered. It is possible to replace slow motion image delivery simply by performing a slow motion delivery operation during delivery.

  When streaming delivery is performed by thinning out a moving image shot at a high speed by the imaging unit 15 capable of high-speed shooting at a speed exceeding the communication speed of the communication network to a frame rate that can be distributed at the communication speed of the communication network. When a slow motion playback operation is performed as a predetermined operation, the high speed shooting moving images are sequentially stored in the slow motion distribution buffer 13d, and the high speed shooting moving images in the slow motion distribution buffer 13d are thinned and distributed. Since the video is distributed for a predetermined time instead of the moving image in the middle, it is possible to perform the slow motion distribution by distributing the high-speed shooting moving image without thinning instead of the moving image distributed by thinning.

  The undelivered moving image that was not distributed during the slow motion distribution is stored in the chasing distribution buffer 13c, and after the slow motion distribution, the chasing distribution is performed based on the undistributed moving image stored in the chasing distribution buffer 13c. As a result, a viewer (viewer) can view a moving image within the interruption period even if the slow motion distribution is interrupted.

  The chasing distribution buffer 13c stores undelivered moving images that were not distributed during the slow motion distribution more thinly than in the normal thinning distribution, so that high-speed chasing distribution according to thinning is possible. Become.

  Since it is determined whether or not a slow motion delivery operation has been performed when high-speed shooting is performed by the imaging unit 15, it is possible to enable slow motion distribution only when high-speed shooting is performed. it can.

  The predetermined time during which the slow motion distribution is performed is a time determined according to the number of frames in which the high-speed captured moving image can be stored in the slow motion distribution buffer 13d. Therefore, the slow motion distribution time is arbitrarily changed from time to time. can do.

  Since the predetermined time during which the slow motion distribution is performed is a time until an operation for instructing the stop of the slow motion distribution is performed, the time during which the slow motion distribution is performed can be arbitrarily changed from time to time.

  Since the images taken by the imaging unit 15 are sequentially stored in the storage unit 13, the moving image being distributed can be recorded and saved as it is.

  Since the moving image to be streamed and the image corresponding to the predetermined operation are sequentially stored in the storage unit 13, even if switching to still image distribution or slow motion distribution during streaming distribution of the moving image, The switched image can also be recorded and saved.

  In the above-described embodiment, the slow motion delivery is performed in response to the slow motion delivery operation when the imaging unit 15 performs the high speed photography. However, the slow motion delivery is not limited to the high speed photography. For example, the present invention can be similarly applied even when shooting is performed at intervals of 33.33 ms. In this case, in the flowchart of FIG. 6, a step of determining the presence / absence of the slow motion distribution operation is inserted at the position determined as NO in step S15 for determining the presence / absence of the still image shooting operation. What is necessary is just to insert the step which performs a slow motion delivery process, when it determines with operation having been performed. This slow motion delivery process is basically the same process as steps S31 to S39 in FIG. 7, but in this case, when delivering the contents of the slow motion delivery buffer 13d instead of the normal delivery, For example, distribution may be performed at intervals of 1.5 times or twice that of normal distribution.

  In the above-described embodiment, the captured moving image is thinned for chasing distribution and stored in the chasing distribution buffer 13c. However, the moving image may be stored without being thinned and distributed when chasing distribution is performed. .

  In the above-described embodiment, the frame image captured during the still image capturing operation is distributed as a still image instead of the moving image during the streaming distribution of the moving image. An independent still image capturing unit may be provided, and the still image captured by the still image capturing unit may be interrupted and distributed instead of the moving image being distributed.

  In the above-described embodiment, a captured still image or a high-speed shooting moving image for slow motion is used as an image corresponding to a predetermined operation instead of the moving image being distributed. These images may be read out in correspondence with a predetermined operation and delivered by interruption.

  In the above-described embodiment, when a captured still image is distributed for a predetermined time instead of a moving image being distributed, still image distribution in which a single still image is distributed continuously, and still images are synthesized within the moving image The composite image distribution to be distributed and the alternate distribution to alternately distribute the still image and the moving image are performed, but a plurality of types of still images (for example, still image A and still image B) are alternately distributed. It may be. Further, a plurality of types of still images may be combined and distributed.

  In the above-described embodiment, the short-distance communication is performed between the imaging device 1 and the mobile terminal device 2, thereby connecting to the communication network (wireless communication network 3, Internet 5) via the mobile terminal device 2. However, a wireless communication function that can be connected to the wireless communication network 3 may be built in the imaging apparatus 1.

  In the above-described embodiments, a case where the present invention is applied to a digital compact camera has been described. However, a digital single-lens reflex camera may be used, and a personal computer with a camera function, a PDA (personal portable information communication device), a music player -It may be an electronic game.

  Further, the “apparatus” and “unit” shown in the above-described embodiments may be separated into a plurality of cases by function, and are not limited to a single case. In addition, each step described in the above-described flowchart is not limited to time-series processing, and a plurality of steps may be processed in parallel or separately.

The embodiment of the present invention has been described above. However, the present invention is not limited to this, and includes the invention described in the claims and the equivalent scope thereof.
Hereinafter, the invention described in the claims of the present application will be appended.
(Appendix)
(Claim 1)
The invention described in claim 1
An imaging apparatus provided with a moving image shooting means,
A delivery means for streaming the moving image taken by the moving picture photographing means in real time via a communication network;
A discriminating unit for discriminating whether or not a predetermined operation has been performed during streaming delivery of a moving image by the distributing unit;
A distribution control unit that performs distribution control to distribute an image corresponding to the predetermined operation to the arrangement unit for a predetermined period of time via the communication network when the determination unit determines that the predetermined operation has been performed; ,
It is an imaging device characterized by comprising.
(Claim 2)
The invention according to claim 2 is the imaging apparatus according to claim 1,
The distribution unit generates a normal moving image for distribution in real time from the moving image captured by the moving image capturing unit, and transmits the normal moving image for distribution generated in real time via the communication network. Stream in real time,
When it is determined that the predetermined operation has been performed, the distribution control unit sends an image corresponding to the predetermined operation to the distribution unit instead of the normal moving image for distribution generated in real time. Streaming via a communication network,
An imaging apparatus characterized by being configured as described above.
(Claim 3)
According to a third aspect of the present invention, in the imaging device according to the first or second aspect,
It further includes a still image shooting means,
The determining unit determines whether or not a still image shooting operation for instructing shooting by the still image shooting unit is performed as a predetermined operation during streaming distribution of the moving image by the distributing unit;
The distribution control means performs distribution control for distributing a still image captured by the still image capturing means to the distribution means for a predetermined time when it is determined that the still image capturing operation is performed by the determining means.
The imaging apparatus is characterized by the above.
(Claim 4)
The invention according to claim 4 is the imaging apparatus according to claim 3,
The distribution control unit combines the still image captured by the still image capturing unit within a predetermined display area of the moving image being distributed when the determination unit determines that a still image capturing operation has been performed. Performing distribution control for causing the distribution means to distribute the image for a predetermined time;
The imaging apparatus is characterized by the above.
(Claim 5)
The invention according to claim 4 is the imaging apparatus according to claim 3,
The distribution control unit alternately sends the moving image being distributed and the still image captured by the still image capturing unit to the distribution unit when the determination unit determines that a still image capturing operation has been performed. Perform distribution control to distribute for a predetermined time,
The imaging apparatus is characterized by the above.
(Claim 6)
The invention according to claim 5 is the imaging apparatus according to any one of claims 3 to 5,
A temporary storage means for chasing distribution that temporarily stores undelivered moving images that were not distributed during distribution of still images by the distribution control means;
The distribution control unit performs distribution control for causing the distribution unit to perform chasing distribution based on an undistributed moving image stored in the chasing distribution temporary storage unit after distributing the still image for a predetermined time. ,
The imaging apparatus is characterized by the above.
(Claim 7)
The invention according to claim 7 is the imaging apparatus according to claim 6,
The temporary storage means for chasing distribution thins out and stores undelivered moving images that were not distributed during the distribution of the still image,
The distribution control means causes the distribution means to follow and distribute by sequentially reading out undistributed moving images stored in the temporary storage means for chasing distribution.
The imaging apparatus is characterized by the above.
(Claim 8)
The invention according to claim 8 is the imaging device according to any one of claims 1 to 7,
A setting means for arbitrarily setting the predetermined time;
The imaging apparatus is characterized by the above.
(Claim 9)
The invention according to claim 9 is the imaging apparatus according to any one of claims 3 to 7,
The predetermined time is a time from the start to the release of the operation of the photographing operator that instructs photographing by the still image photographing means.
The imaging apparatus is characterized by the above.
(Claim 10)
The invention described in claim 9 is the imaging apparatus according to claim 1 or 2,
The determining means determines whether or not a slow motion distribution operation for instructing a slower motion distribution than the moving image being distributed as a predetermined operation during the streaming distribution of the moving image by the distributing means,
The distribution control unit generates a distributed slow motion image in real time from the moving image captured by the moving image capturing unit when the determination unit determines that the slow motion distribution operation has been performed, and the distribution Perform distribution control to allow the means to distribute for a predetermined time,
The imaging apparatus is characterized by the above.
(Claim 11)
The invention according to claim 11 is the imaging apparatus according to claim 9,
The moving image shooting means is capable of high-speed shooting at a speed exceeding the communication speed of the communication network,
The distribution unit distributes the high-speed captured moving image captured at high speed by the moving image capturing unit by thinning out to a frame rate that can be distributed at the communication speed of the communication network,
Temporary storage means for slow motion distribution that temporarily stores the subsequent high-speed captured moving images when the determination means determines that a slow motion distribution operation has been performed during the thinning distribution by the distribution means. ,
The delivery control means performs delivery control for slow motion delivery by causing the delivery means to sequentially read and deliver the high-speed captured moving image stored in the temporary storage means for slow motion delivery for a predetermined time.
The imaging apparatus is characterized by the above.
(Claim 12)
The invention according to claim 12 is the imaging apparatus according to claim 10 or 11,
A temporary storage means for chasing distribution for temporarily storing undelivered moving images that were not distributed during slow motion distribution by the distribution control means;
The distribution control unit distributes the slow motion captured image for a predetermined time, and then distributes the chasing distribution to the distribution unit based on an undistributed moving image stored in the chasing distribution temporary storage unit. I do,
The imaging apparatus is characterized by the above.
(Claim 13)
The invention according to claim 13 is the imaging apparatus according to claim 12,
The temporary storage means for chasing distribution stores undelivered moving images that were not distributed during the slow motion distribution by thinning out the thinned out images by the distribution means,
The distribution control means causes the distribution means to follow and distribute by sequentially reading out undistributed moving images stored in the temporary storage means for chasing distribution.
The imaging apparatus is characterized by the above.
(Claim 14)
The invention according to claim 14 is the imaging apparatus according to any one of claims 11 to 13,
The determination means further determines whether or not the high-speed shooting is performed, and determines whether or not the slow motion delivery operation is performed when it is determined that the high-speed shooting is performed.
The imaging apparatus is characterized by the above.
(Claim 15)
According to a fifteenth aspect of the present invention, in the imaging apparatus according to the eleventh aspect,
The predetermined time is a time determined according to the number of frames in which the high-speed captured moving image can be stored in the temporary storage means for slow motion delivery.
This is an imaging apparatus.
(Claim 16)
The invention according to claim 16 is the imaging apparatus according to any one of claims 10 to 14,
The predetermined time is a time until an operation to instruct to stop the slow motion delivery is performed.
This is an imaging apparatus.
(Claim 17)
The invention described in claim 17 is the imaging apparatus according to claim 1,
A storage unit that sequentially stores images captured by the moving image capturing unit;
The imaging apparatus is characterized by the above.
(Claim 18)
The invention according to claim 18 is the imaging apparatus according to claim 17,
The storage means sequentially stores a moving image distributed by the distribution means and an image corresponding to the predetermined operation;
The imaging apparatus is characterized by the above.
(Claim 19)
The invention described in claim 18
Streaming the moving image captured by the moving image capturing means in real time via a communication network;
Determining whether a predetermined operation is performed during streaming distribution of the moving image;
Performing distribution control for distributing an image corresponding to the predetermined operation for a predetermined time via the communication network when it is determined that the predetermined operation has been performed;
It is the imaging processing method characterized by including this.
(Claim 20)
The invention according to claim 20 provides
Against the computer,
A function for streaming a moving image captured by a moving image capturing means in real time via a communication network;
A function of determining whether a predetermined operation is performed during streaming distribution of the moving image;
A function of performing distribution control for distributing an image corresponding to the predetermined operation for a predetermined time via the communication network when it is determined that the predetermined operation has been performed;
It is a program for realizing.
(Claim 21)
The invention according to claim 21
An imaging device that captures a moving image, a management device that receives a moving image captured by the imaging device via a communication network, and a receiving-side terminal device that receives the moving image from the management device via a communication network An imaging processing system comprising:
The imaging apparatus includes a distribution unit that performs real-time streaming distribution of a moving image captured by a moving image capturing unit via a communication network, and whether a predetermined operation has been performed during streaming distribution of the moving image by the distribution unit. A distribution unit that distributes an image corresponding to the predetermined operation to the distribution unit for a predetermined time via the communication network when the determination unit determines that a predetermined operation has been performed. Distribution control means for performing control,
The management device receives a moving image that is streamed in real time from the imaging device and an image corresponding to the predetermined operation, and streams the image to the terminal device in real time.
This is an imaging processing system characterized by the above.

DESCRIPTION OF SYMBOLS 1 Imaging device 2 Portable terminal device 3 Wireless communication network 4 Other portable terminal devices 5 Internet 6 Management server 7 PC
8 TV receiver 11 Control unit 13 Storage unit 13a Program memory 13c Chasing distribution buffer 13d Slow motion distribution buffer 14 Operation unit 15 Imaging unit 16 Display unit 18 Near field communication unit F1 Still image distribution flag F2 Chasing reproduction flag

Claims (21)

An imaging apparatus provided with a moving image shooting means,
A delivery means for streaming the moving image taken by the moving picture photographing means in real time via a communication network;
A discriminating unit for discriminating whether or not a predetermined operation has been performed during streaming delivery of a moving image by the distributing unit;
Distribution control means for performing distribution control for causing the distribution means to distribute an image corresponding to the predetermined operation for a predetermined time via the communication network when it is determined that the predetermined operation has been performed by the determination means;
An image pickup apparatus comprising: The distribution unit generates a normal moving image for distribution in real time from the moving image captured by the moving image capturing unit, and transmits the normal moving image for distribution generated in real time via the communication network. Stream in real time,
When it is determined that the predetermined operation has been performed, the distribution control unit sends an image corresponding to the predetermined operation to the distribution unit instead of the normal moving image for distribution generated in real time. Streaming via a communication network,
The imaging apparatus according to claim 1, which is configured as described above. It further includes a still image shooting means,
The determining unit determines whether or not a still image shooting operation for instructing shooting by the still image shooting unit is performed as a predetermined operation during streaming distribution of the moving image by the distributing unit;
The distribution control means performs distribution control for distributing a still image captured by the still image capturing means to the distribution means for a predetermined time when it is determined that the still image capturing operation is performed by the determining means.
The imaging apparatus according to claim 1, wherein the imaging apparatus is configured as described above. The distribution control unit combines the still image captured by the still image capturing unit within a predetermined display area of the moving image being distributed when the determination unit determines that a still image capturing operation has been performed. Performing distribution control for causing the distribution means to distribute the image for a predetermined time;
The imaging apparatus according to claim 3, which is configured as described above. The distribution control unit alternately sends the moving image being distributed and the still image captured by the still image capturing unit to the distribution unit when the determination unit determines that a still image capturing operation has been performed. Perform distribution control to distribute for a predetermined time,
The imaging apparatus according to claim 3, which is configured as described above. A temporary storage means for chasing distribution that temporarily stores undelivered moving images that were not distributed during distribution of still images by the distribution control means;
The distribution control unit performs distribution control for causing the distribution unit to perform chasing distribution based on an undistributed moving image stored in the chasing distribution temporary storage unit after distributing the still image for a predetermined time. ,
The imaging apparatus according to claim 3, wherein the imaging apparatus is configured as described above. The temporary storage means for chasing distribution thins out and stores undelivered moving images that were not distributed during the distribution of the still image,
The distribution control means causes the distribution means to follow and distribute by sequentially reading out undistributed moving images stored in the temporary storage means for chasing distribution.
The imaging apparatus according to claim 6, which is configured as described above. A setting means for arbitrarily setting the predetermined time;
The imaging apparatus according to claim 1, wherein the imaging apparatus is configured as described above. The predetermined time is a time from the start to the release of the operation of the photographing operator that instructs photographing by the still image photographing means.
The imaging apparatus according to claim 3, wherein the imaging apparatus is configured as described above. The determining means determines whether or not a slow motion distribution operation for instructing a slower motion distribution than the moving image being distributed as a predetermined operation during the streaming distribution of the moving image by the distributing means,
The distribution control unit generates a slow motion image for distribution in real time from the moving image captured by the moving image capturing unit when the determination unit determines that the slow motion distribution operation has been performed, and the distribution Perform distribution control to allow the means to distribute for a predetermined time,
The imaging apparatus according to claim 1, wherein the imaging apparatus is configured as described above. The moving image shooting means is capable of high-speed shooting at a speed exceeding the communication speed of the communication network,
The distribution unit distributes the high-speed captured moving image captured at high speed by the moving image capturing unit by thinning out to a frame rate that can be distributed at the communication speed of the communication network,
Temporary storage means for slow motion distribution that temporarily stores the subsequent high-speed captured moving images when the determination means determines that a slow motion distribution operation has been performed during the thinning distribution by the distribution means. ,
The delivery control means performs delivery control for slow motion delivery by causing the delivery means to sequentially read and deliver the high-speed captured moving image stored in the temporary storage means for slow motion delivery for a predetermined time.
The imaging apparatus according to claim 10, which is configured as described above. A temporary storage means for chasing distribution for temporarily storing undelivered moving images that were not distributed during slow motion distribution by the distribution control means;
The distribution control unit distributes the slow motion captured image for a predetermined time, and then distributes the chasing distribution to the distribution unit based on an undistributed moving image stored in the chasing distribution temporary storage unit. I do,
12. The imaging apparatus according to claim 10, wherein the imaging apparatus is configured as described above. The temporary storage means for chasing distribution stores undelivered moving images that were not distributed during the slow motion distribution by thinning out the thinned out images by the distribution means,
The distribution control means causes the distribution means to follow and distribute by sequentially reading out undistributed moving images stored in the temporary storage means for chasing distribution.
The imaging apparatus according to claim 12, which is configured as described above. The determination means further determines whether or not the high-speed shooting is performed, and determines whether or not the slow motion delivery operation is performed when it is determined that the high-speed shooting is performed.
The imaging apparatus according to claim 11, wherein the imaging apparatus is configured as described above. The predetermined time is a time determined according to the number of frames in which the high-speed captured moving image can be stored in the temporary storage means for slow motion delivery.
The imaging apparatus according to claim 11. The predetermined time is a time until an operation to instruct to stop the slow motion delivery is performed.
The imaging apparatus according to claim 10, wherein the imaging apparatus is characterized in that A storage unit that sequentially stores images captured by the moving image capturing unit;
The imaging apparatus according to claim 1, which is configured as described above. The storage means sequentially stores a moving image distributed by the distribution means and an image corresponding to the predetermined operation;
The imaging apparatus according to claim 17, which is configured as described above. Streaming the moving image captured by the moving image capturing means in real time via a communication network;
Determining whether a predetermined operation is performed during streaming distribution of the moving image;
Performing distribution control for distributing an image corresponding to the predetermined operation for a predetermined time via the communication network when it is determined that the predetermined operation has been performed;
An imaging processing method comprising: Against the computer,
A function for streaming a moving image captured by a moving image capturing means in real time via a communication network;
A function of determining whether a predetermined operation is performed during streaming distribution of the moving image;
A function of performing distribution control for distributing an image corresponding to the predetermined operation for a predetermined time via the communication network when it is determined that the predetermined operation has been performed;
A program to realize An imaging device that captures a moving image, a management device that receives a moving image captured by the imaging device via a communication network, and a receiving-side terminal device that receives the moving image from the management device via a communication network An imaging processing system comprising:
The imaging apparatus includes a distribution unit that performs real-time streaming distribution of a moving image captured by a moving image capturing unit via a communication network, and whether a predetermined operation has been performed during streaming distribution of the moving image by the distribution unit. A distribution unit that distributes an image corresponding to the predetermined operation to the distribution unit for a predetermined time via the communication network when the determination unit determines that a predetermined operation has been performed. Distribution control means for performing control,
The management device receives a moving image that is streamed in real time from the imaging device and an image corresponding to the predetermined operation, and streams the image to the terminal device in real time.
An imaging processing system characterized by the above.

Images