KR20170009611A - The method and system for acquisition of multiple images in real-time - Google Patents

Abstract

The present invention relates to a method and a system for obtaining multiple images in real time, including: remotely controlling multiple guest devices having a photographing function; obtaining an image; dividing images obtained from the multiple guest devices; and outputting the image.

Description

METHOD AND SYSTEM FOR ACQUISITION OF MULTIPLE IMAGES IN REAL-TIME < RTI ID = 0.0 >

The present invention relates to a real-time multi-image acquisition method and system, and more particularly, to a system and method for acquiring at least one image by remotely controlling a plurality of guest devices having a photographing function using a host device, And a system for implementing the method. [0003] 2. Description of the Related Art [0004]

BACKGROUND ART [0002] Recently, with the development of technologies related to wireless communication and smart phones, there have been developed many algorithms for wirelessly controlling digital devices using smart phones or software (for example, applications) to which such algorithms are applied.

On the other hand, the public interest in the field of photographing or image photographing has been increasing, and a lot of photographic aids such as a helical rope or a self-contained lens have been on the increase. Also, Research on techniques for taking pictures remotely is actively under way.

In accordance with this technical flow, a technology for shooting a subject that has been distant from a distance using a smartphone is being developed. However, until now, the smartphone is only 1: 1 connected with one camera to control the camera. The GoPro HERO4 device, which has a function to control multiple cameras connected to multiple cameras, requires a separate controller and can not directly view and control the preview screen of the connected cameras.

Accordingly, in order to improve the convenience and usability of the present invention, it is possible to control a plurality of photographing devices located at different angles by using only one control device without a separate device, A system capable of monitoring and shooting in real time is needed.

As an embodiment of the present invention, a real-time multi-image acquisition method and system thereof can be provided. In other words, a method of remotely acquiring images from a plurality of guest devices having a photographing function and outputting the divided images on a display screen of the host device, and photographing a plurality of guest devices by remotely controlling the method The system can be provided.

A method for real-time multi-image acquisition according to an embodiment of the present invention includes a first step in which a host device is connected to at least one guest device among a plurality of guest devices having a photographing function by wireless communication, A second step of receiving information on an image frame in real time from at least one guest device of the plurality of guest devices, a third step of storing information on the received image frame in the database in accordance with the identification information of the connected guest device, A fourth step of the host device transmitting an operation condition setting signal, an image capturing command signal, and time information at the time when the image capturing command is commanded to the connected guest device; The guest who has received the image shooting command under the set operating conditions A sixth step of stopping reception of information on the real-time image frame from the apparatus, a sixth step of stopping reception of information on the real-time image frame, a step of receiving, from the information on the image frame stored in the database according to the identification information, And a seventh step of outputting the extracted image frame through the display unit of the host apparatus.

The information about the image frame according to the embodiment of the present invention includes the image number and the image frame number of the subject observed in real time through the guest device, and the identification information of the guest device includes an ID And the operating condition may include, but is not limited to, a lens exposure value, a zoom in-out ratio, and a shutter speed value of the guest device.

The second step of the real-time multi-image acquisition method according to an embodiment of the present invention includes displaying information about an image frame received in real time from a guest device through a display unit of the host device, A part of the display unit can be displayed as a divided screen based on the entire display unit of the host apparatus or the number of connected guest apparatuses connected thereto.

A host device according to an embodiment of the present invention includes a communication device for transmitting and receiving data wirelessly with a guest device having a photographing function, a signal for setting an operation condition of the guest device, an image photographing command signal, And a display unit for outputting information on an image frame received in real time from the guest device through a communication unit and a communication unit for causing the communication unit to transmit at least one of the time information and the time information to the guest device, Out rate, and shutter speed value.

A method of operating a guest device to acquire multiple images in real time according to an embodiment of the present invention includes a first step of wirelessly communicating with a host device, a first step of transmitting information on an image frame to a connected host device in real time A third step of receiving an operation condition setting signal, an image capturing command signal, and time information at the time of commanding image capturing from the host device, a third step of acquiring the image capturing command at the time of commanding the image capturing under the set operating conditions A fourth step of transmitting the frame number of the acquired image to the host apparatus, and a fifth step of stopping the transmission of the information about the image frame to the host apparatus and waiting for a new image capturing command signal from the host apparatus.

A guest device according to an embodiment of the present invention includes a lens unit that receives an optical signal as an input signal, an image pickup unit that converts the optical signal into an electric signal, a memory unit that stores an output signal of the image pickup unit, Wherein the output signal includes at least one of pixel value information of an image of a subject, brightness value information of an image, time information obtained by an image, operation condition information of a guest device, and frame number of an image Information.

The real-time multi-image acquisition system provided as an embodiment of the present invention includes a database for storing information about image frames in real time according to identification information of a host device, at least one guest device, and a guest device provided from the host device can do.

Meanwhile, as an embodiment of the present invention, a computer-readable recording medium on which a program for causing the computer to execute the above-described method may be provided.

According to an embodiment of the present invention, there is provided a real-time multi-image acquisition method and system, wherein a host device remotely controls a plurality of guest devices having a photographing function to acquire images, And output the images. In other words, it is possible to acquire images illuminated at various angles with respect to a subject distant from the host apparatus at a time, thereby overcoming the physical and temporal limitations of photography. Therefore, it is possible to introduce a real-time multi-image acquisition method and its system into a broadcast, a picture, a cinematography, etc., and photograph or edit a photograph while monitoring a plurality of cameras in real time.

1 is a flowchart illustrating a real-time multi-image acquisition method according to an embodiment of the present invention.
2 is a block diagram of a real-time multi-image acquisition system in accordance with an embodiment of the present invention.
3 is a view illustrating a preview screen in which a host apparatus receives and displays information on image frames in real time according to an embodiment of the present invention.
FIG. 4 is a diagram illustrating a step of extracting an image frame stored in a database and outputting the extracted image frame to a host device after a shooting command is performed according to an embodiment of the present invention.
5 is a block diagram of a host device according to an embodiment of the present invention.
6 is a flowchart illustrating an operation method of a guest apparatus for real-time multi-image acquisition according to an embodiment of the present invention.
FIG. 7 is a flowchart illustrating an operation example of a host apparatus for real-time multi-image acquisition according to an embodiment of the present invention.
8 is a flowchart illustrating an example of operation of a guest apparatus for real-time multi-image acquisition according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

The terms used in this specification will be briefly described and the present invention will be described in detail.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments. Also, in certain cases, there may be a term selected arbitrarily by the applicant, in which case the meaning thereof will be described in detail in the description of the corresponding invention. Therefore, the term used in the present invention should be defined based on the meaning of the term, not on the name of a simple term, but on the entire contents of the present invention.

When an element is referred to as "including" an element throughout the specification, it is to be understood that the element may include other elements as well, without departing from the spirit or scope of the present invention. Also, the terms "part," " module, "and the like described in the specification mean units for processing at least one function or operation, which may be implemented in hardware or software or a combination of hardware and software . In addition, when a part is referred to as being "connected" to another part throughout the specification, it includes not only "directly connected" but also "connected with other part in between".

Throughout the specification, the term "image frame" can refer to a cut of a digital image in pixels.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a flowchart illustrating a real-time multi-image acquisition method according to an embodiment of the present invention, and FIG. 5 is a block diagram of a host apparatus according to an embodiment of the present invention.

The real-time multi-image acquisition method according to the embodiment of the present invention is characterized in that the host device 200 is a guest device 301 (at least one of 301 to 30N, N is a positive integer) (N is a positive integer) of the plurality of guest devices (301 to 30N, N being a positive integer) through wireless communication through a wireless communication with the host device 200 A second step S20 of receiving information on the image frame 110 from any one of the guest devices 301 to 30N and N being positive integers in real time, A third step (S30) of storing the data in the database 400 in accordance with the identification information of the devices 301 to 30N (N is a positive integer), and the host device 200 stores the operation condition setting signal, The time information at the time of command is connected A fourth step S40 of transmitting the frame number 110 of the host device 200 to the host device 200 through the host device 200 A fifth step (S50) of receiving from the guest device (301 to 30N, N being a positive integer) the image taking command is received, a sixth step (S60) of stopping the reception of information on the real time image frame (110) In the third step, the image frame 110 corresponding to the frame number of the image received in the fifth step is extracted from the information about the image frame 110 stored in the database 400 according to the identification information, 110 of the host apparatus 200 through the display unit 230 of the host apparatus 200. FIG.

A method in which the host apparatus 200 is connected to the guest apparatuses 301 to 30N and N by a positive integer according to an embodiment of the present invention may be Wi-Fi, Bluetooth, DLNA But is not limited to, a NFC (Living Network Alliance), NFC (Near Field Communication), Beacon (beacon), Zigbee, and the like.

The host device 200 according to an embodiment of the present invention may include a communication unit 220, a control unit 210, and a display unit 230 as shown in the block diagram of FIG.

The communication unit 220 of the host device 200 according to an exemplary embodiment of the present invention is a module for transmitting and receiving data wirelessly with guest devices 301 to 30N having a photographing function and N is a positive integer, Transmits to the communication unit 220 a signal for setting an operation condition of the guest devices 301 to 30N and N is a positive integer and an image capturing command signal and time information at the time of commanding image capturing, And the display unit 230 displays the image frame 110 received in real time from the guest devices 301 to 30N (N is a positive integer) through the communication unit 220, And outputting the information on the display device.

The guest devices 301 to 30N (N is a positive integer) according to an embodiment of the present invention may include a lens portion, an image pickup portion, a memory portion, and a communication portion. An optical signal received as an input signal in the lens unit is converted into an electric signal in the image pickup unit, a memory unit stores an output signal of the image pickup unit, and a communication unit transmits data including an output signal of the image pickup unit to the host device 200 . The signal output from the image pickup unit includes pixel value information of the image for the subject, luminance value information of the image, time information obtained by the image, operation condition information of the guest devices (301 to 30N, N is a positive integer) Frame 110 number information.

2 is a block diagram of a real-time multi-image acquisition system in accordance with an embodiment of the present invention.

The real-time multi-image acquisition system 100 provided as an embodiment of the present invention may include a host device 200, at least one guest device 301 to 30N, N is a positive integer, and a database 400 .

The host device 200 according to an exemplary embodiment of the present invention may include a mobile device (e.g., a smart phone, a tablet PC, a smart watch, etc.), a notebook, a personal computer (PC), an e-Book, a camera, , But is not necessarily limited thereto. In other words, the host device 200 may be a device capable of communicating with another device.

The guest devices 301 to 30N (N is a positive integer) according to an embodiment of the present invention may include a personal computer (PC) including a camera, a webcam, a notebook, a smart phone, a camcorder, a tablet PC, But the present invention is not limited thereto.

The database 400 according to an embodiment of the present invention stores information on the real-time image frame 110 received from the host apparatus 200 according to the identification information of the guest devices 301 to 30N (N is a positive integer) . The database 400 stores the image frames 110 photographed by the host device 200 and displays the image frames 110 of the stored guest devices 301 to 30N And when data of a predetermined range (for example, 80%) or more of the entire capacity of the database 400 is stored, the guest devices 301 to 30N having the largest number of image frames 110, N is a positive integer The first image frame 110 of the first image frame 110 can be sequentially deleted to secure a storage space.

3 is a view illustrating a preview screen in which the host apparatus 200 receives and displays information on the image frame 110 in real time according to an embodiment of the present invention.

The information about the image frame 110 according to an embodiment of the present invention includes the image and the image frame 110 number for the subject that is observed in real time through the guest devices 301 to 30N and N is a positive integer .

The host device 200 according to an embodiment of the present invention receives information about the image frame 110 from the guest device (301 to 30N, N is a positive integer) connected by wireless communication in real time, A part of the display unit 230 may be output as a divided screen based on the number of all the display units 230 of the host apparatus or the number of the guest apparatuses 301 to 30N (N being a positive integer) connected thereto. For example, an image photographed on the right side of the subject from the first guest device 301 is received and is output to a part of the divided screen of the display unit 230, and the left side of the subject is photographed from the second guest device 302 It is possible to receive one image and output it to a part of the divided screen of the display unit 230.

The guest device 301 to 30N according to the embodiment of the present invention transmits the information about the image frame 110 to the host device 200 in a streaming manner, A preview image may be provided through the display unit 230 of the display unit 230 and an image may be output through the display unit 230 by using an application of the smartphone. According to an embodiment of the present invention, when the guest device 301 to 30N (N is a positive integer) transmits information about the image frame 110 in a streaming manner, The transmission efficiency can be increased by using the H.264 image compression algorithm which can reduce the size.

The host device 200 receives the information about the image frame 110 from the guest devices 301 to 30N and N is a positive integer and then transmits it to the guest devices 301 to 30N connected in the wireless communication, The image frame 110 and the image frame 110 number may be stored in the database 400 according to the identification information of the image frame 110. [ The identification information according to an embodiment of the present invention may include an ID assigned to each guest device 301 to 30N (N is a positive integer).

The host device 200 receives information about the image frame 110 and outputs the image through the display unit 230 and then sets operating conditions of the connected guest devices 301 to 30N and N are positive integers have. The operating condition according to an embodiment of the present invention may include, but is not limited to, a lens exposure value, a zoom in-out ratio, and a shutter speed value of the guest device. When the operating conditions of the connected guest devices 301 to 30N (N is a positive integer) are set, the host device 200 can send an image capturing command signal to the connected guest devices 301 to 30N (N is a positive integer) have. The time information at the time of commanding the image taking when the host device 200 transmits the image capturing command signal to the guest devices 301 to 30N (N is a positive integer) to which the host device 200 is connected is also the guest device 301 to 30N Integer).

When the host device 200 receives the image capturing command signal and the time information at the time of commanding the image capturing, the guest devices 301 to 30N (N is a positive integer) Can be transmitted to the host apparatus 200.

4 is a diagram illustrating a step of extracting an image frame 110 stored in a database 400 after outputting a photographing command according to an embodiment of the present invention and outputting the image frame 110 to the host apparatus 200. [

When the image capturing command is issued in the host apparatus 200, the image frame 110 received from the guest apparatuses 301 to 30N (N is a positive integer) among the image frames 110 stored in the database 400 according to the ID of the guest apparatus It is possible to extract the image frame 110 corresponding to the number 110 and output the extracted image frame 110 through the display unit 230 of the host apparatus 200. [

FIG. 6 is a flowchart illustrating a method of operating a guest device (301 to 30N, N is a positive integer) for real-time multi-image acquisition according to an embodiment of the present invention.

A method of operating the guest devices 301 to 30N (N is a positive integer) according to an embodiment of the present invention includes a first step S100 of connecting with the host device 200 by wireless communication, A second step S200 of transmitting information on the image frame 110 in real time, a second step S200 of transmitting information on the image frame 110 in real time, an operation condition setting signal, an image photographing command signal, A fourth step (S400) of transmitting the image frame 110 number obtained at the time of commanding the image taking under the set operating conditions received in the third step to the host apparatus 200, (S500) of stopping the transmission of the information about the image frame 110 to the host apparatus 200 and waiting for a new image pickup command signal from the host apparatus 200. [

The real-time multi-image acquisition method according to an embodiment of the present invention can be divided into a series of processes occurring in the host device 200 and a series of processes occurring in the guest devices 301 to 30N (N is a positive integer).

7 is a flowchart illustrating an operation example of the host apparatus 200 for real-time multi-image acquisition according to an embodiment of the present invention.

As described above, the host apparatus 200 according to the embodiment of the present invention is a system in which a plurality of guest apparatuses 301 to 30N (N is a positive integer) are connected by radio communication and then a streaming method To receive information about the image frame 110 including the image frame 110 and the image frame 110 number in real time. The information about the received image frame 110 may be stored in the database 400 and the image frames 110 may be stored in the display unit 110 of the host device according to the number of connected guest devices 301 to 30N And may be output in a preview format through the display unit 230.

The host device 200 may set operating conditions such as a lens exposure value, a zoom in-out ratio, and a shutter speed value of the guest devices 301 to 30N (where N is a positive integer) according to an embodiment of the present invention. The set operating conditions are transmitted to the guest devices 301 to 30N (N is a positive integer) in the host device 200, and then the information on the image frame 110 is transmitted to the guest devices 301 to 30N Positive integer) and outputs it to the display unit 230 and store it in the database 400.

According to an embodiment of the present invention, when the host device 200 transmits the image pickup command signal to the guest device 301 to 30N (N is a positive integer), the time information at the time of the command is transmitted together with the guest device 301 (N is a positive integer) from the guest device (301 to 30N, N is a positive integer) upon receipt of the image frame 110 number obtained at the image capturing command Corresponding to the image frame 110 number received from the guest devices 301 to 30N (N is a positive integer) among the image frames 110 stored in the database 400 according to the ID of the guest device The image frame 110 can be extracted and output to the display unit 230 of the host apparatus 200. [ Thereafter, the user can select an image storage mode, store the image, re-take the image, or end the operation.

8 is a flowchart showing an example of operation of guest devices (301 to 30N, N is a positive integer) for real-time multi-image acquisition according to an embodiment of the present invention.

The guest devices 301 to 30N (N is a positive integer) according to an embodiment of the present invention are connected to the host device 200 in a wireless communication manner and then transmitted to the image frame 110 in real time using a streaming method. To the host device 200, information about the image frame 110 including the image frame 110 number. Upon receiving the operation condition setting value from the host device 200, the lens exposure value, the zoom in-out ratio, and the shutter speed value may be changed to transmit the image frame 110 based on the changed setting value back to the host device 200 .

When the guest device 301 to 30N (N is a positive integer) according to the embodiment of the present invention receives the image capturing command signal and the time information of the image capturing command time from the host device 200, Transmits the image frame 110 number to the host device 200, stops the transmission of the information about the real-time image frame 110, waits for the resume command signal from the host device 200 or terminates the operation .

7 and 8, the process of extracting the image frame 110 stored in the database 400 using the time information at the image capturing command time and the image frame 110 number may be performed by the host device 200, The host device 200 and the guest devices 301 to 30N (where N is a positive integer) by decreasing the time difference between the time of transmitting the image capturing command and the time of receiving the image capturing command from the guest device 301 to 30N (N is a positive integer) In order to maximize the scheduling between them.

The contents of the above-described method can be applied in connection with the system according to the embodiment of the present invention. Therefore, the description of the same contents as those of the above-described method with respect to the system is omitted.

One embodiment of the present invention may also be embodied in the form of a recording medium including instructions executable by a computer, such as program modules, being executed by a computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer-readable medium can include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes any information delivery media, including computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

100: Real-time multi-image acquisition system
110: image frame
200: Host device
210:
220: communication unit of the host device
230:
301 to 30N (where N is a positive integer): Guest device
400: Database

Claims (9)

A first step in which a host device is connected in wireless communication with at least one guest device of a plurality of guest devices having a photographing function;
A second step of the host device receiving information on an image frame in real time from at least one of the plurality of guest devices through the wireless communication in the first step;
A third step of storing information on the image frame received in the second step in a database according to the identification information of the connected guest device;
A fourth step of the host device transmitting an operation condition setting signal, an image capturing command signal, and time information at the time when the image capturing command is issued to the connected guest device;
A fifth step of receiving a frame number of an image obtained at the time when the host device instructs the image capturing in the fourth step from the guest device receiving the image capturing command under the set operating condition;
Stopping reception of information on the real-time image frame; And
Extracting an image frame corresponding to a frame number of the image received in the fifth step from the information about the image frame stored in the database according to the identification information in the third step, A seventh step of outputting through a display unit of the apparatus;
The method comprising the steps of: The method according to claim 1,
Wherein the information about the image frame includes an image of a subject observed in real time through the guest device and a frame number of the image,
Wherein the identification information of the guest device includes an ID assigned to each guest device,
Wherein the operating condition includes at least one of a lens exposure value, a zoom in-out ratio, and a shutter speed value of the guest device.
3. The method of claim 2,
Wherein the second step includes displaying information on image frames received in real time from the guest device through a display unit of the host device,
Wherein the information about the image frame is displayed as a divided screen of a part of the display unit based on the entire display unit of the host apparatus or the number of the connected guest apparatuses connected thereto.
A communication unit for wirelessly transmitting and receiving data to / from a guest device having a photographing function;
A controller for causing the communication unit to transmit to the guest device at least one of a signal for setting an operation condition of the guest device, an image capturing command signal, and time information at a time of commanding image capturing; And
And a display unit for outputting information on an image frame received in real time from the guest device through the communication unit, wherein the operating condition includes at least one of a lens exposure value, a zoom in-out ratio, and a shutter speed value To obtain a real-time multiple image.
A first step of wireless communication with the host device;
A second step of transmitting information on an image frame to the connected host device in real time;
A third step of receiving an operation condition setting signal, an image capturing command signal, and time information at the time of commanding image capturing from the host device;
A fourth step of transmitting a frame number of an image obtained at the time of commanding the image taking under the operating condition set in the third step to the host device; And
A fifth step of stopping transmission of information on the image frame to the host apparatus and waiting for a new image capturing command signal from the host apparatus;
The method comprising the steps of: receiving a plurality of real-time images;
6. The method of claim 5,
Wherein the information about the image frame includes an image of a subject observed in real time through the guest device and a frame number of the image,
Wherein the identification information of the guest device includes an ID assigned to each guest device,
Wherein the operating condition includes at least one of a lens exposure value, a zoom in-out ratio, and a shutter speed value of the guest device.
In the guest device,
An image pick-up unit for converting the optical signal into an electric signal, a memory unit for storing an output signal of the image pickup unit, and a controller for wirelessly transmitting data including the output signal to the host device And a communication unit for transmitting and receiving,
Wherein the output signal includes pixel value information of an image of a subject, brightness value information of the image, time information of the image obtained, operation condition information of the guest device, and frame number information of the image. Guest device for acquiring multiple images.
In a real-time multi-image acquisition system,
A host device;
At least one guest device; And
And a database for storing image frame information in real time according to the identification information of the guest device provided from the host device.
A computer-readable recording medium on which a program for implementing the method of any one of claims 1, 2, 3, 5, and 6 is recorded.

Images