KR20190023213A - Selfie support Camera System Using AR sticker - Google Patents

Abstract

A selfie support camera system using an augmented reality (AR) sticker enables a user wearing an AR sticker to be freely photographed by a selfie camera of an image photographing unit by ignoring a designated position and a designated stage as the image photographing unit recognizes the user as an authorized person according to a recognized value after recognizing a specific QR code or a mark when the user puts an AR sticker on which the specific QR code or the mark is printed.

Description

{Selfie support Camera System Using AR sticker}

Field of the Invention [0002] The present invention relates to a camera system, and more particularly, to a self-photographing photo-supporting camera system using an AR sticker.

[0002] A recent portable terminal basically includes a camera and supports a photographing function using the camera. At the time of photographing, the user presses a key of the portable terminal or touches a button on the screen to perform camera shooting.

On the other hand, when a user touches a button on the screen at the time of shooting, he / she generally touches with a thumb, so that the hand holding the portable terminal may be shaken or the hand posture may become unstable at the time of shooting, ), Portable terminals may become more shaky.

In order to solve such a problem, Korean Patent Laid-Open No. 10-2013-0054576, "Method and apparatus for self-camera photographing" has been proposed. However, the above- , It is difficult to automatically shoot the images in a short distance, a long distance, and a long distance, and it is difficult to provide a service for processing and analyzing the images.

In addition, when the user performs self-photographing using his or her portable terminal, only a narrow range of background can be photographed even if the user uses the self-stick.

SUMMARY OF THE INVENTION The present invention has been proposed in order to solve the above-

By providing AR stickers to customers who want to use self-filming and self-filming videos, when a user visits an area or section, the SELF-camera recognizes the individual user's AR sticker so that the user wearing the AR sticker ignores the predetermined position and stage And a self-photographing photo-supporting camera system using an AR sticker which can be freely photographed by a self-camera.

According to an embodiment of the present invention, when a user attaches an augmented reality (AR) sticker on which a specific QR code or mark is printed, the image capturing unit recognizes the corresponding code or mark, The user wearing the AR sticker recognizes the person as an authorized person, and provides a self-photographing photo-supporting camera system using the AR sticker which can be photographed by the self-portrait camera of the image photographing unit freely ignoring the predetermined position and stage.

In the self-photographing photo-supporting camera system using the AR sticker according to the embodiment of the present invention,

When an AR sticker is provided to a customer who wants to use a self-filming and self-filming video, the SELF-I-CAMERA selects and distinguishes the user when the user visits the designated area and the section, It can be provided separately according to the theme and theme.

In addition, a user who wears the AR sticker can be freely exposed to the SELF-IR camera to ignore the predetermined position and stage, and finally receive the SELF-VIDEO and the moving image.

In addition, the image capturing is performed in the background of the indoor photographing stage in which the user is located, and the image data can be conveniently transmitted using the user's personal information.

In addition, the self-photographing camera-supported camera system 1 using the AR sticker according to the embodiment of the present invention can solve a situation in which a desired image can not be obtained at a limited angle of view, It can automatically shoot by short distance, medium distance, and long distance, send pictures by email or text in various ways via network transmission, and request the past photo data at future visits by databaseing the requested photo data. In addition, a desired photograph can be obtained by real-time driving the image capturing unit 200, which is installed in a short distance, medium or long distance, with a self-photographing image hard to obtain by the hand of the user.

1 is a block diagram of a self-photographing photo-supporting camera system 1 using an AR sticker according to an embodiment of the present invention
Fig. 2 is a layout configuration diagram of the self-photographing photo-supporting camera system 1 using the AR sticker of Fig.
Fig. 3 is a view of image data photographed by using the self-photographing photo-supporting camera system 1 using the AR sticker of Fig.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, in order to facilitate a person skilled in the art to easily carry out the technical idea of the present invention.

1 is a configuration diagram of a self-photographing photo-supporting camera system 1 using an AR sticker according to an embodiment of the present invention.

The self-photographing photo-supporting camera system 1 using the AR sticker according to the present embodiment includes only a simple structure for clearly explaining the technical idea to be proposed.

1, the self-photographing photographing support camera system 1 using an AR sticker includes a plurality of sensing units 100, a photographing unit 200, a data server 300, a portable terminal 400, .

Here, the sensing unit 100, the image sensing unit 200, and the data server 300 are configured to exchange data and control signals with each other using a wired or wireless communication scheme. That is, the self-photographing photo camera system using the AR sticker is configured to exchange data with each other using a communication environment or a communication system called M2M (machine-to-machine) communication or IoT (Internet of Things).

When the user attaches an AR (augmented reality, AR) sticker on which a specific QR code or mark is printed, the camera system recognizes the code or mark and then recognizes The user wearing the AR sticker can be freely photographed by the self-portrait camera of the image photographing section, ignoring the predetermined position and stage.

That is, when the user who wants to use the self-image and self-moving video provides the AR sticker, the user of the self-camera selects and distinguishes the user when the user visits the predetermined area and section, and the user's self- , Location, and theme.

In addition, a user who wears the AR sticker can be freely exposed to the SELF-IR camera to ignore the predetermined position and stage, and finally receive the SELF-VIDEO and the moving image.

The detailed configuration and main operation of the self-photographing photo camera system 1 using the AR sticker constructed as described above will be described below.

The sensing unit 100 is disposed in each of a plurality of indoor photographing stages STAGE and receives personal information from a user's portable terminal using an RF tagging method. In addition, the sensing unit 100 is configured to perform settlement for photographing. The sensing unit 100 is defined as a stationary terminal that transmits position information so that the user can self-photograph the background of the current indoor shooting stage STAGE.

That is, in the present embodiment, the indoor photographing stage STAGE refers to a photograph photographing place designated to photograph a photograph in the background of an exhibition, a fair, and a theme space, and each of the indoor photographing stages STAGE includes a sensing unit 100 Is installed. For example, in an exhibition or an exhibition where a plurality of booths are installed, each booth can be defined as one indoor shooting stage (STAGE).

A pressure sensor is disposed on the bottom surface of the plurality of indoor photographing stages STAGE. The sensing unit 100 senses the position of the user based on the detection result of the pressure sensor, Lt; / RTI > Therefore, the image capturing unit 200 can perform image capturing around the point where the user is located.

When the user inputs personal information of at least one of a telephone number, an e-mail address, and an account of a social network service (SNS) into the sensing unit 100 and proceeds to the settlement unit 100, (200) to support a user to take a self-shot picture while displaying a scheduled shooting image in real time on a preset background.

At this time, the image photographed by the image photographing unit 200 is transmitted to the data server 300, and the data server 300 transmits the photographed image by using the inputted personal information. That is, the data server 300 transmits the photographed pictures by using the telephone number, the e-mail address, and the social network service account.

The image photographing unit 200 is installed at a position where a photograph can be taken in the background of each indoor photographing stage STAGE.

For example, a plurality of image capturing units may be installed on the ceiling of the exhibition hall, and each image capturing unit may take charge of a plurality of indoor capturing stages. At this time, the image capturing unit 200 can operate in conjunction with the illumination installed on the ceiling. That is, the image capturing unit 200 can automatically adjust the brightness of the photographing area by controlling the brightness of the lighting installed on the ceiling, the angle of illumination of the lighting, and the like after determining the brightness of the photographing area.

In addition, when the image capturing unit 200 determines that there is an obstacle in the capturing area through the recognition of the image object, the image capturing unit 200 can automatically move to capture the entire body of the user. That is, when the image capturing unit 200 is installed in the ceiling of the exhibition hall, it is preferable that a moving rail capable of automatically moving each of the plurality of image capturing units is installed, and the image capturing unit is provided with a moving driving unit, As shown in FIG.

The photographing direction and the zoom magnification of the image capturing unit 200 are controlled according to the control of the sensing unit 100. The expected image to be captured is displayed on the display unit of the sensing unit 100 or the portable terminal 400 in real time, So that the user can easily take self-photographing photographs.

That is, the image capturing unit 200 captures an image in the background of any one indoor shooting stage STAGE among a plurality of indoor shooting stages STAGE, and stores the position information transmitted from the sensing unit 100, Takes images based on information.

Since the image includes both the moving image and the still image, the image photographing unit 200 can selectively photograph the moving image and the still image (photograph) according to the user's selection.

According to the embodiment, one image capturing unit 200 can be configured to take one indoor capturing stage STAGE, and by adjusting the photographing direction and the zoom magnification, a plurality of pre-allocated image capturing units 200 And an indoor photographing stage (STAGE) of the photographing device.

The PTZ camera may be a camera capable of adjusting PAN, TILT, and ZOOM using a motor. Therefore, the PTZ camera can be rotated at a specific angle and direction under the control of the sensing unit 100, so that the region that can be photographed can be adjusted.

The image capturing unit 200 is equipped with an emotional LED (LED) for nighttime identification and is provided with an auxiliary light source for enabling night self photographing. The image capturing unit 200 illuminates the search headlight with an indoor capturing stage to facilitate image acquisition .

The video shooting unit 200 basically selects a camera having a resolution of megapixel or higher and divides the video camera into a near, middle, and remote formats. The camera uses an IP network camera or a DSLR digital camera (zoom lens mounted type) A method of driving a zoom lens that automatically takes several pictures at different distances and a method of acquiring a single high-resolution picture with a full background, And operate it.

The image capturing unit 200 may transmit data using a wireless mesh network.

That is, when a plurality of image capturing units 200 are provided, each image capturing unit wirelessly relays data to each other to extend the data exchange limit distance with respect to the sensing unit 100, the portable terminal 400, and the data server 300 You can do it.

For reference, the image capturing unit 200 may be configured such that a microphone is disposed at an angle of 90 degrees so that a total of four microphones can collect sound in each direction. At this time, a partition wall is provided between the four microphones to help identify the sound source. The microphone is preferably a directional microphone. When the directional microphone is provided as described above, the image capturing unit 200 can sense the user's voice and sense the direction of movement in advance.

For example, when the image capturing unit 200 takes charge of capturing two stages STAGE1 and STAGE2 of the first indoor shooting stage STAGE1 and the second indoor shooting stage STAGE2,

The image capturing unit 200 can detect a sound generated when the user moves from the first indoor photographing stage STAGE1 to the second indoor photographing stage STAGE2 and can automatically photograph the moving process.

At this time, the image capturing unit 200 may detect a predetermined sound and take an image. For example, when the user says "5 seconds later," the image capturing section 200 tracks the voice direction of the user to determine the capturing direction, recognizes the voice "5 seconds later" The image can be taken after 5 seconds from one point.

Further, the image capturing unit 200 can recognize the voice command of "capturing a moving image for 5 seconds "," capturing a still image 5 times at 1 second intervals after 5 seconds " .

At this time, a voice command such as "capturing a moving image for 5 seconds" and "capturing a still image 5 times at an interval of 1 second after 5 seconds" is recognized through the sensing unit 100 and transmitted to the image capturing unit 200, The unit 200 may be configured to track only the direction of the voice.

The data server 300 stores the image data transmitted from the image capturing unit 200 and personal information of the user in a database and stores the personal information such as a telephone number, an e-mail address, a social network service account, And transmits the image data to the user. The image data may be produced in the form of an electronic album and transmitted to the user.

Accordingly, the user can self-shoot in each indoor shooting stage, and then receive a phone number, an e-mail address, and an image shot by a social network service account.

Meanwhile, the sensing unit 100 may receive user's personal information such as a telephone number, an e-mail address, a social network service account, and the like through a wireless communication method from the portable terminal 400 of the user.

In this case, the sensing unit 100 and the portable terminal 400 are configured to exchange data through a wireless communication method such as Bluetooth or NFC (Near Field Communication), so that the user simply connects the portable terminal 400 to the sensing unit 100). ≪ / RTI >

Further, when the user tags the portable terminal 400 to the sensing unit 100, a link for downloading the photographing application is displayed.

When the user installs the photo taking application on the portable terminal 400, the user can control the image taking unit 200 for a predetermined time by using the photo taking application installed on the portable terminal 400 as well as the sensing unit 100 have.

That is, the portable terminal 400 can display the image to be photographed in real time, and can transmit a control signal to the image capturing unit 200 to instruct the photographing to proceed at a specific time. In addition, the portable terminal 400 can be configured to settle an amount for capturing an image through a photographing application.

As described above, when the sensing unit 100 receives the user's personal information through the wireless communication method from the user's portable terminal 400, the sensing unit 100 or the image capturing unit 200 may transmit the captured- To the portable terminal 400 in real time.

The sensing unit 100, the image capturing unit 200, the data server 300, and the portable terminal 400 may be configured to exchange data with each other through a wireless communication method. A broadband wireless communication method such as a short-range wireless LAN method or a 3G or LTE method in which data can be transmitted quickly can be used.

Fig. 2 is a layout diagram of the self-photographing photograph supporting camera system 1 using the AR sticker of Fig.

Referring to FIG. 2, the sensing unit 100 receives personal information from a user's portable terminal using an RF tagging method. That is, the image photographing unit 200 is installed at a position where a photograph can be taken in the background of each indoor photographing stage STAGE.

The photographing direction and the zoom magnification of the image capturing unit 200 are controlled according to the control of the portable terminal 400 or the sensing unit 100. Such a predetermined image to be captured is transmitted to the display unit of the sensing unit 100 or the portable terminal 400 so that the user can easily photograph the self-photographing photograph.

That is, the image capturing unit 200 captures an image in the background of any one indoor shooting stage STAGE among a plurality of indoor shooting stages STAGE, and stores the position information transmitted from the sensing unit 100, Takes images based on information. Since the image includes both the moving image and the still image, the image photographing unit 200 can selectively photograph the moving image and the still image (photograph) according to the user's selection.

According to the embodiment, one image capturing unit 200 can be configured to take one indoor capturing stage STAGE, and by adjusting the photographing direction and the zoom magnification, a plurality of pre-allocated image capturing units 200 And an indoor photographing stage (STAGE) of the photographing device. For example, as shown in FIG. 2, a plurality of image capturing units 200 installed on a ceiling are disposed at positions capable of covering all the areas of the first to fourth stages STAGE, And then photographs the corresponding area.

The PTZ camera may be a camera capable of adjusting PAN, TILT, and ZOOM using a motor. Accordingly, the sensing unit 100 can rotate the PTZ camera at a specific angle and direction by the user's operation, so that the region that can be photographed can be adjusted.

FIG. 3 is image data photographed using the self-photographing photo-supporting camera system 1 using the AR sticker of FIG.

Referring to FIG. 3, the image capturing unit 200 may be a PTZ camera. The PTZ camera may be a camera capable of adjusting PAN, TILT, and ZOOM using a motor. Collectively. Therefore, the sensing unit 100 can rotate the PTZ camera at a specific angle and direction by the user's operation, so that the region that can be photographed can be adjusted.

The image capturing unit 200 may enlarge and photograph a user through zoom adjustment, or may enlarge a specific portion of an image after capturing the image at a high image quality, and then generate a final image. That is, it is possible to photograph the self-photographing user by enlarging or reducing the screen ratio of the photographing user in small, medium, or large form in the entire photograph. Here, a cow is a photograph in which the background is most photographed, a middle is a photograph taken in consideration of both a background and a portrait, and a stand is defined as a portrait-oriented photograph.

At this time, when the image capturing unit 200 transmits the final image to the sensing unit 100 or the portable terminal 400, the time, specific image or specific data may be inserted into the final image.

On the other hand, the data server 300 determines whether the user has visited all of the plurality of indoor shooting stages (STAGE) based on the position information, the image data, and the user's personal information,

When all the plurality of indoor shooting stages (STAGE) are visited, the information of the user is transmitted to the augmented reality game server set in advance,

When the user accesses the augmented reality game server and proceeds to play the game, the augmented reality game server can interlock the augmented reality game items around the plurality of indoor shooting stages STAGE.

At this time, the data server 300 analyzes the photographed image of the user, grasps the visiting time of each indoor photographing stage and the user's moving line, and transmits the information to the augmented reality game server. The augmented reality game server determines placement positions of the augmented reality game items based on the user's movement information transmitted from the data server 300 or the like.

Also, the image capturing unit 200 operates in any one of a self-photographing support mode and a security mode. In the self-photographing support mode, as described above, the user can take a self-photographing mode.

The administrator can switch the security mode by controlling the sensing unit 100 or switch to the security mode using the manager's portable terminal. In addition, the self-photographing support mode and the security mode can be automatically switched according to the preset time.

That is, in the security mode, the image capturing unit 200 automatically determines the photographing direction based on the object recognition of the sensed data or the image of the pressure sensor disposed on the bottom surface of the plurality of indoor photographing stages STAGE, To the data server 300 in real time.

In other words, the image photographing unit 200 basically photographs while rotating a predetermined area in up, down, left, and right directions. When sensing data of a pressure sensor disposed on the bottom surface of a plurality of indoor photographing stages STAGE is transmitted, When approaching the photographing stage (STAGE), the area is photographed intensively.

In addition, the image capturing unit 200 recognizes the captured image as an object, and when an intruder such as a person is recognized, the capturing unit 200 continuously captures the object.

At this time, when the intruder is determined through the object recognition in the security mode, the method for distinguishing the administrator or the patrol by the image capturing unit 200 may be performed as follows.

When the patrol proceeds the predetermined gesture for a predetermined time at a predetermined place, the image capturing unit 200 can be configured to recognize the patrol as an authorized person.

In addition, when the patrol wears clothes of a specific color, the image capturing unit 200 can recognize the person wearing the clothes of the color as an authorized person. At this time, it is preferable that the permitted color is set differently for each day of the week.

In addition, when the patrolman is attaching a clothes or an attachment to which a specific QR code or mark is printed, the image capturing unit 200 recognizes the code or mark and then, as the authorized person Can be recognized.

For reference, the QR code or mark attached to the patrons' clothes may be coated with an infrared reflective coating reflecting a specific infrared wavelength so that the image capturing unit 200 can recognize the object more clearly. In addition, the image capturing unit 200 may be equipped with a spectral filter that adjusts the infrared transmission wavelength. By attaching the spectroscopic filter to the image capturing unit 200, the identification of the cord and the mark coated with the infrared reflective paint can proceed more smoothly.

In addition, a spectral filter for adjusting the infrared transmission wavelength may be mounted, and a camera for photographing an infrared wavelength region and a camera for photographing a visible light region may be arranged in a pair. When a pair of cameras is allocated to each indoor shooting stage STAGE and an infrared reflective paint for reflecting a specific infrared wavelength is coated on the QR code or mark attached to the clothes of the patrol, The data server 300 can perform the object recognition operation more accurately by comparing the photographed image of the infrared region with the photographed image of the visible ray region. That is, since the spectroscopic filter is mounted on the image capturing unit 200, the identification of the code and the mark coated with the infrared reflective coating can proceed more smoothly.

In addition, when the patrol wearer wears a patrol suit coated with an infrared reflective coating material or a glove coated with an infrared reflective coating material on the hand, the image sensing unit 200 can smoothly perform recognition of the motion of the patrol.

That is, the image capturing unit 200 is preferably configured to capture both the still image and the moving image in the visible light band, the still image and the moving image in the infrared band.

The image capturing unit 200 recognizes the situation as a circumstantial condition and transmits it to the data server 300 when the object is recognized as an additional patrol holder even if the patrol is an authorized patrol. That is, by monitoring the behavior of the patrol, security reliability can be improved.

In the self-photographing photo-supporting camera system using the AR sticker according to the embodiment of the present invention,

When an AR sticker is provided to a customer who wants to use a self-filming and self-filming video, the SELF-I-CAMERA selects and distinguishes the user when the user visits the designated area and the section, It can be provided separately according to the theme and theme.

In addition, a user who wears the AR sticker can be freely exposed to the SELF-IR camera to ignore the predetermined position and stage, and finally receive the SELF-VIDEO and the moving image.

In addition, the image capturing is performed in the background of the indoor photographing stage in which the user is located, and the image data can be conveniently transmitted using the user's personal information

In addition, the self-photographing camera-supported camera system 1 using the AR sticker according to the embodiment of the present invention can solve a situation in which a desired image can not be obtained at a limited angle of view, It can automatically shoot by short distance, medium distance, and long distance, send pictures by email or text in various ways via network transmission, and request the past photo data at future visits by databaseing the requested photo data. That is, when the user requests a photograph taken in the past at the current place through the portable terminal, the corresponding photograph can be displayed on the portable terminal. In addition, a desired photograph can be obtained by real-time driving the image capturing unit 200, which is installed in a short distance, medium or long distance, with a self-photographing image hard to obtain by the hand of the user.

Thus, those skilled in the art will appreciate that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. It is therefore to be understood that the embodiments described above are to be considered in all respects only as illustrative and not restrictive. The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

100: sensing part
200:
300: data server
400: portable terminal

Claims (1)

When the user attaches an AR (augmented reality, AR) sticker on which a specific QR code or mark is printed, the image capturing unit recognizes the code or mark, recognizes it as an authorized person according to the recognized value,
The user who wears the AR sticker can be freely photographed by the self-portrait camera of the image photographing section while ignoring the predetermined position and stage.
Self-photographing photo support camera system using AR sticker.

Images