KR101726769B1

KR101726769B1 - Interactive device intergrated with web camera

Info

Publication number: KR101726769B1
Application number: KR1020150099482A
Authority: KR
Inventors: 권돌
Original assignee: 주식회사 아이에스엘코리아
Priority date: 2015-07-14
Filing date: 2015-07-14
Publication date: 2017-04-27
Also published as: KR20170008898A

Abstract

The present invention discloses an interactive apparatus. More particularly, the present invention relates to an interactive apparatus which is connected to a terminal and is integrated with a web camera used for transmitting video images or performing video communication on the web.
According to the embodiment of the present invention, not only the camera module for the web camera service but also the camera module for recognizing the user's operation and the image processing module for controlling the camera module are provided in the terminal, It is effective.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to an interactive device,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an interactive apparatus, and more particularly, to an interactive apparatus connected to a terminal for transmitting a video image on the web or integrated with a web camera used for performing a video call.

2. Description of the Related Art [0002] With the rapid development of information and communication technology (ICT), at present, a home or a company accesses the Internet using a plurality of terminals equipped with a web camera, And a remote monitoring and control system for monitoring and controlling various kinds of equipments and equipments in a remote area such as an internet simultaneous broadcasting system, an internet video conferencing system, a coast, a highway and a surveillance area, Access control systems are being developed.

1 is a diagram schematically showing an example of a conventional web camera and a communication service system using the same.

1, a conventional communication service system 1 using a web camera includes a first terminal 20 connected to a web camera 10 and a second terminal 40 located far away from the web camera 10, The web camera device 10 photographs an object to be transmitted and senses the sound of the surrounding environment to transmit the corresponding video and audio signals to the first The first terminal 20 transmits the sensed video signal and the sound signal to the second terminal 30 through the information communication network 50. [ In addition, the second terminal 30 transmits a video signal and an acoustic signal sensed by the web camera device 40 connected thereto in response to a signal from the first terminal 20. [

Although not shown, a mediation server (not shown) may be further connected between the first and second terminals 20 and 30 to relay signal transmission between the first and second terminals 20 and 30

In this configuration, a communication service is implemented between the first and second terminals 20 and 30. In particular, the web camera device 10 connected to each terminal detects and displays an image img sound (sod) A camera module 11 and a sound module 12 including a sensor for signaling, and an interface module 15.

However, the web camera device 10 according to the above-described structure only implements the function of simply transmitting the shape and sound of the object to be shot to the other terminal in the communication service system having the above-mentioned structure, and its utilization is limited.

Patent 10-2011-120671 Patent 10-2011-120670

The present invention has been devised to overcome the above-mentioned problems, and it is an object of the present invention to provide an interlactive service to a user by expanding the function of a web camera device used in a communication service system through an information communication network There is a problem in providing a web camera-integrated interactive apparatus in which utilization efficiency is increased.

In order to solve the above-mentioned problems, a web camera integrated interactive apparatus according to a preferred embodiment of the present invention includes: a first camera module for photographing a first direction and generating a first video signal; A second camera module for photographing a second direction and generating a second image signal including a movement path of infrared light in which a user operation is reflected; And an interface module for transmitting the first and second video signals to an external terminal, the web camera integrated interactive device comprising:
The first camera module may further include a speaker module for reproducing the sound signal,
The first camera module includes: a lens unit that condenses light incident from the first direction; An image sensor unit for converting the condensed light into an electric signal; And an image processor for generating the first video signal including the three primary colors based on the electric signal,
The first camera module may further include a sound module for sensing a surrounding sound to generate a sound signal,
The second camera module may include: a lens unit that condenses light incident from the first direction; A filter unit for filtering the condensed light with the infrared light; An image sensor unit for converting light passing through the filter unit into an electric signal; And an image processor for generating the second video signal based on the electrical signal,
Wherein the terminal comprises: an interface for receiving the first and second video signals; And an image processing module for selectively receiving at least one of the first and second image signals and outputting image information constituting a screen,
Wherein the image processing module comprises: an infrared ray tracing unit for tracking the movement path in the second direction corresponding to the second image signal and outputting path data corresponding thereto; And an image generation unit that generates the image information corresponding to the first image signal or to which the path data is mapped,
Wherein the terminal comprises: a display module for displaying the image information; A communication module connected to an information communication network and transmitting the first video signal to another terminal; And an external device connection module connected to the external device and transmitting the image information to the external device,
Wherein the first and second camera modules are mounted in the first and second cases respectively,
Wherein the second case is a sphere form, the first case is box-shaped, the second case is disposed on an upper portion thereof,
Wherein the first case has a depression at a predetermined depth on an upper surface thereof, the second case is seated in the depression,
The first case has a hole for receiving the latch, and the first case is coupled to the first case so as to be rotatable up and down and left and right.
Wherein the interface module is provided on a substrate to be mounted in the first case, and a cable for electrically connecting the second camera module and the interface is disposed inside the latch,
Wherein the first case and the second case have a structure in which at least one magnetic member in which attraction force acts on each other is incorporated and is coupled by a magnetic force.

delete

The web camera integrated interactive device according to the embodiment of the present invention includes a camera module for recognizing the user's operation in addition to the camera module for the web camera service and the terminal has the image processing module for controlling the camera module, Not only a service but also an interactive function such as a writing on the screen can be provided.

1 is a diagram schematically showing an example of a conventional web camera and a communication service system using the same.
2 is a diagram illustrating an overall configuration of an interactive system using a web camera-integrated interactive apparatus according to an embodiment of the present invention.
3 is a diagram showing the configuration of a web camera-integrated interactive apparatus of the present invention and a terminal connected thereto.
FIG. 4A is a perspective view showing an appearance of an integrated web camera-integrated device according to an embodiment of the present invention, and FIG. 4B is a perspective view showing an appearance of an infrared ray generator and its holder used in the interactive apparatus of FIG. 4A.
5A and 5B are cross-sectional views of the internal structure of the web camera-integrated interactive apparatus according to the embodiment of the present invention, taken along line VV 'in FIG. 4A.

Prior to the description, when an element is referred to as being "comprising" or "including" an element throughout the specification, it is to be understood that the element may be further comprised of other elements . Also, the terms " part, "" module, " and" module ", etc. in the specification mean units for processing at least one function or operation and may be implemented by hardware, software or a combination of hardware and software .

Hereinafter, a web camera-integrated interactive apparatus according to a preferred embodiment of the present invention will be described in detail.

2 is a diagram illustrating an overall configuration of an interactive system using a web camera-integrated interactive apparatus according to an embodiment of the present invention.

2, the system using the web camera-integrated interactive apparatus of the present invention includes an interactive apparatus 110 for capturing first and second directions and outputting a video signal corresponding to the first and second directions, And a beam projector 300 that forms a screen corresponding to the image information transmitted from the terminal.

The interactive apparatus 110 includes a lower case 210 having a first camera module for capturing a first direction and an upper case 220 having a second camera module for capturing a second direction, Lt; / RTI >

The first and second directions may be the same or different. The first background bg1 taken by the lower case 210 may be used as an image of a service such as a video call, The second background bg2 may be used as an image for a user to perform a writing on the screen, such as a video conference. In particular, the second background (bg2) displays a point (P1) corresponding to the user's operation in the image displayed by the projector (300), and the user uses the infrared ray generator (not shown) and the camera module in the upper case 220 detects the movement path of the point P1 and transmits it to the terminal 120 in the second background bg2 The interactive function is implemented.

Hereinafter, a configuration of a web camera-integrated interactive apparatus and a terminal connected thereto according to an embodiment of the present invention will be described with reference to the drawings.

3 is a diagram showing the configuration of a web camera-integrated interactive apparatus of the present invention and a terminal connected thereto.

Referring to FIG. 3, the communication service system 100 including the web camera integrated interactive device according to the embodiment of the present invention photographs a first direction and implements a web camera function, (Not shown) as a web camera function corresponding to the first and second video signals transmitted from the interactive apparatus 110. The interactive apparatus 110 includes an interactive device 110 that implements a function of reflecting a specific operation in real time on an image, And a terminal 120 for controlling the display of the image information reflecting the operation of the user through the connected external device.

Here, the first and second directions are set according to a user's intention. For example, the first direction may be set to the user direction for a communication service such as a video conversation, and the second direction may be set to perform an interactive function , It can be set to face the screen by a monitor or a beam projector.

In addition, if the first and second directions are set to be the same, a service such as a video conference can be provided with contents displayed on the screen according to the user's operation in accordance with communication with an external terminal.

The interactive device 110 is composed of a first camera module 111, a sound module 112, a second camera module 113, and an interface module 115, which are integrated with a web camera.

The first camera module 111 is a module for implementing a web camera function and photographs a first direction at a position where the interactive device 110 is installed and outputs a first video signal corresponding thereto. Here, the first video signal may be a signal that directly reflects the light received by the first camera module 111 by the object and the background arranged in the first direction. In order to perform such a function, the first camera module 111 includes a lens unit 1111 for condensing the light received in the first direction, and a controller 1110 for generating an electric signal corresponding to the light condensed by the lens unit 1111 An image sensor 1113 and an image processor 1115 for converting the electric signal into a first image signal that can form a screen and outputting the first image signal. The first video signal output from the video processor 1115 is transmitted to the terminal 120 through the interface module 115. [

The sound module 112 senses sounds generated in the vicinity of the interactive apparatus 110 and corresponds to a micro phone included in a conventional web camera. The sound sensed by the sound module 112 is transmitted to the terminal 120 through the interface module 115 as a sound signal.

The second camera module 113 is a module for implementing the interactive function. The second camera module 113 photographs the second direction at the position where the interactive device 110 is installed, detects the operation by the user in the area, And outputs a signal.

The second video signal may be a screen displayed on a screen or other display device arranged in the second direction, and the user's operation may indicate a screen or the like on the screen using an infrared ray generator (not shown). The second camera module 113 photographs the movement path of the infrared signal generated from the infrared ray generator and transmits the infrared ray to the terminal. In order to perform such a function, the second camera module 113 includes a lens unit 1131 for condensing the light received in the second direction, and a condenser for condensing the light condensed by the lens unit 1131 only in the infrared wavelength band An image sensor unit 1133 for generating an electric signal corresponding to the infrared signal, and a control unit 1130 for converting the electric signal into a point form moving along the moving path on the screen, And an image processing unit 1135 for performing image processing. The second video signal output from the video processor 1135 is transmitted to the terminal 120 through the interface module 115.

The image sensor units 1113 and 1133 may be an image sensor such as a complementary metal oxide semiconductor (CMOS) or a charge coupled device (CCD), and the filter unit 1132 may include an infrared band- Lt; / RTI >

According to the above structure, the interactive apparatus 110 transmits the first video signal and the sound signal to the terminal 120 in the web camera mode, and transmits the second video signal to the terminal 120 in the interactive mode. The two modes can be performed simultaneously.

The interactive device 110 may further include a separate speaker module (not shown) for assisting a service such as a video call. In addition to the speaker module 123 of the terminal 120, The related sound can be reproduced.

The terminal 120 receives signals from the interactive device 110 and displays a video image by implementing a web camera function and an interactive function. The terminal 120 may be a personal computer or the like.

The terminal 120 includes an interface module 121, an image processing module 122, a speaker module 123, a display module 124, an external device connection module 125 and a communication module 126.

The interface module 121 is connected to the interactive apparatus 110 and receives the first and second video signals and the sound signals. A USB (universal serial bus) can be applied as a connection method applied thereto.

The image processing module 122 converts the first and second image signals into image information to be displayed in an image format, and inputs the image information to the display module 124 or the external device connection module 125 . In order to perform this function, the image processing module includes an infrared ray tracing unit 1221 including a medium on which an interactive processing engine for tracking the movement path of infrared light included in the second image signal is recorded, And an image generation unit 1225 that constructs an image based on the movement path of the light. In particular, the infrared ray tracking unit 1221 maps the optical movement path to the coordinates on the screen displayed on the display module 124 and the external device connection module 125, And the image generating unit 1225 generates image information by reflecting the imaged travel path according to the tracked coordinates in the original image.

The speaker module 123 plays back sound signals transmitted from the interactive apparatus 110 in the form of sounds in the terminal 120.

The display module 124 displays a screen corresponding to the input image information, and may be a monitor of a personal computer. The display module 124 may include a liquid crystal display panel (LCD panel) or an organic electroluminescence panel (OLED panel).

The external device connection module 125 is connected to a beam projector (not shown) provided outside the terminal 120 in addition to the display module 124 provided in the terminal 120 and forms a screen according to the image information In particular, an image displayed on the screen reflects the movement path of the infrared ray track in the form of an image.

The communication module 126 is connected to the information communication network 150 and transmits and receives image-related data to and from the terminal 120 and a server or an external terminal (not shown).

According to this structure, the web camera-integrated interactive apparatus according to the embodiment of the present invention can realize an interactive function as a single device by reflecting not only a video communication function using a web camera but also an image corresponding to a user's operation to an image .

Hereinafter, an external structure of a web camera-integrated interactive apparatus according to an embodiment of the present invention will be described with reference to the drawings.

FIG. 4A is a perspective view showing an appearance of an integrated web camera-integrated device according to an embodiment of the present invention, and FIG. 4B is a perspective view showing an appearance of an infrared ray generator and its holder used in the interactive apparatus of FIG. 4A.

4A, a web camera-integrated interactive device 110 according to an embodiment of the present invention includes a first and a second case 210 and 220 having first and second camera modules mounted thereon, to be.

The first and second cases 210 and 220 may be made of a plastic or metal material to protect the camera module and form an appearance of the interactive apparatus 110. The first case 210 may be box-shaped, and the lens 1111 of the first camera module and the sound module 112 may be exposed on one side and a separate speaker 114 may be disposed on the first case 210 . A depression g1 is formed at an upper portion of the second case 220 to receive and engage the second case 220.

The second case 220 is provided in the depression g1 of the first case 210. [ The second case may be a sphere form and the lens 1131 of the second camera module may be disposed on one side. Particularly, the width of the depression g1 may be larger than the width of the second case 220 so that the second case 220 to be inserted can be easily rotated in the up, down, left, and right directions.

4B illustrates the structure of the infrared ray output apparatus 230 for recognizing the user's operation. The infrared ray output apparatus 230 has an electronic pen shape and includes a cylindrical body 231, a body 231 and a pen tip 235 And a cradle 236 including a pen tip 235 for emitting infrared light and a hole h1 for insertion of the pen tip 235 is formed.

A signal generator (not shown) for generating infrared light of a specific frequency by a user's operation is built in the body 231. The signal generator 231 is driven by the pressure of the pen tip 235 of the user, Thereby emitting infrared light. Accordingly, if the user performs the writing using the infrared ray output device 230 on the screen in the second direction, the interactive device tracks the movement path of the infrared ray and reflects the infrared ray on the image.

The first and second cases 210 and 220 of FIG. 4A are not fixed in the directions of the lens units 1111 and 1131, It should be designed so as to be rotatable with respect to each other so that the first and second directions can be photographed, or to be capable of adjusting the angle by the complete separation. Hereinafter, the coupling structure of the web camera-integrated interactive apparatus 110 according to the embodiment of the present invention will be described in detail with reference to the drawings.

5A and 5B are cross-sectional views of the internal structure of the web camera-integrated interactive apparatus according to the embodiment of the present invention, respectively, taken along the line V-V 'in FIG. 4A.

Referring to FIG. 5A, as an example of the coupling structure of the interactive apparatus 310 according to the embodiment of the present invention, a first camera module 111 is disposed at one side of the box-shaped first case 211 The main board 1151 on which the interface module is mounted may be disposed on the bottom surface of the first case 211. [

The first camera module 111 includes a lens portion 1111 for imaging a first direction, an image sensor portion 1113 and an image processing portion 1115 and a substrate 1117 on which the components are mounted The substrate 1117 is vertically arranged so that the lens unit 1111 is exposed to the outside and the substrate 1117 and the main substrate 1151 are electrically connected to each other by a cable 1119. [

The second case 221, on which the second camera module 113 is mounted, is inserted and coupled to the depression of the first case 211. The second camera module 113 includes a lens unit 1131, a filter unit 1132, an image sensor unit 1133 and an image processing unit 1135 for photographing in a second direction and a substrate 1137).

Particularly, the second case 221 protrudes in a downward direction to engage with the first case 211 with a predetermined length, which is formed inside the hole formed on the depression of the first case 211 The first and second cases 211 and 221 are coupled to each other in a rotatable manner while keeping the first and second cases 211 and 221 separate from each other.

The second camera module 113 is electrically connected through a cable 1139 between the board 1137 and the main board 1151 to transmit video signals to the interface, (Not shown).

In the above-described structure, there is no restriction on the angle adjustment of the second case in the left-right direction, but there is a restriction on the adjustment range in the vertical adjustment. The coupling structure of the case will be described.

5B, an interactive apparatus 410 according to another embodiment of the present invention includes a box-shaped first case 212 in which a first camera module 111 is disposed, And a second case 222 in which the second camera module 113 is disposed. The first and second cases are not physically coupled but are coupled by a magnetic member 140 .

Specifically, the first case 212 has a structure similar to that of the above-described embodiment, and the second case 222 is inserted on the concave portion of the upper surface, but no hole is formed. The second case 222 is seated on the first case 212 without the latching portion 2211 formed on the lower surface of the second case 222. The two cases 212, And are coupled to each other by a magnetic member 140 mounted inside one. Although the magnetic member 140 is disposed in the second case 222 and each case 212 and 222 is made of metal, the present invention is not limited thereto. The two cases 212 and 222 may be made of plastic The magnetic member 140 may be formed of a material, and all of the magnetic members 140 may be provided.

The first camera module 111 inside the first case 212 is electrically connected to the board 1151 in the first case 212 through the cable 1119 in the same manner as the above- The cable 1139 connected to the board 1137 of the second case 222 extends in a direction opposite to the lens portion 1131 and electrically connected to the board 1151 of the first case 212 from the outside, .

According to this structure, the web camera-integrated interactive apparatus according to the embodiment of the present invention has the effect of imaging the first and second directions and implementing the interactive function in addition to the web camera function as one device.

While a great many are described in the foregoing description, it should be construed as an example of preferred embodiments rather than limiting the scope of the invention. Accordingly, the invention is not to be determined by the embodiments described, but should be determined by equivalents to the claims and the appended claims.

110: Interactive device 120: Terminal
210: Lower case 220: Upper case
300: Beam projector P1: Point
bg1: Background 1 bg2: Background 2

Claims

A first camera module for photographing a first direction to generate a first image signal;
If the second direction is photographed and the user action
A second camera module for generating a second video signal including a reflected movement path of the infrared light; And
An interface module for transmitting the first and second video signals to an external terminal,
Wherein the web camera-integrated interactive apparatus comprises:
The first camera module includes:
Further comprising a speaker module for reproducing a sound signal,
The first camera module includes:
A lens unit for condensing light incident from the first direction;
An image sensor unit for converting the condensed light into an electric signal; And
And an image processor for generating the first video signal including the three primary colors based on the electric signal,
Lt; / RTI >
The first camera module includes:
Further comprising a sound module for sensing a surrounding sound to generate a sound signal,
Wherein the second camera module comprises:
A lens unit for condensing light incident from the second direction;
A filter unit for filtering the condensed light with the infrared light;
An image sensor unit for converting light passing through the filter unit into an electric signal; And
An image processing unit for generating the second video signal based on the electric signal,
Lt; / RTI >
The terminal comprises:
An interface for receiving the first and second video signals; And
An image processing module for selectively receiving at least one of the first and second image signals and outputting image information constituting a screen,
/ RTI >
The image processing module includes:
An infrared ray tracking unit for tracking the movement path in the second direction corresponding to the second video signal and outputting path data according to the movement path; And
An image generating unit for generating image information corresponding to the first image signal or for which the path data is mapped,
Lt; / RTI >
The terminal comprises:
A display module for displaying image information;
A communication module connected to an information communication network and transmitting the first video signal to another terminal; And
An external device connection module connected to the external device and transmitting the image information to the external device,
/ RTI >
Wherein the first and second camera modules include:
Respectively, are mounted in the first and second cases,
The second case is a sphere form,
The first case is box-shaped, the second case is disposed on the upper side,
The first case includes:
A recessed portion having a predetermined depth is formed on the upper surface, the second case is seated in the depressed portion,
The second case has a latch portion projecting downward,
Wherein the first case has a hole into which the latch is inserted, and the second case is coupled to the first case so as to be rotatable up and down and right and left,
Wherein the interface module is provided on a substrate mounted in the first case,
The latch portion
A cable for electrically connecting the second camera module and the interface is disposed inside,
The first and second cases may be formed of a metal,
A web camera-integrated interactive apparatus having a structure in which at least one magnetic member in which attraction forces act on each other is incorporated and is coupled by a magnetic force.

delete