KR102192265B1 - Videophone microphone - Google Patents

Abstract

The present invention relates to a camera image synthesis system, a videophone microphone, and an online education platform and includes: the camera image synthesis system including a camera which photographs a subject from various angles; and a synthesizing device for receiving the image captured by the camera in real time and providing a synthesized image. The videophone microphone includes: a noise prevention device for minimizing noise by analyzing the detected sound including the voice of an object and surrounding noise; and a sound absorbing device installed inside the case at the upper end. The online education platform is portable and includes: a learning terminal for online learning; and an education management server providing a synthesized image using the camera image synthesis system and a voice using the videophone microphone to a learning terminal. The present invention can provide a clear voice of the object to the user by removing ambient noise.

Description

Video phone microphone {VIDEOPHONE MICROPHONE}

The present invention relates to a video phone microphone, and more particularly, to a video phone microphone capable of providing a clear voice of an object to a learner by removing ambient noise.

Recently produced microphones can record clearer voices by increasing the clarity of sound quality, but at the same time, the clarity of sound quality is increased, and at the same time, even small noises in the surroundings are simultaneously recorded during recording.

By removing the surrounding noise from the time the object's voice is recorded using a videophone microphone, it is not necessary to remove the noise accompanying the recorded voice. As a result, it is necessary to perform the work efficiently.

Korean Patent Registration No. 10-0875942 Korean Utility Model Registration No. 20-0308077 Korean Patent Registration No. 10-1773891

An aspect of the present invention provides a microphone for a video phone capable of providing a clear voice of an object to a user by removing ambient noise.

The technical problem of the present invention is not limited to the technical problem mentioned above, and other technical problems that are not mentioned will be clearly understood by those skilled in the art from the following description.

A camera image synthesis system according to an embodiment of the present invention includes a camera for photographing a subject from various angles; And a synthesis device that receives the image captured by the camera in real time and provides a synthesized image.

A camera image synthesizing system according to another embodiment of the present invention may further include a moving device for moving around the subject by seating the camera.

The synthesizing apparatus according to an embodiment includes: a receiver configured to receive an image captured by the camera in real time; An image analysis unit for analyzing a subject included in the real-time captured image received by the receiving unit; A composite image generator for synthesizing the real-time photographed image and generating a composite image having a desired angle; A viewpoint detection unit for automatically detecting a time point at which the real-time photographed image is converted into a synthesized image; A connection image generator configured to generate a connection image that naturally connects the last frame of the real-time photographed image and the first frame of the composite image image at a viewpoint detected by the viewpoint detection unit; And an image synthesizing unit for synthesizing and providing the real-time captured image, the connection image, and the synthesized image in order.

The moving device according to an embodiment includes: a seating portion positioned at an upper end and on which the camera is seated; A fixing portion fixed to the ground and positioned to surround the subject, formed in an H-beam shape, and provided with a groove that can be fixed to the ground at a lower end, and a fixing unit used as a moving space for moving the camera; A moving part that is inserted and fixed in accordance with the upper groove and the protruding part of the fixing part, and the fixing part is movable along a longitudinal direction positioned in a form surrounding the subject; And a connection part connecting between the seating part and the moving part.

According to an embodiment of the present invention, there is provided a microphone for a video phone, comprising: a noise prevention device for minimizing noise by analyzing a detected sound including a voice of an object and surrounding noise; And a sound absorbing device installed inside the case of the upper end.

According to an exemplary embodiment, the noise prevention apparatus includes: a noise discriminating unit for classifying the voice of the object from the noise of the surrounding area by analyzing the detected sound including the voice of the object and the noise of the surrounding area; A noise analysis unit that analyzes the frequency and phase of the surrounding noise; An attenuation signal generator generating an attenuation signal having a frequency and phase opposite to the frequency and phase; And an attenuation signal radiating unit that emits the generated attenuation signal.

The sound-absorbing device according to an exemplary embodiment may analyze a noise generating place where noise is generated based on the voice of the object and move according to an angle or position of the noise generating place.

An online education platform according to an embodiment of the present invention is portable and includes a learning terminal for online learning; And evaluating the learning level input to the learning terminal to provide a problem of difficulty according to the learning level, scraping the previous problem according to the educational purpose, but extracting the importance of the previous problem and providing it to the learning terminal, and the learning Automatically analyzes the pattern of incorrect answers that occur during the learning process input to the terminal to improve the learning ability of the vulnerable area, and communicates with the learning terminal, the camera image synthesis system, and the videophone microphone to the learning terminal. It may include; an education management server that provides a synthesized image using an image synthesis system and a voice using the videophone microphone.

By removing the surrounding noise from the time of recording the voice of an object using the videophone microphone proposed by the present invention, it is not necessary to manually remove the noise accompanying the recorded voice, thereby enabling efficient work.

The effects of the present invention are not limited to the above-mentioned effects, and various effects may be included within a range apparent to those of ordinary skill in the art from the contents to be described below.

1 is a schematic diagram of a camera image synthesis system according to an embodiment of the present invention.
2 is a schematic diagram of a camera image synthesis system according to another embodiment of the present invention.
FIG. 3 is a detailed diagram illustrating a synthesizing apparatus, which is one of the configurations of the camera image synthesizing system disclosed in FIG. 1.
4 and 5 are diagrams illustrating a mobile device that is one of the configurations of the camera image synthesis system disclosed in FIG. 1.
FIG. 6 is a diagram specifically showing a configuration included in the mobile device disclosed in FIGS. 4 and 5.
7 is a diagram schematically illustrating a microphone for a video phone according to another embodiment of the present invention.
8 is a diagram schematically showing the configuration of a microphone for a video phone according to another embodiment of the present invention.
9 is a diagram illustrating a configuration of a noise prevention device, which is part of the configuration of the microphone for video phone of FIGS. 7 and 8.
10 is a diagram schematically showing a cross-sectional view of a video phone microphone according to another embodiment of the present invention.
11 is a diagram schematically illustrating an online education platform according to another embodiment of the present invention.
12 is a diagram specifically showing the configuration of an online education platform according to another embodiment of the present invention.
13 is a flowchart illustrating a method of generating a composite image by a camera image synthesis system according to an embodiment of the present invention.
14 is a flowchart illustrating a method of removing noise by a microphone for a video phone according to another embodiment of the present invention.
15 to 18 are flow charts illustrating a method of providing learning content to a learning terminal by an online education platform according to another embodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION The detailed description of the present invention to be described later refers to the accompanying drawings, which illustrate specific embodiments in which the present invention may be practiced. These embodiments are described in detail sufficient to enable a person skilled in the art to practice the present invention. It is to be understood that the various embodiments of the present invention are different from each other, but need not be mutually exclusive. For example, certain shapes, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the present invention in relation to one embodiment. In addition, it is to be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the present invention. Accordingly, the detailed description to be described below is not intended to be taken in a limiting sense, and the scope of the present invention, if properly described, is limited only by the appended claims, along with all scopes equivalent to those claimed by the claims. Like reference numerals in the drawings refer to the same or similar functions over several aspects.

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the drawings.

1 is a schematic diagram of a camera image synthesis system according to an embodiment of the present invention.

2 is a schematic diagram of a camera image synthesis system according to another embodiment of the present invention.

1 and 2, the camera image synthesis system 110 may include a camera 113 and a synthesis device 117, and a moving device 115 capable of easily moving the camera 113 It may contain more.

The camera 113 may photograph a subject from various angles, and may store an image captured in real time and transmit it to the synthesis device 117.

The synthesizing device 117 may receive an image captured by the camera 113 in real time, may generate a synthesized image by synthesizing the image received in real time, and may provide the generated synthesized image.

The moving device 115 may be mounted on the camera 113, and may be installed on the ground in a form surrounding the subject being photographed by the camera 113, and the camera 113 may move the position to take a photograph of the subject. So you can move.

FIG. 3 is a detailed diagram illustrating a synthesizing apparatus, which is one of the configurations of the camera image synthesizing system disclosed in FIG. 1.

3, the synthesizing device 117 includes a receiving unit 1171, an image analyzing unit 1173, a synthesized image generating unit 1174, a viewpoint detecting unit 1175, a connected image generating unit 1176, and an image combining unit ( 1177) may be included.

The reception unit 1171 may receive an image captured by the camera 113 in real time, and may efficiently generate a composite image by storing the received image.

The image analysis unit 1173 may analyze a subject among a subject and a background included in the real-time photographed image received by the receiving unit 1171, thereby efficiently generating a composite image of the subject.

The composite image generator 1174 may generate a composite image having an angle desired by the user by synthesizing a real-time photographed image received by the receiver 1171 and analyzed by the image analysis unit 1173.

The viewpoint detection unit 1175 may automatically detect a time point of conversion from a real-time captured image received by the reception unit 1171 and analyzed by the image analysis unit 1173 to a synthesized image.

The connection image generation unit 1176 may generate a connection image that naturally connects the last frame of the real-time photographed image and the first frame of the composite image image at a viewpoint detected by the viewpoint detection unit 1175.

The image synthesizing unit 1177 may synthesize a real-time captured image, a connected image, and a synthesized image in order, and may provide a user with an image that naturally synthesizes the image captured using the camera 113 and the synthesized image.

4 and 5 are diagrams illustrating a mobile device that is one of the configurations of the camera image synthesis system disclosed in FIG. 1.

Referring to FIG. 4, the moving device 115 may include a seating part 1151, a fixing part 1157, a moving part 1155, and a connecting part 1153.

The seating portion 1151 is located at the upper end of the moving device 115 and the camera 113 can be seated. Here, in order for the camera 113 to be seated, a fixing device such as a groove or a screw adapted to the width or width of the camera 113 may be formed.

Meanwhile, the fixing device for mounting and fixing the camera 113 is not limited to the above-described grooves or screws, but may include all devices capable of mounting and fixing the camera 113.

The fixing part 1157 may be fixed to the ground and positioned in a form surrounding the periphery of the subject, formed in the form of an H-beam, and a groove capable of being fixed to the ground may be provided at the lower end, and the camera 113 at the upper end. It can be used as a moving space for moving.

The moving part 1155 may be inserted and fixed in accordance with the upper groove of the fixing part and the protruding part, and the fixing part 1155 may be movable along the longitudinal direction in which the fixing part 1157 is positioned to surround the subject.

The connection part 1153 connects between the seating part 1151 and the moving part 1155 and may be formed in a shape that extends long in the vertical direction, and the seating part 1151 and the moving part 1155 support and support each other. I can do it.

Referring to FIG. 5, the moving device 115 may include a seating part 1151, a fixing part 1157, a moving part 1155, an extension part 115-1.115-2, and a connection part 1153.

Here, the seating part 1151, the fixing part 1157, the moving part 1155, and the connection part 1153 are the same devices as described above with reference to FIG. 4, and thus descriptions thereof will be omitted.

The extension parts 115-1.115-2 are formed between the connection parts 1153 and can move up and down, and accordingly, the length of the camera 113 is reduced or lengthened according to the height of the subject by reducing or extending the length of the connection part 1153. Can be adjusted.

FIG. 6 is a diagram specifically showing a configuration included in the mobile device disclosed in FIGS. 4 and 5.

Referring to FIG. 6, the moving device 115 may include a control unit 1159 and a plurality of support balls 1158.

The control unit 1159 may be provided inside the upper groove of the fixing unit 1157 of the moving device 115 and may be driven under the control of the user, and the support ball 1158 is also driven according to the operation of the control unit 1159 can do.

On the other hand, the control unit 1159 may be provided with a device capable of rotational movement such as a motor, and may rotate the support ball 1158 using a device capable of rotational movement such as a motor.

The plurality of support balls 1158 may be provided in the upper groove of the fixing unit 1157 and the moving device 115 may be driven by the drive of the control unit 1158, and the plurality of support balls 1158 When one support ball starts to rotate by the drive of the control unit 1159, the plurality of support balls 1158 provided in the upper groove of the fixing unit 1157 rotate and move the moving unit 1155 I can make it.

7 is a diagram schematically illustrating a microphone for a video phone according to another embodiment of the present invention.

8 is a diagram schematically showing the configuration of a microphone for a video phone according to another embodiment of the present invention.

Referring to FIGS. 7 and 8, the microphone 170 for a video phone may include a noise prevention device 179 and a sound absorbing device 175.

The noise prevention device 179 may be located in the lower part or the center of the video phone microphone 170, and can recognize all detected sounds including the voice of the object and the surrounding noise, and analyze all sounds to make noise Can be minimized.

The sound absorbing device 175 may be installed inside the case of the upper end of the video phone microphone 170.

9 is a diagram illustrating a configuration of a noise prevention device, which is part of the configuration of the microphone for video phone of FIGS. 7 and 8.

The noise prevention device 179 may include a noise discriminating unit 1791, a noise analysis unit 1793, an attenuation signal generation unit 1795, and an attenuation signal emission unit 1797.

The noise discriminating unit 1791 can analyze all detected sounds, including the voice of the object and the surrounding noise, and can distinguish between the voice of the object and the surrounding noise, and the noise analysis unit 1793 is the noise discriminating unit 1791 ), you can analyze the frequency and phase of the surrounding noise.

The attenuation signal generation unit 1791 may generate an attenuation signal having a frequency and phase opposite to the frequency and phase of the surrounding noise analyzed by the noise analysis unit 1793, and the attenuation signal emission unit 1797 is an attenuation signal. The attenuation signal generated by the generation unit 1795 may be emitted.

10 is a diagram schematically showing a cross-sectional view of a video phone microphone to explain a method of moving a sound absorbing device, which is part of a configuration of a video phone microphone according to another embodiment of the present invention.

A rail part 173 through which the sound absorbing device 175 can move may be provided in the upper case of the video phone microphone 170.

The rail part 173 may be seated on the protruding part of the upper case of the video phone microphone 170, and in order to move the sound absorbing device 175, along the direction of the protruding part of the upper case Can move in the direction of rotation.

On the other hand, the sound absorbing device 175 can analyze the noise generation location where noise is generated based on the voice of the object carrying the video phone microphone 170, and the rail unit 173 according to the angle or position of the noise generation location. Can be moved.

11 is a diagram schematically illustrating an online education platform according to another embodiment of the present invention.

12 is a diagram specifically showing the configuration of an online education platform according to another embodiment of the present invention.

11 and 12, the online education platform 100 may include a learning terminal 190 and an education management server 150, and the education management server 150 includes a camera image synthesis system 110 and a video call. It may include a microphone 170 for.

The learning terminal 190 refers to a device such as a tablet PC that may be portable by a learner or that may be fixed and used in a specific space, and is not limited thereto, and a device capable of receiving learning by communicating with the education management server 150 Can include.

The education management server 150 may provide data that can be learned by a learner, such as a learning problem tailored to the learning level of a learner or an existing problem, to the learning terminal 190 capable of communication.

That is, the education management server 150 may evaluate the learning level of a learner inputted to the learning terminal 190, and may provide a problem of difficulty according to the evaluated learning level by using this.

In addition, the education management server 150 may scrap the existing problem according to the educational purpose of the learner, and may extract the importance of the scraped previous problem and provide it to the learning terminal 190.

The education management server 150 may automatically analyze a pattern of an incorrect answer that occurs during a learning process input to the learning terminal 190, and may improve the learning ability of a learner in a vulnerable area by using this.

The education management server 150 can communicate with the learning terminal 190, the camera image synthesis system 110, and the videophone microphone 170, and the camera image synthesis system 110 to the learning terminal 190 using this It is possible to provide a synthesized image using and a voice using the video phone microphone 170.

13 is a flowchart illustrating a method of generating a composite image by a camera image synthesis system according to an embodiment of the present invention.

The camera image synthesis system 110 can capture a subject in real time from multiple angles using the camera 113 (S1000), and sequentially combine the photographed images taken in real time from multiple angles (S1100), and The shape of the subject included in the captured image may be analyzed (S1300).

After analyzing the shape of the subject, the camera image synthesizing system 110 can detect the time point at which the image from one angle is converted to the image from another angle (S1500), and the image is synthesized to the last frame of the image from one angle. A connection image for moving to may be generated (S1700).

After generating the connection image, the camera image synthesis system 110 may add the generated connection image between the last frame of the captured image at an angle and the synthesized image (S1900).

14 is a flowchart illustrating a method of removing noise by a microphone for a video phone according to another embodiment of the present invention.

The video phone microphone 170 can detect a plurality of sounds collected at the top of the video phone microphone 170 (S2100), and can classify the detected sound into the voice of the object (user) and the surrounding noise. (S2300).

The frequency and phase of the divided surrounding noise can be analyzed (S2500), and an attenuation signal having a phase opposite to that of the surrounding noise is generated (S2700) and radiated, but it can be intensively radiated to the location where the surrounding noise occurs ( S2900).

15 to 18 are flowcharts illustrating a method of providing learning content to a learning terminal by an online education platform according to another embodiment of the present invention.

The online education platform 100 can evaluate the learning level of the learner inputted to the learning terminal 190 by the education management server 150 (S3100), and provides a problem corresponding to the difficulty according to the learning level of the learner using this It can be done (S3300).

In addition, the online education platform 100 may scrap the existing problems according to the learner's educational purpose (S4100), and may extract the scraped existing problems by listing them according to their importance (S4300).

The online education platform 100 can automatically analyze the pattern of the incorrect answer recorded in the learner's learning terminal 190 (S6100), and use this to estimate the learner's weakness (S6300), and the estimated vulnerability It is possible to present a customized problem of the domain (S6500).

On the other hand, the online education platform 100 can be grouped by learner's education level using the learner's learning terminal 190 (S5100), and provide group ranking and statistical information through the learner's learning terminal 190. Can be (S5300).

Such an online education platform including a camera image synthesis system, a camera image synthesis system, and a videophone microphone is a computer-readable recording medium implemented in the form of program instructions that can be implemented as applications or executed through various computer components. Can be written on. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination.

The program instructions recorded in the computer-readable recording medium may be specially designed and constructed for the present invention, and may be known and usable to those skilled in the computer software field.

Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, and magnetic-optical media such as floptical disks. media), and a hardware device specially configured to store and execute program instructions such as ROM, RAM, flash memory, and the like.

Examples of the program instructions include not only machine language codes such as those produced by a compiler but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform processing according to the present invention, and vice versa.

The above-described embodiments are for illustrative purposes only, and those of ordinary skill in the art to which the above-described embodiments belong can easily transform into other specific forms without changing the technical idea or essential features of the above-described embodiments. You can understand. Therefore, it should be understood that the above-described embodiments are illustrative and non-limiting in all respects. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope to be protected through the present specification is indicated by the claims to be described later rather than the detailed description, and should be interpreted as including all changes or modified forms derived from the meaning and scope of the claims and the concept of equivalents thereof. .

100: online education platform
110: camera image synthesis system
150: education management server
170: microphone for video calling
190: learning terminal

Claims (1)

In a video phone microphone that is fixed and records sound detected from the surroundings,
A noise prevention device for minimizing noise by analyzing the detected sound including the voice of the object and the surrounding noise; And
Including; a sound absorbing device installed inside the case of the upper end,
The noise prevention device,
A noise discriminating unit for classifying the voice of the object and the noise around the object by analyzing the detected sound including the voice of the object and the noise around the object;
A noise analysis unit that analyzes the frequency and phase of the surrounding noise;
An attenuation signal generator generating an attenuation signal having a frequency and phase opposite to the frequency and phase; And
Including; an attenuation signal radiating unit for emitting the generated attenuation signal,
The sound absorbing device,
Based on the voice of the object, by analyzing the noise generating place where noise is generated and moving according to the angle or position of the noise generating place,
A camera that photographs a subject from various angles; And
Including; a synthesis device for receiving the image photographed by the camera in real time and providing a synthesized image,
Further comprising a; a moving device for moving around the subject by the camera is seated,
The synthesis device,
A receiver configured to receive an image captured by the camera in real time;
An image analysis unit for analyzing a subject included in the real-time captured image received by the receiving unit;
A composite image generator for synthesizing the real-time photographed image and generating a composite image having a desired angle;
A viewpoint detection unit for automatically detecting a time point at which the real-time photographed image is converted into a synthesized image;
A connection image generator configured to generate a connection image that naturally connects the last frame of the real-time photographed image and the first frame of the synthesized image at a viewpoint detected by the viewpoint detection unit; And
Includes; an image synthesizing unit for synthesizing the real-time photographed image, the connection image, and the synthesized image in order and providing,
The moving device,
A seating portion located at the top and on which the camera is seated;
A fixing portion fixed to the ground and positioned to surround the subject, formed in an H-beam shape, and provided with a groove that can be fixed to the ground at a lower end, and a fixing unit used as a moving space for moving the camera;
A moving part that is inserted and fixed in accordance with an upper groove of the fixing part and a protruding part, and the fixing part is movable along a longitudinal direction positioned in a form surrounding the subject; And
Including, a camera image synthesis system including; a connection part connecting between the seating part and the moving part,
Portable and learning terminal for online learning; And
The learning level input to the learning terminal is evaluated to provide the problem of difficulty according to the learning level, and the existing problem is scraped according to the educational purpose, but the importance of the previous problem is extracted and provided to the learning terminal, and the learning terminal Automatically analyzes the pattern of incorrect answers that occur during the learning process inputted to and improves the learning ability of the vulnerable area, and communicates with the learning terminal, the camera image synthesis system, and the videophone microphone to transmit the camera image to the learning terminal. An education management server that provides a synthesized image using a synthesis system and a voice using the video phone microphone; including, implementing an online education platform, a video phone microphone.

Images