KR20170029723A - Video call -based servers provided Augmented Reality System and Method - Google Patents

Video call -based servers provided Augmented Reality System and Method Download PDF

Info

Publication number
KR20170029723A
KR20170029723A KR1020150126595A KR20150126595A KR20170029723A KR 20170029723 A KR20170029723 A KR 20170029723A KR 1020150126595 A KR1020150126595 A KR 1020150126595A KR 20150126595 A KR20150126595 A KR 20150126595A KR 20170029723 A KR20170029723 A KR 20170029723A
Authority
KR
South Korea
Prior art keywords
augmented reality
portable terminal
server
data
image data
Prior art date
Application number
KR1020150126595A
Other languages
Korean (ko)
Inventor
문주환
양근탁
양동호
Original Assignee
문주환
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 문주환 filed Critical 문주환
Priority to KR1020150126595A priority Critical patent/KR20170029723A/en
Publication of KR20170029723A publication Critical patent/KR20170029723A/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Telephone Function (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The present invention relates to a system and method for outputting augmented reality. The method for outputting augmented reality comprises the steps of: requesting, by a portable terminal, a video call from a server configured to provide a system for outputting augmented reality; receiving, by the server, video data acquired via a camera module included in the portable terminal of a user in response to the request; comparing the received video data with image data stored in memory of the server, acquiring information about the video data, and computing augmented reality data based on the acquired information; outputting the computed augmented reality data to a display of the portable terminal of the user. According to the present invention, computation and outputting of augmented reality data are not performed by a specific application or a client portable terminal. Accordingly, provided may be the system and method for outputting augmented reality, in which data computed and processed by a server is received via a video call with the server configured to provide a corresponding system for outputting augmented reality and is directly output to a display of a portable terminal.

Description

Technical Field [0001] The present invention relates to a video call-based server-provided Augmented Reality System and a method thereof,

The present invention relates to a video call-based server-provided augmented reality output system and a method thereof, and more particularly, to a system and method for providing a video call based server- And the server side calculates the augmented reality data through comparison between the image data and the image data stored in the memory, retransmits the augmented reality data, and outputs the augmented reality data to a display on the portable terminal of the user.

In recent years, as portable terminals have become widespread and become more and more popular, researches on how to use such portable terminals have been conducted. One of such trends is research on augmented reality, which is a result of mixing real and virtual environments .

However, as a result of such research, a variety of types and types of augmented reality systems through portable terminals have been provided, but the augmented reality systems thus provided require users to download and install applications in advance to implement the augmented reality system As augmented reality data of the system is calculated on a portable terminal, high performance is required.

Since the augmented reality data requested in a tourist, a historical site, a museum, etc. is limited, the image data expected to be requested in the corresponding area is stored in the server as image data and compared with the image data transmitted in the video call It is possible to obtain information to be used for the augmented reality system.

The present invention relates to a video call-based server-provided augmented reality output system and a method thereof, and more particularly, to a system and method for outputting augmented reality data by using a server providing a corresponding system, The present invention provides a system and a method for calculating and outputting data through a video call of a mobile terminal.

The present invention relates to a video call-based server-provided augmented reality output system and a method thereof, and more particularly, to a system and a method for outputting augmented reality data, And receiving the processed data and outputting the processed data directly to the display of the portable terminal, and a method thereof.

A portable terminal according to an embodiment of the present invention includes a portable terminal computing unit, a communication module, a camera module, and a display.

The portable terminal computing unit transmits the video call request of the user to the camera module, obtains the image data from the camera module, transmits the image data to the server through the communication module, and transmits the augmented reality data calculated by the server to the display.

The communication module is composed of a radio frequency wave transmitter, a radio frequency wave receiver, and a baseband processor. The communication module receives the image data obtained from the camera module of the portable terminal from the portable terminal operation unit, modulates the data packet into a band of a set radio frequency And transmits it to the server communication module. Receives the main wave of the augmented reality data from the server communication module, converts the received augmented reality data packet into a data packet, and transmits the data packet to the portable terminal operation unit.

A server according to an embodiment of the present invention includes a server operation unit, a communication module, and a memory.

The server operation unit receives the image data collected through the camera module from the portable terminal and compares the image data with the image data stored in the memory to calculate the augmented reality data, and transmits the augmented reality data to the portable terminal, To the communication module.

The server communication module includes a radio frequency wave transmitter, a radio frequency wave receiver, and a baseband processor. The server communication module receives the image data transmitted from the radio frequency wave transmitter of the portable terminal through a radio frequency receiver in the form of a frequency, converts the received image data, And converts the augmented reality data calculated by the server operation unit into a frequency signal and transmits the converted augmented reality data to the portable terminal through the wireless frequency transmission unit.

The memory stores image data to be used in a video call-based augmented reality output system, receives image data from the server operation unit, compares the image data with the stored image data, and stores information of image data necessary for augmented reality data calculation And transmits this information to the server operation unit again.

A server according to an embodiment of the present invention compares video data received through a video call with a portable terminal through a communication module with image data on a memory to calculate augmented reality data and transmits the augmented reality data to a portable terminal Is output to the display of the portable terminal. Therefore, the user can obtain the augmented reality data only by requesting the video call through the portable terminal to the server.

Through the system, the user can obtain the augmented reality data without installing the application or performing additional setup.

Also, the portable terminal can simply output the augmented reality data transmitted from the server through the video call to the display through the system without providing additional calculation, thereby providing the user with a platform-augmented augmented reality system in a lower level .

1 is a simplified block diagram of a portable terminal according to an embodiment of the present invention and a server implementing a video call system in communication with the portable terminal.
2 is a block diagram of a portable terminal having a communication module, a camera module, and a display according to an embodiment of the present invention.
3 is a block diagram of a server having a communication module and a memory according to an embodiment of the present invention.
4 is a flowchart illustrating a method of receiving a video call from a portable terminal according to an exemplary embodiment of the present invention and comparing the received video call with a memory of a server to calculate augmented reality data, Fig.

1 is a simplified block diagram of a portable terminal 100 according to an embodiment of the present invention and a server 200 that implements a video communication system in communication with the portable terminal 100. Referring to FIG. The portable terminal 100 includes a camera module 130 and a communication module 120. The portable terminal 100 collects images that are video call data through the camera module 130 and transmits the collected images to the server 100 through the communication module 120 send. The server 100 receives the packet of the corresponding data through the communication module 230 and proceeds with the video call with the portable terminal 100.

FIG. 2 is a block diagram of a portable terminal 100 having a communication module 120 and a camera module 130 display 140 according to an embodiment of the present invention. The portable terminal 100 includes a portable terminal A communication module 120, a camera module 130, and a display 140, as shown in FIG.

The portable terminal operation unit 110 receives image data for video communication from the camera module 130 in a packet form and transmits the image data to the portable terminal communication module baseband processing unit 123 constituting the portable terminal communication module 120 .

The portable terminal communication module 120 includes a wireless frequency wave transmitting unit 121, a radio frequency wave receiving unit 122 and a baseband processing unit 123. The portable terminal communication module 120 transmits image data obtained by interacting with the portable terminal computing unit 110 to the server 200, And transmits the augmented reality data to the portable terminal operating unit 110. The portable terminal operating unit 110 receives the augmented reality data transmitted from the server communication module transmitting unit 221 and transmits the received augmented reality data to the portable terminal operating unit 110. [

The portable communication module wireless frequency transmission unit 121 of the communication module 120 receives data to be transmitted from the baseband processing unit 123 to the server communication module receiving unit 222 of the server 200, To the band of the set radio frequency wave and transmits it.

The portable communication module wireless frequency receiver 122 receives data to be transmitted from the server communication module transmitter 221 of the server 200 to the baseband processor 123 in the form of a radio frequency band and converts the data into a data packet .

The portable terminal communication module baseband processing unit 123 of the communication module 120 transmits the image data collected from the camera module 130 in the form of packets from the portable terminal operation unit 110 in the video communication transmission step of the portable terminal of the system And converts it into a format that can be modulated into a radio frequency band from a radio frequency transmission unit and transmits the converted signal.

The camera module 130 is operated when there is a request for image data to be provided to the video call from the portable terminal operation unit 110 and interacts with the portable terminal operation unit so that photographed image data can be used for video call, Collecting and delivering.

The display 140 converts the augmented reality data transmitted from the server 200 into image data and outputs the converted augmented reality data so that the user of the portable terminal 100 can view the image to which the augmented reality data is applied.

3 is a block diagram of a server 200 having a communication module 220 and a memory 230 according to an embodiment of the present invention. The server 200 includes a server computing unit 210, a communication module 220 ), And a memory 230. [0035]

The server operation unit 210 receives the image data collected from the camera module 130 of the portable terminal 100 from the server communication module 220 and compares the received image data with the image data stored in the memory of the server 200, The augmented reality data of the data is calculated. The augmented reality data thus calculated is transmitted again to the server communication module 220 and transmitted to the portable terminal 100 through the server communication module wireless frequency transmission unit 221. [

The server communication module 220 includes a radio frequency wave transmitting unit 221, a radio frequency wave receiving unit 222 and a baseband processing unit 223. The server communication module 220 includes a communication module 120, And transmits the augmented reality data obtained from the received augmented reality data to the portable terminal communication module wireless frequency wave receiver 122 of the communication module 120 of the portable terminal 100 again.

The server communication module wireless frequency transmission unit 221 receives data to be transmitted from the baseband processing unit 123 to the portable terminal communication module receiving unit 122 of the portable terminal 100 and transmits the data packet to the wireless frequency band And transmits it.

The server communication module wireless frequency wave receiver 122 receives the data to be transmitted from the portable terminal communication module transmitter 121 of the portable terminal 100 to the baseband processor 223 in the form of a radio frequency band, And transmits it.

The baseband processing unit 223 of the server communication module 220 receives the data packet of the video data transmitted from the wireless communication unit 221 of the server communication module and transmits the data packet of the video data transmitted from the wireless communication unit 121, (210). And receives the augmented reality data packet from the server operation unit 210 and converts the augmented reality data packet into a format that can be modulated into a radio frequency band in the radio frequency wave transmission unit 221,

The memory 130 stores image data to be used in a video call-based augmented reality output system, receives image data collected from the camera module 130 of the portable terminal 100 from the server operation unit 210, Obtains image data information by comparing the image data with the stored image data, and transmits the information to the server operation unit 210 again.

4 is a flow chart illustrating a method of receiving a video call from the portable terminal 100 in the server 200 according to an embodiment of the present invention and comparing the received video data with the image data on the memory 230 of the server, FIG. 2 is a control flowchart of a server 200 that obtains information to be used, calculates an incremental reality data based on the information, converts the incremental reality data, and transmits the converted incremental reality data to the portable terminal 100. FIG.

In step S301, the server 200 is kept in a standby state for receiving a video call from the portable terminal 100. [ If the mobile communication terminal 100 receives the video call request from the server communication module radio frequency receiver 222, the system proceeds to step S302, and if not, the step S301 is maintained.

In step S303, the server operation unit 210 of the server 200 compares the image data received through the server communication module wireless frequency reception unit 222 with the image data stored in the server memory 230, Information to be used is obtained. If the received image data does not match with the image data on the server memory 230, the system continuously searches for matching image data. If the search continues, the congestion due to the loop is detected in step S303 That's right. When the information is acquired, the system proceeds to step S304.

In step S304, the system combines the received image data with the information obtained in step S303 to calculate augmented reality data.

In step S305, the server communication module radio frequency receiver 222 searches for an additional condition signal from the portable communication module wireless frequency transmitter 121. If the signal is found through the search, the server communication module proceeds to step S306, The flow advances to step S307 to skip step S306.

In step S306, the system converts the augmented reality data calculated in step S304 according to the user's request based on the condition of the user searched by the server communication module radio frequency receiver 222. [

In step S307, the server 200 transmits the augmented reality data calculated according to the control of the system to the portable communication module wireless frequency wave receiver 122, and the server side system is terminated.

100: Portable terminal
110: Portable Terminal Operation Unit
120: Portable terminal communication module
121: Portable terminal communication module Radio frequency transmitter
122: portable terminal communication module radio frequency receiver
123: Portable Terminal Communication Module Baseband Processor
130: camera module
140: Display
200: Server
210:
220: Server communication module
221: Server communication module Radio frequency transmitter
222: Server communication module Radio frequency receiver
223: Server communication module baseband processor
230: Memory

Claims (5)


A portable terminal body; And

A camera module located in the portable terminal and collecting image data for a video call;

A communication module located in the portable terminal;

And a portable terminal operating unit which is located in the portable terminal body and controls transmission of image data collected by the camera module to a server for providing an augmented reality output system through a communication module.
A server body; And

A memory for storing image data to be compared with image data for augmented reality data calculation in the server main body;

A communication module for receiving a video call request and video data through a communication module located in the server main body and transmitting the augmented reality data;

And a calculator located in the server body for receiving the received image data and comparing the image data on the memory to calculate the augmented reality data and delivering it to the communication module.
3. The method of claim 2,

A memory for storing image data to be compared with image data received from a video call to be requested by a user in order to obtain the augmented reality data and delivering the augmented reality data to the server operation unit for calculating the augmented reality data.
3. The method of claim 2,

And an arithmetic unit for receiving the image data from the memory and comparing the received image data with the image data received from the video call, and combining the information with the image data to calculate the augmented reality data.
3. The method of claim 2,

And an operation unit for receiving a user's additional condition signal for augmented reality data during video communication for providing augmented reality data from the portable terminal and reflecting the user's additional condition signal to the augmented reality data calculation.


KR1020150126595A 2015-09-07 2015-09-07 Video call -based servers provided Augmented Reality System and Method KR20170029723A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150126595A KR20170029723A (en) 2015-09-07 2015-09-07 Video call -based servers provided Augmented Reality System and Method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150126595A KR20170029723A (en) 2015-09-07 2015-09-07 Video call -based servers provided Augmented Reality System and Method

Publications (1)

Publication Number Publication Date
KR20170029723A true KR20170029723A (en) 2017-03-16

Family

ID=58497636

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150126595A KR20170029723A (en) 2015-09-07 2015-09-07 Video call -based servers provided Augmented Reality System and Method

Country Status (1)

Country Link
KR (1) KR20170029723A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106803921A (en) * 2017-03-20 2017-06-06 深圳市丰巨泰科电子有限公司 Instant audio/video communication means and device based on AR technologies
WO2019045128A1 (en) * 2017-08-29 2019-03-07 라인 가부시키가이샤 Image quality enhancement of video call

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106803921A (en) * 2017-03-20 2017-06-06 深圳市丰巨泰科电子有限公司 Instant audio/video communication means and device based on AR technologies
WO2019045128A1 (en) * 2017-08-29 2019-03-07 라인 가부시키가이샤 Image quality enhancement of video call
US11223662B2 (en) 2017-08-29 2022-01-11 Line Corporation Method, system, and non-transitory computer readable record medium for enhancing video quality of video call

Similar Documents

Publication Publication Date Title
CN108833963B (en) Method, computer device, readable storage medium and system for displaying interface picture
KR101491392B1 (en) Indirect device communication
KR101899351B1 (en) Method and apparatus for performing video communication in a mobile terminal
US9331778B2 (en) Information provision system, server system, terminal device, information provision method, and recording medium
KR102274950B1 (en) Apparatus and method for multi-network access in wireless communication system
WO2015057418A1 (en) Conversion of at least one non-stereo camera into a stereo camera
WO2015101203A1 (en) A method, a device, and a data transmission system for data transmission in a network system
CN110996117B (en) Video transcoding method and device, electronic equipment and storage medium
WO2021109872A1 (en) Http request transmission method and device
WO2022110776A1 (en) Positioning method and apparatus, electronic device, storage medium, computer program product, and computer program
JP5435067B2 (en) Communication system, information terminal, communication method and program
KR20160103918A (en) Method and apparatus for accessing network
KR20200082714A (en) Video Call-absed Augmented Reality System an Method
KR20170029723A (en) Video call -based servers provided Augmented Reality System and Method
WO2022083680A1 (en) Positioning method and related device
EP4114045A1 (en) Device positioning method and relevant apparatus
CN112398685B (en) Host equipment acceleration method, device, equipment and medium based on mobile terminal
CN112153404B (en) Code rate adjusting method, code rate detecting method, code rate adjusting device, code rate detecting device, code rate adjusting equipment and storage medium
US20120102155A1 (en) Communication method for portable terminal
CN112866222A (en) Data processing method and device and data processing device
US7949349B2 (en) Mobile communication terminal and positional information providing method
US20110004400A1 (en) Apparatus and method for providing road data in mobile communication system
CN116709417B (en) Temperature control method and related equipment
JP6815439B2 (en) A system including a terminal device and a server device for displaying a virtual object, and the server device.
CN115086200B (en) Packet loss type determining method and device, electronic equipment and storage medium