KR20120016896A - Displaying device with three dimensional viewing function by using tilting sensor and its displaying system using the same - Google Patents

Abstract

PURPOSE: A display device with a 3D image lighting function using a slope sensor and a display system thereof are provided to three-dimensionally display a displayed product using a slope sensor on e-commerce. CONSTITUTION: A view position determining module(356) converts a slope change value into image index data. A controller(357) detects a complete operation of the view position determining module. The controller searches image index data, which is the same as image index data outputted from a view angle converting module, from a first memory. The controller extracts an image file mapped on the same image index data. The controller displays the extracted image file on the display unit.

Description

Display device with three dimensional viewing function by using tilting sensor and its displaying system using the same}

The present invention relates to a display apparatus and a display system having a three-dimensional image viewing function, and in particular, to implement a display device and a display system having a three-dimensional image viewing function using a tilt sensor, and the motion analysis system of the screen golf course Invented so that you can perform a more realistic golf practice in conjunction.

Recently, due to the rapid development of computer systems and communication networks, electronic commerce is increasingly performed online.

Electronic Commerce (EC) is a general term for commerce using information and communication technology. It exchanges all the information necessary for the trade of goods and services between companies and individuals, individuals and individuals, individuals and governments through the computer and cyber space. It means a commerce method that pays for goods.

In general, it means to trade goods and services to consumers in real time through the virtual shopping mall on the cyber.

These e-commerce enables consumers to receive products at a lower price without being constrained by time and space, and sellers of products can obtain market information or customer information from time to time, and can interact with consumers. There is such an advantage.

As a result, e-commerce using the Internet has been growing at about twice the annual rate since 1997, and this trend is continuously increasing, and e-commerce is expected to expand in many areas by coping with existing commerce.

On the other hand, small sized communication equipments (hereinafter referred to as "display devices") that fit into one hand, such as mobile phones, PDAs, and smart phones, which are one of mobile communication means, are widely used, and electronic commerce is also performed through such display devices. Doing.

However, when electronic commerce is carried out through the display device, since the products displayed in the virtual shopping mall are generally displayed only on the front surface, there is a problem that the user's product search opportunities are limited.

The present invention has been made to solve such a conventional problem, and displays the goods displayed in the e-commerce through the display device in a three-dimensional (that is, three-dimensional; also known as "3D") using a tilt sensor It provides a display device and display system having a three-dimensional image viewing function using a tilt sensor that can be linked to the motion analysis system of the screen golf course, so that golfers can practice golf more realistically. There is a purpose.

A system of the present invention for achieving the above object comprises an image file consisting of three-dimensional images viewed at a non-contiguous predetermined position on a sphere with a given object in the center of a sphere and predetermined index data mapped to the image file. A management server on which an image file database is constructed; A display device including a three-dimensional image viewing circuit unit for performing a three-dimensional image viewing function in association with an image file database of the management server, and a display unit for displaying a predetermined image according to an output of the three-dimensional image viewing circuit unit; And a network communication network for performing data communication between the management server and a display device including the three-dimensional image viewing circuit.

The 3D image viewing circuit unit may include a memory in which index data mapped to an image file downloaded from the image file database is stored; A tilt sensor unit which moves together with the handheld device and outputs data corresponding to a posture of the display device; An angle conversion module for extracting an inclination value of the display apparatus from the attitude data of the display apparatus of the inclination sensor unit; Receives the inclination value output from the angle conversion module, sets the reference inclination value of the display device, extracts the inclination variation value based on the reference inclination value, and converts the inclination variation value into the image index data and outputs it. Detect the completion of the operation of the viewing positioning module and the viewing positioning module, and search the first memory to map the same image index data and the same image index data output from the viewing angle conversion module. And a controller configured to extract an image file and display the image file on the display unit.

As another example, the 3D image viewing circuit unit may further include a second memory in which a tilt value of the display apparatus extracted from the angle conversion module is stored, and the view positioning module accesses the second memory to provide two memory units. When the inclination value of the display device is stored, the reference inclination value may be set, the inclination change value may be calculated, and an index file indicating a viewing position may be extracted.

Here, the inclination sensor unit includes a two-axis acceleration sensor orthogonal to each other and an A / D converter for converting the analog signal output from the two-axis acceleration sensor to a digital signal. The output of the inclination sensor unit is proportional to the sine function value of the inclination of the two-axis acceleration sensor, and in the angle conversion module, the inclination value of the display device is extracted from the arc sine function value of the output value of the inclination sensor unit.

On the other hand, the step of extracting the image index data from the inclination value in the viewing positioning module, the step of extracting the inclination variation value of the display apparatus based on the reference inclination value, and the inclination variation value to the perspective positioning And finding index data according to the magnitude of the gradient variation value, compared to a predetermined angle preset in the module.

As described above, according to the present invention, since the up, down, left, and right side images of the object are displayed on the display unit by tilting the display device itself up, down, left, and right without using a separate input device such as a button, In e-commerce, not only can users increase the degree of freedom of product search, but also link it with a motion analysis system of a screen golf course, so that golfers can practice golf more realistically.

In addition, the present invention is not only limited to electronic commerce, it is a very useful invention, such as can be applied to all three-dimensional image display using a display device.

1 is a schematic diagram of a system for three-dimensionally displaying an image of a product or an article using a display device according to the present invention;
Fig. 2A is a diagram showing a viewing position for obtaining a three-dimensional image file used in the present invention.
FIG. 2B is a view showing in three dimensions image index data corresponding to an image in a database of a management server; FIG.
3A and 3B illustrate an image displayed according to the movement of the display apparatus.
4 is a schematic diagram of a display apparatus having a three-dimensional image viewing function according to an embodiment of the present invention.
5 is a flow chart for explaining the operation of the view positioning module according to the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 shows a schematic diagram of a system for three-dimensionally displaying an image of an object using a display device according to the invention.

The 3D image display system includes a management server 100 under the control of an administrator who operates an internet shopping mall, a display apparatus 300 having a 3D image viewing function to be described later, and a management server 100 and a display apparatus 300. It consists of a network communication network 200 to the data communication with).

In the management server 100, a three-dimensional image file database 110 of a predetermined object or product is constructed, and in response to a request of the display apparatus 300, a three-dimensional image file in the database 110 is networked. It includes a network interface 120 for outputting to the display device 300 through the communication network 200, and a control unit 130 for controlling the database 110 and the network interface 120.

The three-dimensional image file and the image index data in the database 110 are obtained using a imaginary hemisphere as shown in FIG. 2A.

The predetermined position P of the sphere is determined as (θ, ω), which is ultimately converted into index data (a, b) representing the image viewing position. Here, θ represents the angle inclined counterclockwise from the X axis to the surface (YZ plane) perpendicular to the X axis, θ has a range of 0 degrees to 90 degrees. ω represents an angle moved in a predetermined axis (Y axis) on the vertical plane of the X axis, ω has a positive value when the rotation direction is counterclockwise, and has a negative value when the clock direction is -90 degrees to It has a value in the range of 90 degrees.

To obtain a three-dimensional image file, the object or object lying in the center of the sphere is photographed at a predetermined position on the virtual hemisphere.

In the case of digital shooting, the image data is used as it is, and in the case of analog shooting, it is converted into digital data. The image file obtained here separates the range that θ can take and the range that ω can take into a plurality of areas, and includes an image of an object viewed at a predetermined position of each area. It is.

For example, in detail, when the front and up, down, left, and right side images of the product are taken, images when θ is between 0 ° and 15 °, images when θ is between 15 ° and 45 °, θ Are taken when the image is between 45 ° and 75 ° and images when θ is between 75 ° and 90 °. Also, each of these images is an image when ω is between 0 ° and 15 °, an image when between 15 ° and 45 °, an image when between 45 ° and 90 °, -90 ° to Includes images between -45 °, images between -45 ° and -15 °, and images between -15 ° and 0 °. And (0˚ to 15˚, -90˚ to -45˚) images, (0˚ to 15˚, -45˚ to -15˚) images, (0˚ to 15˚, -15˚ to 0˚ ), (0˚ to 15˚, 0˚ to 15˚) images, (0˚ to 15˚, 15˚ to 45˚) images, and (0˚ to 15˚, 45˚ to 90˚) image files As shown in FIG. 2B, the database is mapped to index data of (1,1), (1,2), (1,3), (1,4), (1,5), and (1,6), respectively. 110). And an image of (15 ° to 45 °, -90 ° to -45 °), an image of (15 ° to 45 °, -45 ° to -15 °), and (15 ° to 45 °, -15 ° to 0 °). ˚) images, (15˚ to 45˚, 0˚ to 15˚) images, (15˚ to 45˚, 15˚ to 45˚) images and (15˚ to 45˚, 45˚ to 90˚) images As shown in FIG. 2B, the database is mapped to the index data of (2,1), (2,2), (2,3), (2,4), (2,5) and (2,6), respectively. 110). Similarly, an image of (45 ° to 75 °, -90 ° to -45 °), an image of (45 ° to 75 °, -45 ° to -15 °), (45 ° to 75 °, -15 ° to 0˚), (45˚ to 75˚, 0˚ to 15˚) image, (45˚ to 75˚, 15˚ to 45˚) image and (45˚ to 75˚, 45˚ to 90˚) image 2b are mapped to index data of (3,1), (3,2), (3,3), (3,4), (3,5) and (3,6), respectively, as shown in FIG. 2B. Stored at 110, an image of (75 ° to 90 °, -90 ° to -45 °), an image of (75 ° to 90 °, -45 ° to -15 °), (75 ° to 90 °, -15 ° to 0 °), (75 ° to 90 °, 0 ° to 15 °) image, (75 ° to 90 °, 15 ° to 45 °) image and (75 ° to 90 °, 45 ° to The images are index data of (4,1), (4,2), (4,3), (4,4), (4,5) and (4,6), respectively, as shown in FIG. 2B. Mapped to and stored in the database 110. Here, θ is divided into four regions and ω is divided into six regions, but the present invention is not limited thereto and may be variously designed in consideration of the shape of an object to be displayed.

For example, suppose that a product or an object is in the shape of a cube and "a" is displayed on one surface. Degree

3a shows an image stored in the memory 110 when θ is 15 °, 45 ° and 75 °. In FIG. 3B, ω is 0 °, 45 ° and − at a predetermined θ (about 45 °). The image stored in the database 110 at 45 degrees is shown.

Meanwhile, in order to perform the 3D image viewing function according to the present invention, the display apparatus 300 displays a circuit unit 350 to perform the 3D image viewing function and a display for displaying a predetermined image according to the output of the circuit unit 350. An example of the three-dimensional image view circuit unit 350 including the unit 380 is illustrated in FIG. 4.

In FIG. 4, the 3D image viewing circuit unit 350 includes an inclination sensor unit 360 that outputs data indicating the attitude of the display device, and an inclination of the display device from the attitude data of the display device output from the inclination sensor unit 360. Receiving the inclination value output from the angle conversion module 355 and the angle conversion module 355 to extract the value, sets the reference tilt value of the display device, extracts the tilt variation value based on the reference tilt value, It includes a vista positioning module 356 for converting the variation value to the image index data and outputs.

Here, the tilt sensor unit 360 includes two-axis acceleration sensors 361a and 361b and an A / D converter 363 for converting the analog output of the two-axis acceleration sensor into a digital signal.

More specifically, the X-axis acceleration sensor 361a for measuring the acceleration according to the inclination of the X-axis direction of the display device, the Y-axis acceleration sensor 361b for measuring the acceleration according to the inclination of the display device in the Y-axis direction, X-axis Digital outputs of the analog outputs of the filters 362a and 362b, the X-axis acceleration sensor 361a and the Y-axis acceleration sensor 361b to remove noise from the outputs of the acceleration sensor 361a and the Y-axis acceleration sensor 361b. And an A / D converter 363 for conversion.

Here, the X axis refers to the vertical length axis of the object shown in FIGS. 3A and 3B, and the Y axis refers to one axis located on a plane perpendicular to the X axis.

In addition, the 3D image viewing circuit unit 350 may include a first memory 358 for storing an inclination value output from the angle conversion module 355, an operation switch 361 for instructing the operation of the inclination sensor unit 360, and management. The second memory 363 may download and store image files and index data stored in the memory 110 of the server 100. After controlling the operation switch 361 and receiving the image index data output from the view position determination module 356, the second memory 363 is accessed to read an image corresponding to the received image index data. The controller 357 may further include a control unit 357 which displays a 3D image of an object in response to a change in posture of the display device by transferring the predetermined image to the display unit 380.

In addition, the display apparatus 300 is provided with a network interface 359 for performing communication with the management server 100, downloading image data, and downloading a viewer program for displaying image data (see FIG. 1). ).

Meanwhile, the 3D image viewing circuit unit 350 of the display apparatus 300 illustrated in FIG. 4 illustrates a case where all of the 3D image files in the database 110 are downloaded from the management server 100. However, the present invention is not limited thereto, and the 3D image viewing circuit unit 350 may configure the management server 100 to request only a specific image file and download only a part of the 3D image file in the database 110 in response thereto. It may be.

Look at the behavior. When the operation switch 361 of the display device 300 is pressed, the X-axis acceleration sensor 361a and the Y-axis acceleration sensor 361b of the 3D image viewing circuit unit 350 operate to initialize the display device 300. The acceleration value corresponding to the position is output.

The output acceleration value is proportional to the sine function values of θ and ω representing inclinations of the X-axis acceleration sensor 361a and the Y-axis acceleration sensor 361b that move along with the display apparatus 300. The output acceleration values are input to the filters 362a and 362b to remove noise from these values.

The output values of the X-axis acceleration sensor 361a and the Y-axis acceleration sensor 361b are output as digital signals through the A / D converter 363, which is then input to the angle conversion module 355. In the angle conversion module 355, the inclination value of the display apparatus 300 is extracted from the output digital signal.

In more detail, θ and ω representing inclination values of the display apparatus 300 may be obtained from arcsin of the output values of the acceleration sensors output in the form of digital signals via the A / D converter 363. have.

Next, the inclination value of the display device output from the angle conversion module 355 is represented by (θ, ω) and stored in the first memory 358.

Here, the inclination value stored immediately after the operation of the operation switch 361 (the first time) is set to the reference inclination values θ ref and ω ref.

When the user moves the display apparatus 300 in a desired direction, the user also inclines the X-axis acceleration sensor 361a and the Y-axis acceleration sensor 361b mounted therein, so that the acceleration value corresponding to the predetermined tilt is increased. This value is digitized through the A / D converter 353 and converted by the angle conversion module 355 into the inclination value (denoted by (θ, ω)) of the display apparatus 300, and the first memory. Stored at 358.

On the other hand, the control unit 357 drives the view positioning module 356 after checking that the inclination values of two or more display devices are stored in the first memory 358 after the operation switch 361 is operated, and the view positioning module 356 ) Reads out the inclination value stored in the first memory 358, extracts the inclination value variation, and outputs image index data corresponding to the inclination variation.

Here, the change in the tilt value refers to a value obtained by subtracting the reference tilt value from the tilt value of the display device having a predetermined slope.

The controller 357 detects the start of the operation of the operation switch 361, accesses the management server 100 through the network interface 359 and the network communication network 200, and stores the memory 110 of the management server 100. ) And the image index data and the image file are stored in the second memory 363 of the display device 300.

Hereinafter, the operation of the view positioning module 356 will be described in detail with reference to FIG. 5.

When the operation instruction of the viewing positioning module 356 is received from the control unit 357 (S51), the viewing positioning module 356 accesses the first memory 358 to read out the stored (θ, ω). Pull out (S52). In the read out (θ, ω), as described above, the slope value stored immediately after the operation of the operation switch 361 is set to the reference slope values (θ ref, ω ref) as described above (S53), The amount of gradient value variation (θ var, ω var) is calculated (S54). The process of obtaining image index data (a, b) from the calculated gradient value variation is as follows.

The variation of the slope value θ var is assigned to a = 1 when 0≤θ var <15 ° (S55, S56), and a = 2 when 15˚≤θ var <45 ° (S57, S58), when 45 ° ≤θ var <75 °, a = 3 is assigned (S59, S60), and when θvar≥75 °, a = 4 (S61), and for ω var, If 90˚≤ω var <-45˚, b = 1 (S62, S63), and if -45˚≤ω var <-15˚, b = 2 (S64, S65),- When 15˚≤ω var <0˚, b = 3 is assigned (S66, S67), and when 0˚≤ω var <15˚, b = 4 (S68, S69), 15˚≤ω If var <45 °, b = 5 is assigned (S70, S71), and if ω var≥45 °, b = 6 is assigned (S72).

The controller 357 receives the image index data output from the view position positioning module 356, accesses the second memory 363, searches for the same image index data as the received image index data, and searches the searched image index data. After detecting the mapped image file, an image of the image file is displayed on the display unit 380.

For example, when the reference inclination values θ ref and ω ref are (15 ° and 0 °) and the measured tilt value of the display device is 50 ° and 10 °, then the amount of change in the tilt value ( θ var, ω var) becomes (35 °, 10 °).

This amount of tilt value variation is converted into image index data (2, 4).

The image index data (2, 4) is transmitted to the control unit 357, and the control unit 357 stores an image file mapped to the (2, 4) index data in the image file stored in the second memory 363. The detected image file is displayed on the display unit 380.

Therefore, an image of an object or a product viewed from a position corresponding to the tilt of the display apparatus 300 is displayed. In other words, the effect is similar to browsing a product in a real store.

In the present embodiment, the controller 357 confirms that the inclination value is stored in the second memory 363 and then instructs the operation of the view positioning module 356. However, the present invention is not limited thereto.

In addition, the first memory 358 is not provided independently but provided in the viewing positioning module 356, and the viewing positioning module 356 accesses the internal memory to become the reference tilt value and the initial tilt value and the subsequent tilt value. You can also retrieve the index data representing the viewing position by searching.

As described above, according to the present invention, the side images of the top, bottom, left, and right sides of the object are displayed on the display by tilting the display device itself up, down, left, and right without using a separate input device such as a button. In addition, it is possible to increase the degree of freedom of the user's product search, and if connected with the motion analysis system of the screen golf course, golfers can more realistically practice golf.

It should be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

100: management server 110: database
120: network interface 130: control unit
200: network communication network 300: display device
350: circuit portion 355: angle conversion module
356: Vista positioning module 357: Control unit
358, 363: memory 360: tilt sensor
361: switch 361a, 361b: 2-axis acceleration sensor
362a, 362b: Filter 363: A / D Converter
380: display unit

Claims (3)

A display apparatus comprising a display unit for displaying a predetermined image in accordance with the output of the three-dimensional image viewing circuit portion and the three-dimensional image viewing circuit portion,
The image file stored in the memory of the three-dimensional image view circuit unit and the image index data mapped to the image file are downloaded from the management server which communicates with the display device. It includes a three-dimensional image obtained by viewing at a predetermined predetermined position,
The three-dimensional image view circuit unit,
A tilt sensor unit which moves together with the display device and outputs data corresponding to a posture of the display device;
An angle conversion module for extracting an inclination value of the display apparatus from the attitude data of the display apparatus of the inclination sensor unit;
Receives the inclination value output from the angle conversion module, sets the reference inclination value of the display device, extracts the inclination variation value based on the reference inclination value, and converts the inclination variation value into the image index data and outputs it. Detect the completion of the operation of the viewing positioning module and the viewing positioning module, and search the first memory to retrieve the same image index data as the image index data output from the viewing angle conversion module, and to the same image index data. It includes a control unit for extracting the mapped image file to be displayed on the display unit,
The inclination sensor unit includes a two-axis acceleration sensor orthogonal to each other and an A / D converter for converting an analog signal output from the two-axis acceleration sensor into a digital signal, the output of the inclination sensor unit is the slope of the inclination of the two-axis acceleration sensor Proportional to the sine function,
The angle conversion module, the display device having a three-dimensional image viewing function using the tilt sensor, characterized in that for extracting the inclination value of the display device from the arc sine function value of the output value of the inclination sensor unit.
The method according to claim 1,
In the vista positioning module,
Extracting the image index data from the inclination value, extracting an inclination variation value of the display apparatus based on the reference inclination value, and comparing the inclination variation value with a predetermined angle preset in the viewing positioning module; The display device having a three-dimensional image viewing function using a tilt sensor, characterized in that to find the index data according to the magnitude of the tilt variation value.
In the image display system using a display device having a display unit for displaying a predetermined image,
A management server having an image file database composed of an image file consisting of three-dimensional images viewed at a non-contiguous predetermined position on a sphere with a predetermined object in the center of the sphere and predetermined index data mapped to the image file; A display device including a three-dimensional image viewing circuit unit for performing a three-dimensional image viewing function in association with an image file database of the management server, and a display unit for displaying a predetermined image according to an output of the three-dimensional image viewing circuit unit; And a network communication network for performing data communication between the management server and a display device including the three-dimensional image viewing circuit.
The three-dimensional image view circuit unit,
A memory in which index data mapped to an image file downloaded from the image file database is stored; A tilt sensor unit which moves together with the display device and outputs data corresponding to a posture of the display device; An angle conversion module for extracting an inclination value of the display apparatus from the attitude data of the display apparatus of the inclination sensor unit; Receives the inclination value output from the angle conversion module, sets the reference inclination value of the display device, extracts the inclination variation value based on the reference inclination value, and converts the inclination variation value into the image index data and outputs it. Detect the completion of the operation of the viewing positioning module and the viewing positioning module, and search the first memory to map the same image index data and the same image index data output from the viewing angle conversion module. Display system having a three-dimensional image viewing function using a tilt sensor, characterized in that it comprises a control unit for extracting an image file to be displayed on the display unit.

Images