KR101254591B1 - Apparatus and method for displaying inner image - Google Patents

Abstract

The internal image display device of the present invention is currently displaying internal image data of the input object when the first selection signal is received from the external shape extractor and the input unit for searching and extracting and displaying the external image data corresponding to the input object identifier. By including an image processing unit for converting and displaying the display image and the scale of the external image data, it is possible to provide information that can clearly recognize the organic coupling relationship between the external appearance of the input object and the internal image data regardless of the angle and size. Can be.

Description

Internal image display device and method {APPARATUS AND METHOD FOR DISPLAYING INNER IMAGE}

The present invention relates to an internal image display apparatus and method, and more particularly, to an internal image display apparatus and method capable of searching / extracting / displaying a corresponding object from an identifier of the object and displaying the internal image of the object as it is being displayed. will be.

An internal image display device mounted on a smartphone, for example, a perspective application, provides a background image of a 2D picture of an object such as a photograph of an electromagnetic plate inside a smartphone.

1 is a schematic diagram illustrating a conventional internal image display device.

Looking at it, it can be seen that the background screen outputted to the display 11 is displayed by the internal circuit of the smartphone by an internal image indicator (not shown) mounted in software on the smartphone 10.

Existing internal image display is composed only of a storage unit (not shown) for storing the image of the inside of the predetermined object fragmentally photographed.

According to such a configuration, the existing internal image display may only partially display the inside of a certain object, and when the fragmented image is called an image of one of a plurality of layers constituting the object, the image of the object may be different. The organic connection with the layers is not clear.

Therefore, the internal image of the object provided by the conventional internal image display is difficult to use as information for understanding the structure of the object. Due to this problem, the conventional internal image display device is used only as a design aspect.

An object of the present invention is to provide an internal image display apparatus and method capable of searching for, extracting, and displaying a relevant object from an identifier of the thing and displaying an internal image of the object as it is being displayed.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not intended to limit the invention to the precise forms disclosed. Other objects, which will be apparent to those skilled in the art, It will be possible.

In order to achieve the above object, the internal image display device of the present invention may include an external image extractor and an external image extractor for searching and extracting external image data corresponding to an input object identifier, and receiving the first selection signal from the input unit. And an image processing unit configured to convert the image data into a display angle and scale of the external image data currently being displayed and display the converted image data.

The display apparatus may further include an image converter configured to display the external image data by converting a display angle and a scale according to the second selection signal of the input unit.

The thing identifier may be at least one of image data of a thing photographed by a camera, a name of a thing input by voice, and a name of a thing input by text.

In addition, the internal image data may be divided into one or more steps in the extracted external image data by separating the distance between the selection part included in the first selection signal into one or more steps, and the penetrating direction of the selection part and the opposite part of the divided distance may be determined. The distance unit image data displayed on a vertical plane at, and the image processing unit may display distance unit image data of a distance selected by the first selection signal.

The internal image data may be component unit image data that can be displayed in component units forming the object, and the image processor may select the component unit based on the first selection signal.

The apparatus may further include an image receiver configured to receive the internal image data stored in an external server.

Meanwhile, the method for displaying an internal image of the present invention may include receiving an object identifier, searching for and extracting external image data corresponding to the object identifier, and requesting display of the internal image data of the displayed external image data. The method may include receiving a first selection signal and converting the internal image data of the object into a display angle and a scale of the external image data currently being displayed, when the first selection signal is received.

On the other hand, the internal image display method of the present invention can be recorded on a computer-readable recording medium as a program for execution in a computer.

As described above, the internal image display apparatus and method of the present invention convert the internal image data of the input object into a display angle and scale of the external image data currently being displayed, thereby displaying the external image and the internal image of the input object. It is possible to provide information that can clearly recognize organic coupling relationship with data regardless of angle and size.

In addition, the internal structure of the object may be provided to the user in detail by providing one or more internal image data for each object.

Therefore, according to the internal image display apparatus and method of the present invention, since the relationship between the appearance and the inside of the object can be checked at various angles and sizes, the user can be reliably provided with internal information of the object.

1 is a schematic diagram showing a conventional internal image display device.
2 is a block diagram showing an internal image display device of the present invention.
3 is a schematic diagram showing a state in which the external image data is displayed in the internal image display device of the present invention.
4 is a schematic diagram showing a state in which internal image data is displayed in the internal image display device of the present invention;
5 is a schematic diagram showing another state in which internal image data is displayed in the internal image display device of the present invention;
6 is a schematic diagram showing another state in which internal image data is displayed in the internal image display device of the present invention;
7 is a flowchart illustrating a method of displaying an internal image of the present invention.
8 is a flowchart specifically illustrating an internal image display method of the present invention.

Hereinafter, the internal image display device and method of the present invention will be described in more detail with reference to the accompanying drawings.

2 is a block diagram illustrating an internal image display device of the present invention.

When the first selection signal is received from the external image extractor 130 and the input unit 190, the internal image display apparatus illustrated in FIG. 2 receives and extracts and displays external image data corresponding to the input object identifier. An image processing unit 150 converts and displays internal image data into a display angle and scale of the external image data currently being displayed.

The apparatus may further include a storage unit (not shown) in which the external image data is stored. In this case, the storage unit may be located in an internal video display device, a system in which the internal video display device is mounted, or a server located externally.

The appearance extracting unit 130 searches for, extracts, and displays the external image data corresponding to the input object identifier from the storage unit. The display 110 may be separately provided, and the display of the external image data by the external extractor is implemented by transmitting the external image data to the display. For reference, the external image data is image data forming an external appearance of an object.

The thing identifier is data capable of specifying a thing that is targeted by the appearance extracting unit. The thing identifier may be, for example, image data of a thing photographed by a camera, a name of a thing input by voice, a name of a thing input by text, or the like. One or more of these may be entered simultaneously. In this case, the image data of the object photographed by the camera may be data of the appearance of the object, and accordingly, when the user does not know the name of the object, the user may generate the object identifier by simply photographing the object. Objects at this time may be a variety of peripheral products such as airplanes, cars, laptops, washing machines, refrigerators, computers.

The input unit 190 to which a thing identifier is input may be configured as a camera that can output image data to an external form extractor, a microphone that can output audio data, a keyboard that can output text data, a touch pad, a keypad, and the like. have.

When the object identifier is the image data, the appearance extracting unit compares the image data of the object stored in the storage unit with the object identifier and searches for the same or the closest object. The image data of the object stored in the storage unit may be so-called 3D image data capable of converting display angles and scaling. In order to compare the image data with the object identifier, the display angle and scale of the object identifier may be grasped, and the image data of the object stored in the storage may be converted into the identified display angle and scale to compare them. The conversion of the display angle and the scale of the image data of the object stored in the storage may be performed by the image converter 170.

When the thing identifier is voice data, the voice data of the thing name stored in the storage unit and the thing identifier are compared to search for the same or the closest thing. When the thing identifier is text data, the object data of the thing name stored in the storage unit is compared with the thing identifier to search for the closest or most similar thing.

The object extracted by the appearance extracting unit is appearance image data. Therefore, when the data used for the search is voice data or text data, the external image data of the object stored in the storage unit is extracted by matching with the corresponding data. If the data used for the search is the image data, the corresponding image data is the external image data.

Then, the appearance extracting unit displays the extracted appearance image data on the display, so that the user can check whether the object selected by the user is correct. On the other hand, when the thing identifier is the image data, the appearance extracting unit may convert and display the extracted appearance image data according to the display angle and scale of the image data. Such image data conversion, such as display angle conversion and scale conversion, is a function already performed by the image conversion unit 170 which will be described later. Therefore, instead of adding an image conversion function to the appearance extraction unit, image data conversion may be performed by transmitting the appearance image data extracted to the image conversion unit. In this case, the image converter may transmit the converted external image data directly to the display without transmitting the external image data.

The user who has confirmed the external image data of the object displayed on the display may check whether the external image data is correctly selected, and instruct the user to newly extract the external image data if the external image data is correctly selected. The appearance extracting unit receives such a command through the input unit to newly search and extract the appearance image data. In this process, the appearance extraction unit excludes the appearance image data previously extracted through the object identifier and performs the search and extraction.

When the external image data is correctly selected, the user may select a menu for determining whether to look inside the object, and the signal generated by the input unit by the selection of the menu becomes the first selection signal. By the first selection signal, the internal image display device displays internal image data indicating the inside of the object. This operation is performed by the image processing unit 150.

When the first selection signal is received from the input unit, the image processing unit 150 converts and displays the display angle and scale of the external image data currently displayed on the display.

In order to allow the user to recognize the organic coupling relationship between things, the user must provide internal information that matches the appearance of the object currently recognized by the user. The appearance of the object currently recognized by the user is the appearance display data of the display angle and scale displayed through the display. Therefore, it is necessary to appropriately convert and provide internal image data representing the inside of an object.

The reason why the image processing unit is needed is as follows.

First, when the object identifier is the image data, it is preferable that not only the external image data but also the internal image data are presented after being converted to the display angle and scale of the object identifier.

Next, it is because it is preferable to convert the display angle and scale of the external image data currently displayed on the display by the user's selection.

Internal image data stored in a predetermined storage unit, server, or the like cannot be stored at all display angles and scales desired by a user due to productivity problems. Accordingly, the internal image data of the basic display angle and the basic scale is stored. The display of the internal image data according to the basic display angle and the basic scale causes inconvenience to the user. Accordingly, the image processing unit may convert the internal image data of the basic display angle and the basic scale into the display angle and scale desired by the user for the convenience of the user, and the internal image data of the display angle and scale desired by the user is currently displayed. It may be estimated to be the same as the display angle and scale of the image data.

In this case, the internal image display apparatus may further include an image converter 170 for converting the display angle and scale desired by the user to display the external image data. In this process, information including the display angle and scale desired by the user is generated as the second selection signal through the input unit. That is, the image converting unit 170 may display the external image data by converting the display angle and the scale by the second selection signal of the input unit.

The internal image data may be various images as image data representing an inside of an object.

For example, the internal image data may be divided into one or more steps by dividing the distance between the selection portion included in the first selection signal and the opposite portion in one or more steps in the external image data and displayed on a plane perpendicular to the penetrating direction of the selection portion and the opposite portion. It may be distance unit image data. In this case, the image processor may display distance unit image data of a distance selected by the first selection signal.

In this case, the selection site represents the external image data, that is, the point selected by the user in the external appearance of the object. In the case of touch input using a finger, the touch center point becomes a selection portion. The opposite site represents the opposite point of the selection site in the appearance of the object. The opposite point at this time may be the opposite side symmetric to the selection portion in the object or the opposite side on the plane of the display.

On the other hand, the user may be a student (for education), a worker (for business reference), a car center, etc., the article designer, a design worker, the general public and the like.

3 is a schematic diagram illustrating a state in which external image data is displayed in the internal image display device of the present invention.

The external image data, that is, an object having an external rectangular parallelepiped shape is displayed through the display 110 at an oblique angle, and when one point of the first side surface is a selection site, two opposite parts are possible.

Firstly, the opposite point that is symmetrical with the selection part in the object may be the opposite part. The upper right figure in FIG. 3 illustrates this example. The surface that is symmetrical to the first side surface of the object is the second side surface (hatched side), and the point that is symmetrical with the selection site on the second side surface becomes the opposite portion.

Next, the opposite point on the plane of the display relative to the selection site may be the opposite site. The lower right figure in FIG. 3 illustrates this example. The opposite portion is formed on the first lower surface (hatched side) on the planar view relative to the display and at the same time as the selected portion in plan view.

The internal image data at this time may be distance unit image data representing a cut plane. In detail, the distance unit image data may be displayed on a plane perpendicular to the penetrating direction of the selection portion and the opposite portion for each divided distance by dividing the distance between the selection portion and the opposite portion in one or more steps. In this case, even if the distance-based image data is a diagram showing a cut plane, it should be displayed according to the display angle and scale of the external image data as shown in the right figure of FIGS. 4 and 5.

4 is a schematic diagram illustrating a state in which internal image data is displayed in the internal image display device of the present invention, and FIG. 5 is a schematic diagram illustrating another state in which internal image data is displayed in the internal image display device of the present invention.

4 illustrates a display state of internal image data when the opposite portion is determined as shown in the upper right in FIG. 3, and FIG. 5 illustrates a display state of internal image data when the opposite region is determined as shown in the lower right in FIG. 3. Indicates.

In the above, the configuration of displaying the distance unit image data in the state where the external image data is displayed has been described. In addition, the image processor 150 may display other internal image data while the internal image data is being displayed. In this case, the other internal image data may be distance unit image data having different division distances, or may be internal image data having different portions.

In this process, the image converting unit 170 may convert the display angle and scale of the internal image data currently being displayed. Therefore, when displaying other internal image data while the internal image data is being displayed, different internal image data is displayed according to the display angle and scale converted by the image converter. To this end, the image processor may exchange internal image data with the image converter.

In this case, the first selection signal may include information about the selection site, information about how to process the opposite site, and a separation distance.

Meanwhile, the internal image data may be component unit image data that can be displayed in component units forming an object, unlike the distance unit image data indicating a cutting plane. In this case, the image processor may select a component unit based on the first selection signal.

6 is a schematic diagram illustrating another state in which internal image data is displayed in the internal image display device of the present invention.

Objects are made up of various elements. For example, a smartphone may include a battery, a circuit board, a case, a display, and the like. At this time, each of the battery, circuit board, case, and display constituting the smartphone becomes a component. In the case of the embodiment of FIG. 6, the internal image data is the component unit image data, and the component unit image data at this time is image data representing only each component constituting the thing or other components except the corresponding component.

6 shows a smartphone in a state where the display is deleted from the smartphone. Since each thing includes various elements, the first selection signal may include information for determining which element to select, only the selected element, or an object except the selected element.

In addition to the external image data currently being displayed, other component image data may be displayed based on the component image data currently being displayed. That is, as shown in FIG. 6, the case in which the display is deleted may be additionally deleted and displayed. In this process, an image converter may be involved to convert the display angle and scale.

On the other hand, the internal image display device may be used to mix the distance unit image data and the component unit image data by the user selection.

In the above, the method of displaying the internal image data including the image processor and, in some cases, the image converter is described. At this time, the internal image data should be able to be processed in various ways such as display angle conversion, scale conversion, cutting state of some components, and only a specific component is deleted. In addition, an organic coupling relationship (at least to be able to scale the display angle) with the external image data should be shown. In order to satisfy this condition, the internal image data may be so-called three-dimensional image data (3D image data).

In the case of 3D image data, a large amount of human and temporal resources are required, and the capacity is large. Therefore, there may be a limitation in storing an internal image image of various objects in a storage unit of the internal image device. In particular, when the internal image device is installed in a portable terminal device such as a smart phone, such a limitation is inevitably increased.

Therefore, the internal image data may be stored in an external server, and in this case, the internal image display apparatus may further include an image receiver 120 that receives internal image data from the server. At this time, the image receiving unit may also have a function of transmitting a signal requesting to transmit internal image data to an external server.

When the external server receives a signal for requesting the internal image data from the internal image display device, the external server may check whether there is a right to receive the corresponding internal image data and limit the transmission according to the authority. The authority at this time may be determined by whether or not to pay for the internal image data. That is, if the charging is in the state, it is determined that the authority is authorized, and the corresponding internal image data may be transmitted to the internal image display apparatus in response to the request signal. If charging is not made, it may be determined that the user is not authorized and the charging guide information may be transmitted instead of the internal image data.

An implementation process of the internal image display system using the internal image display device may be as follows.

When the user inputs a thing identifier, the internal video display device displays external image data stored in an external server or its own storage for free. When a signal for requesting internal image data for the external image data is input through the input unit, the internal image data is transmitted to an external server. In this case, the request signal may include an identifier of a user or an internal video display device for checking the authority.

The external server analyzes the request signal to check whether the user has the authority to use the internal image data, and if there is the authority, transmits the internal image data to the internal image display device. If there is no authority, the billing guidance message is transmitted instead of the internal video data.

In the case of the external image data, it is preferable to be linked with the internal image data. Therefore, the external image data stored in the storage unit of the internal image display device itself may be previously provided by an external server.

According to the above-described internal image display device, the user may check whether the object is a desired object through the external image data of the object displayed on the display. In addition, the internal image data of the object can be checked as it is currently displayed (display angle, scale). That is, since the outside / inside of the thing is provided as reliable information, the user can more clearly understand the structure of the thing.

7 is a flowchart illustrating a method of displaying an internal image of the present invention.

The internal image display method illustrated in FIG. 7 may be described as an operation of the internal image display apparatus of FIG. 2.

First, a thing identifier is received (S510). In this operation performed by the input unit 190, the thing identifier may be image data, voice data, and text data.

Next, the external image data corresponding to the thing identifier is searched for and extracted (S520). The operation performed by the appearance extracting unit 130 may include a means for comparing the object identifier with previously stored external image data. When the thing identifier is image data, the stored external image data should be converted into a display angle and scale of the thing identifier to determine whether it matches. If the thing identifier is voice data / text data, it should be possible to compare the stored voice data / text data with the thing identifier corresponding to the previously stored external image data.

In operation S530, a first selection signal for requesting to display internal image data of the displayed external image data is received. In this operation performed by the image processor 150, the first selection signal may be generated by the input unit.

When the first selection signal is received, the input internal image data of the object is converted into a display angle and scale of the external image data currently being displayed and displayed (S540). An operation performed by the image processing unit 150 processes and displays the internal image data to match the external image data currently being displayed. In this case, the internal image data may be displayed by replacing the external image data. In this case, the internal image data displayed by replacing the external image data may be processed as the external image data at the present time. Therefore, when the user requests another internal image data, the internal image data currently displayed may be replaced with other internal image data.

In addition, the display area of the display may be divided to display external image data in one area, and internal image data may be displayed in another area.

8 is a flowchart specifically illustrating an internal image display method of the present invention.

In the internal image display method of FIG. 8, it is assumed that a user of the corresponding smartphone wants to check an internal image of the vehicle 1 that the user desires while the internal image display apparatus is installed in the smartphone.

First, the car 1 to be photographed with a camera mounted on the smartphone (S 610). In this case, the camera corresponds to the input unit, and the image data of the photographed vehicle 1 becomes the object identifier.

The appearance extracting unit converts the appearance image data of various vehicles stored in the external server or the smartphone memory into the display angle and scale of the photographed vehicle 1 and searches for comparison. The search result of the matched or closest car is determined as the car 1 and displayed on the display (S620).

The user may check whether the displayed vehicle is the vehicle 1 and instruct the user to perform a new search / extraction / display if they do not match (S621). At this time, the search / extraction / display process may be performed by excluding the vehicle in the already displayed state.

If the displayed car coincides with the car 1, it is selected whether to display the internal image of the displayed car 1 in units of components or in units of distance (S630). In the case of component units, a first selection signal is generated including information about which component is shown and which is not represented. For the user's convenience, the menu may be sequentially deleted from the outermost component to the central component.

In the case of the distance unit, a first selection signal is generated including information on which distance unit to select (S630). For the convenience of the user, the menu may be sequentially displayed from the selection point to the opposite portion every time the menu is selected. In the case of the distance unit, distance unit image data is displayed (S 543). If it is not a distance unit, for example, it may be a case of a component unit, and in this case, the component unit image data is displayed (S541).

Meanwhile, the internal image display method of FIGS. 7 and 8 may be recorded as a program for executing in a computer on a computer-readable recording medium.

It will be understood by those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. It is therefore to be understood that the embodiments described above are to be considered in all respects only as illustrative and not restrictive. The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

The internal image of the thing may be applied to a device that matches the appearance of the currently displayed object and displays the same.

110 Display 120 Video Receiver
130 ... Extracting part 150 ... Image processing part
170.Video Converter 190 ... Input

Claims (8)

An appearance extracting unit which searches for and extracts and displays external image data corresponding to the input object identifier; And
An image processing unit converting the internal image data of the input object into a display angle and scale of the external image data currently being displayed and displaying the first selection signal from an input unit;
Including;
The internal image data may be divided into at least one step by dividing the distance between the selection part included in the first selection signal from the extracted external image data in one or more steps so as to be perpendicular to the penetrating direction of the selection part and the opposite part. Distance unit image data displayed as an image,
And the image processing unit displays distance unit image data of a distance selected by the first selection signal. The method of claim 1,
And an image converter configured to display the external image data by converting a display angle and a scale according to a second selection signal of the input unit.
The method of claim 1,
And the thing identifier is at least one of image data of a thing photographed by a camera, a name of a thing input by voice, and a name of a thing input by text.
delete delete The method according to any one of claims 1 to 3,
And an image receiver configured to receive the internal image data stored in an external server. delete delete

Images