KR20240012847A - Display device outputting metaverse based platform and controlling method of the same - Google Patents

Abstract

The present invention includes an interface unit that communicates with the outside and receives user input; A display that outputs a metaverse-based platform; and a control unit, wherein the control unit registers a product from a user and outputs a menu for the registered product within the platform, wherein the menu includes a repair menu and when the user selects the repair menu. A display device that outputs a metaverse-based platform is provided, characterized in that it connects an AS center and outputs a product in progress of repair when an AS technician within the AS center performs a repair.

Description

Display device and control method for outputting metaverse-based platform {DISPLAY DEVICE OUTPUTTING METAVERSE BASED PLATFORM AND CONTROLLING METHOD OF THE SAME}

The present invention relates to a display device and control method that outputs a metaverse-based platform.

Recently, virtual reality, augmented reality, and mixed reality technologies that apply computer graphics technology have been developed. At this time, virtual reality technology refers to a technology that uses a computer to build a virtual space that does not exist in the real world and then makes the virtual space feel like reality, while augmented reality or mixed reality technology refers to a technology that uses a computer to create a virtual space that does not exist in the real world. It refers to a technology that adds and expresses information, that is, a technology that allows real-time interaction with users by combining the real world and the virtual world.

Among these, augmented reality and mixed reality technologies are being used in conjunction with technologies in various fields (for example, broadcasting technology, medical technology, and game technology, etc.). Augmented reality technology is used in the field of broadcasting technology in cases where the weather map in front of a weathercaster giving a weather forecast on TV changes naturally, or when advertising images that do not exist in the stadium are inserted and transmitted on the screen during sports broadcasts as if they actually exist in the stadium. This is a representative example of this being grafted and utilized. In particular, these augmented reality and mixed reality technologies are being implemented and provided as various application services with the advent of smart phones.

A representative service that provides augmented reality or mixed reality to users is Meta-verse. Metaverse is a compound word of meta, meaning virtual, and universe, meaning the real world, and refers to a three-dimensional virtual world where social/economic/cultural activities similar to the real world take place. In Metaverse, daily life can be realized in the virtual world, where users create their own avatars, communicate with other users, and engage in economic activities.

Additionally, in the case of home appliances, you must visit the AS center in person to receive AS. For home appliances that cannot be taken with you, an after-sales service technician must visit your home. In addition, when applying for after-sales service, a detailed explanation of the model name, installation environment, and symptoms of the home appliance is required, but the explanation for the general public is inevitably superficial, and it is difficult for older users to find product information.

Additionally, if a failure occurs during times when the AS center is not in operation, it is difficult to determine even for simple repairs, so there is a problem of having to wait in the disabled state until after-sales service is submitted.

The present invention aims to solve the above-mentioned problems and other problems.

The purpose of the present invention is to provide a display device and control method that outputs a metaverse-based platform.

According to one aspect of the present invention, an interface unit that communicates with the outside and receives user input; A display that outputs a metaverse-based platform; and a control unit, wherein the control unit registers a product from a user and outputs a menu for the registered product within the platform, wherein the menu includes a repair menu and when the user selects the repair menu. A display device that outputs a metaverse-based platform is provided, characterized in that it connects an AS center and outputs a product in progress of repair when an AS technician within the AS center performs a repair.

The control unit outputs a chat room within the platform, invites an AS technician within the AS center to the output chat room, and when the user requests repair for the product within the chat room, the AS technician performs the repair. It is characterized by progress.

The control unit connects to the metaverse service server before inviting the AS technician and performs a preliminary inspection of the product through an artificial intelligence AS technician.

The control unit requests the user to allow inspection of the product, wherein the inspection allowance item includes at least one of the model name of the product, the installation environment of the product, and the log of the product, and the inspection allowance item of the product is It is characterized in that information about the product is transmitted to the AS technician based on the service.

The control unit is characterized in that the product in progress of repair is abstracted and output.

The menu includes an inspection menu, and the control unit connects the AS center when the user selects the inspection menu, and outputs the inspection result when the AS technician performs the inspection.

The menu includes a repair record menu, and the control unit outputs a repair record list as the user selects the repair record menu, and when the user selects a first repair record from the repair record list, the first repair record is displayed. 1 Characterized in outputting at least one of an image, video, and text corresponding to the repair record.

When outputting the image, the control unit is characterized in that it expresses the product rendering level differently depending on the user's authority.

The control unit stores a usage record for the product and compresses the stored usage record when a first period of time has elapsed from the point of storage.

When a specific event occurs, the control unit does not compress usage records before and after the specific event.

The control unit provides an AS technician mode when the AS technician accesses the platform, and the AS technician mode is characterized in that it provides a blueprint and an exploded view of the product.

The platform is characterized by including a space where products and furniture registered by the user are arranged.

The present invention includes the steps of registering a product from a user; Outputting a menu for the registered product within a metaverse-based platform, the menu including a repair menu; Connecting to an after-sales service center as the user selects the repair menu; and, when an AS technician in the AS center performs repairs, outputting a product undergoing repair.

The effects of the display device and method for outputting the metaverse-based platform according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, products registered in a home hub can be operated and managed on the metaverse.

According to at least one of the embodiments of the present invention, there is an advantage that the environment in which a product requiring AS is installed can be confirmed on the metaverse.

According to at least one of the embodiments of the present invention, there is an advantage that interior simulation is possible without measuring the length of the product when replacing furniture and home appliances.

According to at least one of the embodiments of the present invention, it is possible to suggest a guide for required space (eg, safe space) and the optimal location of products for each style.

According to at least one of the embodiments of the present invention, when a product requires repair, there is an advantage that precise inspection is possible according to the user's tolerance range.

According to at least one of the embodiments of the present invention, there is an advantage that the product can be inspected even without anyone at home.

According to at least one of the embodiments of the present invention, there is an advantage that operations similar to reality can be provided audio-visually within the home.

According to at least one of the embodiments of the present invention, there is an advantage that various products can be registered and usage logs can be analyzed comprehensively and from various angles.

According to at least one of the embodiments of the present invention, when an educational metaverse is provided, AS technicians can receive education without temporal or spatial constraints.

Further scope of applicability of the present invention will become apparent from the detailed description that follows.

However, since various changes and modifications within the spirit and scope of the present invention may be clearly understood by those skilled in the art, the detailed description and specific embodiments such as preferred embodiments of the present invention should be understood as being given only as examples.

Figure 1 is a block diagram for explaining each configuration of the display device 100 according to an embodiment of the present invention.
Figure 2 is a flowchart explaining a metaverse-based product AS method according to an embodiment of the present invention.
3A to 3C are diagrams showing a screen of a display device that outputs a metaverse-based platform according to an embodiment of the present invention.
4 to 9 are flowcharts explaining a metaverse-based product AS method according to an embodiment of the present invention.

Hereinafter, embodiments disclosed in the present specification will be described in detail with reference to the attached drawings. However, identical or similar components will be assigned the same reference numbers regardless of reference numerals, and duplicate descriptions thereof will be omitted. The suffixes “module” and “part” for components used in the following description are given or used interchangeably only for the ease of preparing the specification, and do not have distinct meanings or roles in themselves. Additionally, in describing the embodiments disclosed in this specification, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in this specification, the detailed descriptions will be omitted. In addition, the attached drawings are only for easy understanding of the embodiments disclosed in this specification, and the technical idea disclosed in this specification is not limited by the attached drawings, and all changes included in the spirit and technical scope of the present invention are not limited. , should be understood to include equivalents or substitutes.

Terms containing ordinal numbers, such as first, second, etc., may be used to describe various components, but the components are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another.

When a component is said to be "connected" or "connected" to another component, it is understood that it may be directly connected to or connected to the other component, but that other components may exist in between. It should be. On the other hand, when it is mentioned that a component is “directly connected” or “directly connected” to another component, it should be understood that there are no other components in between.

Singular expressions include plural expressions unless the context clearly dictates otherwise.

In this application, terms such as “comprise” or “have” are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more other features. It should be understood that this does not exclude in advance the possibility of the existence or addition of elements, numbers, steps, operations, components, parts, or combinations thereof.

In the case of home appliances, to receive service, you must visit the service center in person. For home appliances that cannot be taken with you, an after-sales service technician must visit your home. In addition, when applying for after-sales service, a detailed explanation of the model name, installation environment, and symptoms of the home appliance is required, but the explanation for the general public is inevitably superficial, and it is difficult for older users to find product information.

Additionally, if a failure occurs during times when the AS center is not in operation, it is difficult to determine even for simple repairs, so there is a problem of having to wait in the disabled state until after-sales service is submitted.

Similarly, if a user is using the product incorrectly on a daily basis, frequent malfunctions may occur if this is repeated, but if the user does so without realizing it, it is difficult for the user to directly recognize this.

In addition, if the AS technician is not familiar with remote repair, diagnosis can be difficult, and it is not easy for the AS technician to secure the actual product according to the number of trainees and assemble and disassemble it directly to obtain information for product repair.

In order to solve this problem, we would like to propose a display device and method for outputting the metaverse-based platform of the present invention.

Meanwhile, the display device described in this specification is, for example, an intelligent video display device that adds a computer support function to the broadcast reception function, and is faithful to the broadcast reception function while adding an Internet function, etc., such as a handwriting input device, a touch screen, or It can be equipped with a more convenient interface such as a spatial remote control. In addition, by supporting wired or wireless Internet functions, it is possible to connect to the Internet and a computer and perform functions such as email, web browsing, banking, or gaming. A standardized general-purpose OS can be used for these various functions.

Accordingly, in the display device described in the present invention, for example, various applications can be freely added or deleted on a general-purpose OS kernel, so various user-friendly functions can be performed. More specifically, the video display device may be, for example, a network TV, HBBTV, smart TV, etc., and in some cases, may also be applied to a smart phone.

Figure 1 is a block diagram for explaining each configuration of the display device 100 according to an embodiment of the present invention.

The display device 100 includes a broadcast reception unit 110, an external device interface unit 171, a network interface unit 172, a storage unit 140, a user input interface unit 173, an input unit 130, and a control unit 180. , may include a display module 150, an audio output unit 160, and/or a power supply unit 190.

The broadcast reception unit 110 may include a tuner unit 111 and a demodulation unit 112.

Meanwhile, unlike the drawing, the display device 100 includes only the external device interface unit 171 and the network interface unit 172 among the broadcast receiver 110, the external device interface unit 171, and the network interface unit 172. It is also possible to do so. That is, the display device 100 may not include the broadcast reception unit 110.

The tuner unit 111 may select a broadcast signal corresponding to a channel selected by the user or all previously stored channels among broadcast signals received through an antenna (not shown) or a cable (not shown). The tuner unit 111 can convert the selected broadcast signal into an intermediate frequency signal or a baseband video or audio signal.

For example, if the selected broadcast signal is a digital broadcast signal, the tuner unit 111 may convert it into a digital IF signal (DIF), and if the selected broadcast signal is an analog broadcast signal, it may be converted into an analog baseband video or audio signal (CVBS/SIF). That is, the tuner unit 111 can process digital broadcasting signals or analog broadcasting signals. The analog base band video or audio signal (CVBS/SIF) output from the tuner unit 111 may be directly input to the control unit 180.

Meanwhile, the tuner unit 111 can sequentially select broadcast signals of all broadcast channels stored through a channel memory function among received broadcast signals and convert them into intermediate frequency signals or baseband video or audio signals.

Meanwhile, the tuner unit 111 may be equipped with multiple tuners in order to receive broadcast signals of multiple channels. Alternatively, a single tuner that simultaneously receives broadcast signals from multiple channels is also possible.

The demodulator 112 may receive the digital IF signal (DIF) converted by the tuner unit 111 and perform a demodulation operation. The demodulator 112 may perform demodulation and channel decoding and then output a stream signal (TS). At this time, the stream signal may be a multiplexed video signal, audio signal, or data signal.

The stream signal output from the demodulator 112 may be input to the control unit 180. After performing demultiplexing and video/audio signal processing, the control unit 180 can output video through the display module 150 and audio through the audio output unit 160.

The sensing unit 120 refers to a device that detects changes within the display device 100 or external changes. For example, proximity sensor, illumination sensor, touch sensor, infrared sensor, ultrasonic sensor, optical sensor, e.g. , camera), a voice sensor (e.g., a microphone), a battery gauge, and an environmental sensor (e.g., a hygrometer, a thermometer, etc.).

The control unit 180 can check the status of the display device 100 based on the information collected by the sensing unit 120 and notify the user when a problem occurs or control it to maintain the best condition by adjusting it on its own.

In addition, the content, image quality, size, etc. of the image provided to the display module 180 can be controlled differently depending on the viewer or surrounding illumination detected by the sensing unit to provide an optimal viewing environment. As smart TVs advance, the number of functions mounted on the TV increases, and the number of sensing units 20 also increases along with it.

The input unit 130 may be provided on one side of the main body of the display device 100. For example, the input unit 130 may include a touch pad, physical buttons, etc. The input unit 130 can receive various user commands related to the operation of the display device 100 and transmit control signals corresponding to the input commands to the control unit 180.

Recently, as the size of the bezel of the display device 100 has become smaller, the number of display devices 100 in which the input unit 130 in the form of a physical button exposed to the outside has been minimized has increased. Instead, a minimal physical button is located on the back or side, and user input can be received through the remote control device 200 through a touchpad or a user input interface unit 173, which will be described later.

The storage unit 140 may store programs for processing and controlling each signal in the control unit 180, or may store processed video, audio, or data signals. For example, the storage unit 140 stores application programs designed for the purpose of performing various tasks that can be processed by the control unit 180, and selects some of the stored application programs at the request of the control unit 180. can be provided.

Programs stored in the storage unit 140 are not particularly limited as long as they can be executed by the control unit 180. The storage unit 140 may perform a function for temporarily storing video, voice, or data signals received from an external device through the external device interface unit 171. The storage unit 140 can store information about a certain broadcast channel through a channel memory function such as a channel map.

Although FIG. 1 shows an embodiment in which the storage unit 140 is provided separately from the control unit 180, the scope of the present invention is not limited thereto, and the storage unit 140 may be included in the control unit 180.

The storage unit 140 includes volatile memory (e.g., DRAM, SRAM, SDRAM, etc.), non-volatile memory (e.g., flash memory, hard disk drive (HDD), and solid state drive (Solid- It may include at least one of state drive (SSD), etc.).

The display module 150 converts the video signal, data signal, OSD signal, and control signal processed by the control unit 180 or the video signal, data signal, and control signal received from the interface unit 171 to generate a driving signal. You can. The display module 150 may include a display panel 181 having a plurality of pixels.

A plurality of pixels provided in the display panel may include RGB subpixels. Alternatively, a plurality of pixels provided in the display panel may include RGBW subpixels. The display module 150 may convert image signals, data signals, OSD signals, control signals, etc. processed by the control unit 180 to generate driving signals for a plurality of pixels.

The display module 150 can be a plasma display panel (PDP), a liquid crystal display (LCD), an organic light emitting diode (OLED), a flexible display module, etc., and can also be a three-dimensional display module (3D display). may be possible. The 3D display module 150 can be divided into a glasses-free type and a glasses type.

The display device 100 includes a display module that occupies most of the front area and a case that covers the rear side of the display module and packages the display module.

Recently, the display device 100 is a display module 150 that can be bent, such as LED (Light Emitting Diodes) or OLED (Organic Light Emitting Diodes), to implement a curved screen beyond a flat surface. can be used.

LCDs, which were mainly used in the past, received light through a backlight unit because it was difficult for the LCD to emit light on its own. The backlight unit is a device that uniformly supplies the light source and the light supplied from the light source to the liquid crystal located on the front. As the backlight unit became increasingly thinner, it was possible to implement a thin LCD, but it is difficult to implement the backlight unit using a flexible material, and when the backlight unit is bent, it is difficult to supply light uniformly to the liquid crystal, causing a problem in that the brightness of the screen changes.

On the other hand, in the case of LED or OLED, each element that makes up the pixel emits light on its own, so it can be implemented in a curved manner without using a backlight unit. In addition, since each element emits its own light, even if the positional relationship with neighboring elements changes, its own brightness is not affected, so the flexible display module 150 can be implemented using LED or OLED.

OLED (Organic Light Emitting Diode) panels appeared in earnest in the mid-2010s and are quickly replacing LCD in the small and medium-sized display market. OLED is a display made using a self-luminous phenomenon that emits light when a current flows through a fluorescent organic compound. The picture quality response speed is faster than that of LCD, so there is almost no afterimage when displaying a video.

OLED uses three types of phosphor organic compounds, including red, green, and blue, which have a self-luminous function. Electrons and positively charged particles injected from the cathode and anode are used to emit light. Since it is a light-emitting display product that utilizes the phenomenon of self-emitting light by combining within organic materials, there is no need for a backlight (halo device) that reduces color.

The LED (Light Emitting Diode) panel is a technology that uses one LED element as one pixel, and the size of the LED element can be reduced compared to the prior art, making it possible to implement a flexible display module 150. Previously, devices called LED TVs used LEDs as a light source for the backlight unit that supplied light to the LCD, but the LEDs themselves did not constitute a screen.

The display module includes a display panel, a coupling magnet located on the back of the display panel, a first power supply, and a first signal module. The display panel may include a plurality of pixels (R, G, B). A plurality of pixels (R, G, B) may be formed in each area where a plurality of data lines and a plurality of gate lines intersect. A plurality of pixels (R, G, B) may be placed or arranged in a matrix form.

For example, the plurality of pixels (R, G, B) include a red (R) subpixel, a green (Green, 'G') subpixel, and a blue (Blue, 'B') subpixel. It can be included. The plurality of pixels (R, G, B) may further include a white (hereinafter referred to as 'W') subpixel.

The side of the display module 150 that displays images may be referred to as the front or front side. When the display module 150 displays an image, the side from which the image cannot be observed may be referred to as the rear or back side.

Meanwhile, the display module 150 is composed of a touch screen and can be used as an input device in addition to an output device.

The audio output unit 160 receives the audio-processed signal from the control unit 180 and outputs it as audio.

The interface unit 170 serves as a passageway for various types of external devices connected to the display device 100. The interface unit may include a wired method of transmitting and receiving data through a cable as well as a wireless method using an antenna.

The interface unit 170 includes a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, and a port for connecting a device equipped with an identification module ( port), an audio input/output (I/O) port, a video input/output (I/O) port, and an earphone port.

An example of a wireless method may include the broadcasting receiver 110 described above, and may include not only broadcasting signals, but also mobile communication signals, short-distance communication signals, and wireless Internet signals.

The external device interface unit 171 can transmit or receive data with a connected external device. To this end, the external device interface unit 171 may include an A/V input/output unit (not shown).

The external device interface unit 171 can be connected wired/wireless to external devices such as DVD (Digital Versatile Disk), Blu ray, game device, camera, camcorder, computer (laptop), set-top box, etc. You can also perform input/output operations with external devices.

In addition, the external device interface unit 171 establishes a communication network with various remote control devices 200 to receive control signals related to the operation of the display device 100 from the remote control device 200 or to receive control signals related to the operation of the display device 100 from the remote control device 200. ) can be transmitted to the remote control device 200.

The external device interface unit 171 may include a wireless communication unit (not shown) for short-distance wireless communication with other electronic devices. Through this wireless communication unit (not shown), the external device interface unit 171 can exchange data with an adjacent mobile terminal. In particular, the external device interface unit 171 may receive device information, executing application information, application images, etc. from the mobile terminal in mirroring mode.

The network interface unit 172 may provide an interface for connecting the display device 100 to a wired/wireless network including an Internet network. For example, the network interface unit 172 may receive content or data provided by the Internet or a content provider or network operator through a network. Meanwhile, the network interface unit 172 may include a communication module (not shown) for connection to a wired/wireless network.

The external device interface unit 171 and/or the network interface unit 172 supports Wi-Fi (Wireless Fidelity), Bluetooth, Bluetooth Low Energy (BLE), Zigbee, and NFC (Near Field Communication). ), communication modules for short-range communication such as LTE (long-term evolution), LTE-A (LTE Advance), CDMA (code division multiple access), WCDMA (wideband CDMA), UMTS (universal mobile telecommunications system), WiBro ( It may include a communication module for cellular communication such as Wireless Broadband).

The user input interface unit 173 may transmit a signal input by the user to the control unit 180 or transmit a signal from the control unit 180 to the user. For example, transmitting/receiving user input signals such as power on/off, channel selection, and screen settings from the remote control device 200, or local keys such as power key, channel key, volume key, and setting value (not shown). The user input signal input from the control unit 180 is transmitted to the control unit 180, the user input signal input from the sensor unit (not shown) that senses the user's gesture is transmitted to the control unit 180, or the signal from the control unit 180 is transmitted to the control unit 180. It can be transmitted to the sensor unit.

The control unit 180 may include at least one processor, and may control the overall operation of the display device 100 using the processor included therein. Here, the processor may be a general processor such as a central processing unit (CPU). Of course, the processor may be a dedicated device such as an ASIC or another hardware-based processor.

The control unit 180 demultiplexes a stream input through the tuner unit 111, the demodulator 112, the external device interface unit 171, or the network interface unit 172, or processes the demultiplexed signals, Signals for video or audio output can be generated and output.

The image signal processed by the control unit 180 may be input to the display module 150 and displayed as an image corresponding to the image signal. Additionally, the image signal processed by the control unit 180 may be input to an external output device through the external device interface unit 171.

The voice signal processed by the control unit 180 may be output as sound to the audio output unit 160. Additionally, the voice signal processed by the control unit 180 may be input to an external output device through the external device interface unit 171. Additionally, the control unit 180 may include a demultiplexer, an image processor, etc.

In addition, the control unit 180 may control overall operations within the display device 100. For example, the control unit 180 may control the tuner unit 111 to select (tuning) a broadcast corresponding to a channel selected by the user or a previously stored channel.

Additionally, the control unit 180 can control the display device 100 by a user command or internal program input through the user input interface unit 173. Meanwhile, the control unit 180 can control the display module 150 to display an image. At this time, the image displayed on the display module 150 may be a still image or a moving image, and may be a 2D image or 3D image.

Meanwhile, the control unit 180 can cause a certain 2D object to be displayed in the image displayed on the display module 150. For example, the object may be at least one of a connected web screen (newspaper, magazine, etc.), EPG (Electronic Program Guide), various menus, widgets, icons, still images, videos, and text.

Meanwhile, the control unit 180 may modulate and/or demodulate the signal using an amplitude shift keying (ASK) method. Here, the amplitude shift keying (ASK) method may refer to a method of modulating a signal by varying the amplitude of the carrier wave according to the data value, or restoring an analog signal to a digital data value according to the amplitude of the carrier wave.

For example, the control unit 180 may modulate an image signal using an amplitude shift keying (ASK) method and transmit it through a wireless communication module.

For example, the control unit 180 may demodulate and process an image signal received through a wireless communication module using an amplitude shift keying (ASK) method.

Through this, the display device 100 can easily transmit and receive signals with other video display devices placed adjacent to it, even without using a unique identifier such as a MAC address (Media Access Control Address) or a complex communication protocol such as TCP/IP. You can.

Meanwhile, the display device 100 may further include a photographing unit (not shown). The photography unit can photograph the user. The photographing unit can be implemented with one camera, but is not limited to this, and can also be implemented with a plurality of cameras. Meanwhile, the photographing unit may be embedded in the display device 100 on the display module 150 or may be placed separately. Image information captured by the photographing unit may be input to the control unit 180.

The control unit 180 may recognize the user's location based on the image captured by the photographing unit. For example, the control unit 180 may determine the distance (z-axis coordinate) between the user and the display device 100. In addition, the control unit 180 may determine the x-axis coordinate and y-axis coordinate within the display module 150 corresponding to the user's location.

The control unit 180 may detect the user's gesture based on each or a combination of images captured from the photographing unit or signals detected from the sensor unit.

The power supply unit 190 may supply corresponding power throughout the display device 100. In particular, power is supplied to the control unit 180, which can be implemented in the form of a system on chip (SOC), the display module 150 for displaying images, and the audio output unit 160 for audio output. You can.

Specifically, the power supply unit 190 may include a converter (not shown) that converts AC power to DC power and a Dc/Dc converter (not shown) that converts the level of DC power.

Meanwhile, the power supply unit 190 receives power from the outside and serves to distribute power to each component. The power supply unit 190 may use a method of supplying AC power by directly connecting to an external power source, and may include a power supply unit 190 that includes a battery and can be used by charging.

In the former case, it is used by connecting a wired cable and is difficult to move or has a limited range of movement. In the latter case, it is free to move, but the weight and volume increase as much as the battery, and for charging, it must be connected directly to the power cable for a certain period of time or combined with a charging stand (not shown) that supplies power.

The charging stand can be connected to the TV through a terminal exposed to the outside, or the built-in battery can be charged when approached wirelessly.

The remote control device 200 may transmit user input to the user input interface unit 173. For this purpose, the remote control device 200 may use Bluetooth, Radio Frequency (RF) communication, Infrared Radiation communication, Ultra-wideband (UWB), ZigBee, etc. Additionally, the remote control device 200 may receive video, audio, or data signals output from the user input interface unit 173, and display them or output audio signals on the remote control device 200.

Meanwhile, the above-described display device 100 may be a fixed or mobile digital broadcasting receiver capable of receiving digital broadcasting.

Meanwhile, the block diagram of the display device 100 shown in FIG. 1 is only a block diagram for an embodiment of the present invention, and each component of the block diagram is integrated and added according to the specifications of the display device 100 that is actually implemented. , or may be omitted.

That is, as needed, two or more components may be combined into one component, or one component may be subdivided into two or more components. In addition, the functions performed by each block are for explaining embodiments of the present invention, and the specific operations or devices do not limit the scope of the present invention.

Hereinafter, we will look at a display device and method for outputting a metaverse-based platform based on FIGS. 2 to 9. In addition, hereinafter, the display device that outputs the metaverse-based platform may use the display device 100 described above in FIG. 1.

Figure 2 is a flowchart explaining a metaverse-based product AS method according to an embodiment of the present invention. Hereinafter, descriptions that overlap with the above-described content will be omitted.

Referring to FIG. 2, in step S210, the user can register the product in the home hub. Here, the home hub may be provided in the form of an application or program on the display device. In other words, users can register home appliances or furniture used in the house through the home hub application. For this purpose, users can use various display devices. Display devices used here may include TVs, smart phones, PCs, etc. Users can directly input product specification numbers, etc. through various display devices.

According to an embodiment of the present invention, a display device that outputs a metaverse-based platform may output the metaverse-based platform my home. Here, My Home is a metaverse-based platform that can correspond to the space where the home appliances and furniture registered by the user are placed in the user's home drawing. Here, My Home is an example name used in the present invention to refer to a metaverse-based platform, and it goes without saying that embodiments of the present invention are not affected by the name.

To configure the platform, My Home's house drawings are viewed through the Ministry of Land, Infrastructure and Transport's website and installed in 3D, and the display device that outputs the metaverse-based platform displays home appliances registered in the home hub as My Home on the metaverse. It can be displayed on the table.

At this time, since the size of the house downloaded from the Ministry of Land, Infrastructure and Transport is accurate, home appliances registered in the home hub can be placed at the exact location within the house drawing. Other furniture can be searched by model name or default shapes can be placed, and when a user registers an actual photo through My Home, the display device that outputs the metaverse-based platform displays the photos and images captured by the user's camera. Furniture shapes can be placed by recognizing images, etc.

In one embodiment of the present invention, a display device that outputs a metaverse-based platform can view or operate home appliances registered using the metaverse-based platform My Home on the metaverse. In other words, users can register home appliances through the home hub and use the metaverse world through the My Home platform linked to the home hub.

In step S220, in one embodiment of the present invention, a display device that outputs a metaverse-based platform may output a metaverse-based AS center. In other words, if a problem occurs with a registered home appliance, you can connect to the relevant AS center through the repair button within My Home.

More specifically, when the user selects a product to be repaired, the display device that outputs the metaverse-based platform can output a menu from the product to be repaired. Here, the menu may include an AS center menu, a management menu, and an analysis menu, and the AS center menu may include a repair menu, inspection menu, repair record menu, self-repair guide menu, and black box menu.

In step S230, when the user selects the AS center menu among the output menus, the display device outputting the metaverse-based platform additionally includes a repair menu, inspection menu, repair record menu, self-repair guide menu, and black box menu. Can be printed. Afterwards, the user can select the repair menu. This will be explained in detail with reference to Figure 3a.

In step S240, the display device that outputs the metaverse-based platform can be connected to the AS center. At this time, the display device that outputs the metaverse-based platform can be connected to the AS center to which the AS technician belongs through the metaverse. Likewise, AS technicians belonging to the AS center can also access the user's My Home through the metaverse.

In step S250, the display device that outputs the metaverse-based platform may output a chat room and invite users and AS technicians to the chat room. This will be explained in detail through Figure 3b.

In step S260, the user may request an AS technician to repair the product. Users can request repairs for the product from an AS technician through a chat room displayed by the display device that outputs the Metaverse-based platform. Additionally, users can request product repairs from an after-sales service technician by selecting a menu within the My Home platform.

In step S270, the AS technician may perform repairs on the product. At this time, the display device that outputs the Metaverse-based platform can virtualize the image of an AS technician repairing the product and output it on My Home, the Metaverse platform. This will be explained in detail in FIG. 3C below.

3A to 3C are diagrams showing a screen of a display device that outputs a metaverse-based platform according to an embodiment of the present invention. Hereinafter, descriptions that overlap with the above-described content will be omitted.

Figure 3a shows a screen output by the platform of a display device that outputs a metaverse-based platform.

Referring to FIG. 3A, through the above-described embodiment, a display device that outputs a metaverse-based platform can output a screen on which furniture and home appliances of the user's home are arranged. At this time, because the user has entered the specification number for the home appliance in advance, the display device that outputs the metaverse-based platform has information about the product.

In one embodiment, a display device that outputs a metaverse-based platform can hold detailed information about a refrigerator when a user registers product information about the refrigerator. At this time, the display device that outputs the metaverse-based platform can connect to the after-sales service center based on the information entered by the user and receive detailed information about the product.

For example, a display device that outputs a metaverse-based platform can check the manufacturing date of the motor included in the refrigerator based on the refrigerator's serial number entered by the user. In addition, the display device that outputs the Metaverse-based platform can calculate the time since the user actually started using the refrigerator, so it can check to what extent the motor has been used. At this time, the display device that outputs the metaverse-based platform can check the log included in the product. To this end, the display device that outputs the metaverse-based platform can be directly connected to products registered through the home hub through WiFi, etc., and if not directly connected, logs can be received through the home hub.

For another example, the display device that outputs the Metaverse-based platform can confirm the information that the motor included in another product, an air conditioner, was manufactured on February 8, 2018 and can rotate 1 million times. In addition, the display device that outputs the Metaverse-based platform is expected to have a higher load than normal because the motor included in the air conditioner has rotated 30,000 times so far, but it has rotated 30,000 times at a high temperature (temperature higher than the general standard temperature for air conditioners). can do.

At this time, the display device that outputs the metaverse-based platform can transmit the log included in the product to the server providing the metaverse platform (my home platform in the present invention) for this determination, and the metaverse platform Based on this, the decision result can be sent back to the display device that outputs the metaverse-based platform and to the AS technician at the AS center.

Additionally, in one embodiment, the display device that outputs the metaverse-based platform can directly render the interior of the house, so the installation environment of the product, such as whether the product is installed in a room or a living room, can be conveyed to the AS technician. . At this time, not only can the display device that outputs the metaverse-based platform directly provide information about the installation environment to the AS technician, but the AS technician also has the installation environment printed within the platform, so when the AS technician accesses the platform, You can directly check the installation environment of the product.

In one embodiment, a display device that outputs a metaverse-based platform may output a menu for registered products. The menu may include a repair menu, inspection menu, repair record menu, self-repair guide menu, and black box menu. The operation when the user selects each menu will be explained in detail through the drawings below.

Figure 3b shows an example in which a chat room is output within the platform of a display device that outputs a metaverse-based platform.

The following FIG. 3B assumes that the user selects the repair menu in the embodiment of FIG. 3A.

Referring to FIG. 3b, as the user selects the repair menu, the display device that outputs the metaverse-based platform can output a chat room. For this purpose, the display device that outputs the metaverse-based platform can connect to the AS center. That is, FIGS. 3A to 3C currently show an example of accessing a metaverse-based platform from the user's perspective, but an AS technician within the AS center can also view the same screen.

In one embodiment, the display device that outputs the metaverse-based platform invites a technician from the AS center to the output chat room, and when a user requests repair for a product within the chat room, the AS technician can perform the repair.

In one embodiment, a display device that outputs a metaverse-based platform can connect to the metaverse service server before inviting an AS technician and perform a preliminary inspection of the product through an artificial intelligence AS technician. More specifically, the Metaverse Service Center allows an artificial intelligence robot to quickly pre-inspect the product and then call an after-sales service technician if a detailed inspection is necessary.

In one embodiment, a display device that outputs a metaverse-based platform may request items allowing product inspection from the user. Here, the items allowed for inspection of the product may include at least one of the product model name, the product installation environment, and the product log. Accordingly, the connected AS center can access the product to the extent permitted by the user. Model name, installation environment, operation test, and log can be accessed remotely.

In one embodiment, a display device that outputs a metaverse-based platform may transmit information about a product to an after-sales service technician based on the inspection allowable items of the product. At this time, all information can be transmitted and received through the Home Hub application and My Home platform.

For example, the air conditioner's log can also be transmitted to the Metaverse platform through the home hub application where the air conditioner is registered. To this end, the products registered in the home hub and the display device that outputs the metaverse-based platform used by the user may be connected to the same WiFi. Afterwards, the AS technician can access the user's Metaverse platform through another network.

Additionally, a chat room output by a display device that outputs a metaverse-based platform may include the functions of a general chat room. In other words, users and AS technicians can communicate with each other.

Figure 3c shows an embodiment in which an AS technician repairs a product within the platform of a display device that outputs a metaverse-based platform.

In one embodiment, a display device that outputs a metaverse-based platform may abstractly output a product in progress of repair. At this time, from the user's perspective, it appears as if the AS technician enters the user's metaverse platform to repair the product, and from the AS technician's perspective, repairs are possible while being visible on the exploded view or blueprint of the product.

Referring to Figure 3c, the display device that outputs the metaverse-based platform can output the message “The AS technician is repairing the product” through the platform and simultaneously output the image of the AS technician repairing the product. . At this time, the display device that outputs the metaverse-based platform cannot show the user an exploded view or blueprint of the product and can simply display the image of the product being repaired. On the other hand, a display device that outputs a metaverse-based platform can output both an exploded view and a design diagram of the product to an after-sales service technician. Through this, the after-sales service technician can determine how to actually repair the product.

Figure 4 is a flowchart explaining a metaverse-based product AS method according to an embodiment of the present invention. Hereinafter, descriptions that overlap with the above-described content will be omitted.

Referring to FIG. 4, in step S410, the user can select the AS center and repair menu for the product to be repaired within the metaverse-based platform.

In step S420, the metaverse-based platform can connect to the AS center. At this time, the above-described network can be used.

In step S430, the metaverse-based platform may invite the AS engineer to the chat room. At this time, the Metaverse-based platform can have the artificial intelligence AS technician first perform a preliminary inspection of the product through the Metaverse service server after printing the chat room and before inviting the AS technician. At this time, if the artificial intelligence AS technician determines that connection to the AS technician is necessary as a result of the preliminary inspection, he or she can connect the AS technician.

In step S440, the user and the AS technician can have a conversation about product repair requests and problems within the chat room. At this time, the Metaverse-based platform may receive consent from users because there is a risk of infringement of personal information or sensitive information.

In step S450, the user can select items to allow access to the product. At this time, the access permission items can be provided by the AS technician. At this time, if additional information is needed, the AS technician can request the user again to allow access to the product.

In step S460, the user may request repair from an AS technician.

In step S470, the AS technician can diagnose the product within an acceptable range. More specifically, after-sales service technicians can check the model name by accessing the basic information of the product, and in the case of the installation environment, they can check the installation environment of the product directly from My Home in the Metaverse, and by accessing the logs stored in the product. You can check the product log.

In step S480, the AS technician can remotely access the product and perform functions such as debugging or reset. To this end, the after-sales service technician can request permission from the user to remotely access the product.

In step S490, after the repair is completed, the AS technician may explain precautions to the user and end the chat room.

Accordingly, when a product requires repair, there is an advantage that precise inspection is possible according to the user's tolerance range.

Figure 5 is a flowchart explaining a metaverse-based product AS method according to another embodiment of the present invention. Hereinafter, descriptions that overlap with the above-described content will be omitted.

Referring to FIG. 5, in step S510, the user can select the AS center and inspection menu for the product to be inspected within the metaverse-based platform. Additionally, the metaverse-based AS device of the present invention may include a TV, a smart phone, etc. In other words, users can run a metaverse-based platform using a terminal.

In addition, in step S510, it was explained that the user directly selects the AS center and maintenance menu, but the user can set the maintenance request as a reservation, and the metaverse-based platform sends an AS technician when the reservation setting time arrives. You can call In this case, the AS technician can connect at that time, inspect the product, report the results, and finish. At this time, the metaverse-based platform may not output the chat room.

In step S520, the metaverse-based platform can connect to the AS center.

In step S530, the metaverse-based platform may invite the AS engineer to the chat room.

In step S540, the AS technician can enter the metaverse-based platform and perform at least one of regular inspection or occasional inspection of the product. Regular inspection involves inspection of products subject to inspection, and occasional inspection involves inspection of user inspection requested items according to user requests. At this time, the AS technician can check the inside of the user's metaverse-based platform, so they can directly know the product's installation environment.

In step S550, the AS engineer can input the inspection results, and the Metaverse-based platform can output the inspection results. At this time, the metaverse-based platform can output the inspection results within the chat room or in some areas within My Home. Afterwards, the Metaverse-based platform can check additional inspection items for users.

Additionally, if a user requests a specific inspection in the chat room, the AS technician can perform the requested inspection again. If there are no further requests for additional inspection, in step S560, the metaverse-based platform may output the final inspection result and end the chat room.

In one embodiment, the metaverse-based platform can output a checklist that can be checked in the product. In addition, the Metaverse-based platform can output checklists required by other registered products. At this time, the user can individually approve whether to inspect other products that can be inspected.

Accordingly, when regular or occasional inspection is required, the user has the advantage of being able to remotely access and inspect the product without visiting the home directly through the product inspection menu within the platform. Additionally, if the Home Hub application or My Home platform is linked to the user's terminal, there is an advantage in that remote inspection can be permitted even if no one is at home.

Figure 6 is a flowchart explaining a metaverse-based product AS method according to another embodiment of the present invention. Hereinafter, descriptions that overlap with the above-described content will be omitted.

Referring to FIG. 6, in step S610, the user can select the AS center and repair record menu for the product for which the repair record is to be checked within the metaverse-based platform.

In step S620, the metaverse-based platform can output a list of repair records. Here, the repair record list represents a list of records of repairing the product. Additionally, the record of repairing the product may include at least one of images, videos, and text generated or necessary while repairing the product according to the embodiments of FIGS. 2 to 4 . For example, repair records may include records of explanations or precautions given by an after-sales service technician during product repair.

In step S630, the user may select the first repair record from the repair record list.

In step S640, the metaverse-based platform may play the video for the selected first repair record. More specifically, the first repair record may include a repair record video of an AS technician for the first product. Accordingly, the Metaverse-based platform can play video of repair records performed by AS technicians. In one embodiment, the metaverse-based platform may express the internal rendering level of the product differently depending on the user's permissions.

In step S650, playback may end and then return to step S620.

In other words, when the user wants to review the repair records, he or she can view the repair records again through the list of stored repair records. Users can view the repair process remotely and check the after-sales service technician's explanations, precautions, and usage guides during the process.

Accordingly, the user can check the process of how the AS technician repaired the product, and if the same problem occurs next time, the user can repair it himself in case of a simple repair. Additionally, here, the AS engineer can check the exploded view or even the design drawing of the product, but the user can only check the abstracted drawing of the product.

Figure 7 is a flowchart explaining a metaverse-based product AS method according to another embodiment of the present invention. Hereinafter, descriptions that overlap with the above-described content will be omitted.

Referring to FIG. 7, in step S710, the user can select the AS center and self-repair guide menu for the product for which the self-repair guide is to be checked within the metaverse-based platform.

In step S720, the metaverse-based platform can connect to the AS center.

In step S730, the metaverse-based platform may output a list of self-repair guides.

In step S740, the user may select the first image from the self-repair guide list. In other words, a metaverse-based platform can provide self-repair guides for products so that users can repair products on their own. At this time, the self-repair guide provided to the user may include a rendered product image with confidential product information abstracted.

In step S750, the metaverse-based platform can play the selected first video. Accordingly, users can self-repair the product by following the video.

In step S760, if the user needs expert help during self-repair, the repair request can be delivered to the AS technician through the metaverse-based platform. At this time, the Metaverse-based platform can additionally output buttons such as the “Call AS Technician” menu while outputting the first video, which is a self-repair guide. Additionally, the Metaverse-based platform can automatically call an after-sales service technician from the after-sales service center if it discovers that the user is unable to proceed to the next step during self-repair. Additionally, the Metaverse-based platform can forward a repair request to an after-sales service technician at the after-sales service center if symptoms requiring expert diagnosis are discovered during the user's self-repair.

Accordingly, when it is difficult to use the after-sales service center, users can directly repair the product through a guide video.

Figure 8 is a flowchart explaining a metaverse-based product AS method according to another embodiment of the present invention. Hereinafter, descriptions that overlap with the above-described content will be omitted.

Referring to FIG. 8, in step S810, the metaverse-based platform may turn on the black box service for product use records. At this time, the Metaverse-based platform can output a “black box” menu inside My Home to receive on/off settings from the user. Here, the black box can store not only repair records but also metadata such as patterns and logs of the user's daily use of the product.

More specifically, in step S820, the metaverse-based platform can store daily product usage records. In one embodiment, the metaverse-based platform may delete other records, leaving only the metadata after a first period of time (e.g., one month). Additionally, in one embodiment, the metaverse-based platform may compress and store metadata after the first period. Later, if there is a request from an AS engineer, it can be unzipped and checked.

In step S830, the metaverse-based platform can store detailed records when a specific event or pattern is found in the stored metadata. For example, if a specified event such as high temperature, vibration, shock, or power failure occurs while using the product, the Metaverse-based platform can leave a record so that the before and after logs are not deleted. In addition, the Metaverse-based platform can also store product disconnection and delay information that can be detected through the home hub application. Record this information so that after-sales service technicians can use it when repairing the product. At this time, in one embodiment, the metaverse-based platform not only stores specific events or specific patterns, but also abstracts and outputs specific events or specific patterns to users or AS technicians.

In step S840, the metaverse-based platform can output a warning and a guide to correct use to the user if it is found that the records stored according to steps S820 and S830 are used in a way other than the correct use method. there is.

In step S850, the metaverse-based platform can provide records and metadata stored in the black box to the AS technician if the user agrees. Accordingly, while repairing a product, the after-sales service technician can search the product's usage records and use them as a reference for repairs. Additionally, in one embodiment, the after-sales service technician can retrieve recent usage records of the product and retrieve the user's product usage patterns.

Accordingly, there is an advantage in that various products can be registered and usage logs can be analyzed comprehensively and from various angles.

Figure 9 is a flowchart explaining a metaverse-based product AS method according to another embodiment of the present invention. Hereinafter, descriptions that overlap with the above-described content will be omitted.

Figure 9 shows a case where an AS technician, not a user, accesses the My Home platform, unlike Figures 2 to 8. In other words, of course, AS technicians at the AS center can also use the Metaverse-based platform. In this case, in order to protect the user's personal information, the inside of the virtual home, rather than the actual user's home, can be used as the My Home platform.

Referring to FIG. 9, in step S910, the AS engineer can access the educational metaverse-based platform. In other words, the AS technician at the AS center can use the above-mentioned platform in AS technician mode.

In step S920, the metaverse-based platform can provide exercises in a determined order according to the learning goal. Additionally, the Metaverse-based platform can provide a follow-through function by viewing existing repair records.

In step S930, the metaverse-based platform can output the product interior in AS technician mode. In other words, the Metaverse-based platform can output the internal design and exploded view of the product together with the AS technician mode, unlike the user mode. At this time, the Metaverse-based platform can print internal product parts in 3D and provide simulation of assembly and disassembly of parts.

Accordingly, AS technicians can receive training without time or space constraints.

The above detailed description should not be construed as restrictive in any respect and should be considered illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

100: display device
110: Broadcast reception unit
111: Tuner unit
112: Demodulation unit
120: Sensing unit
130: input unit
140: storage unit
150: display module
160: Audio output unit
170: Interface unit
171: External device interface unit
172: Network interface unit
173: User input interface unit
190: power supply unit
200: remote control device

Claims (13)

An interface unit that communicates with the outside and receives user input;
A display that outputs a metaverse-based platform; and
Includes a control unit,
The control unit
Register the product from the user,
Outputting a menu for the registered product within the platform, wherein the menu includes a repair menu,
Connecting to an after-sales service center as the user selects the repair menu,
A display device that outputs a metaverse-based platform, characterized in that when an AS technician in the AS center performs a repair, it outputs a product in progress of repair. According to claim 1,
The control unit
Print a chat room within the platform,
Invite AS technicians within the AS center to the printed chat room,
A display device that outputs a metaverse-based platform, characterized in that when the user requests repair for the product in the chat room, the AS technician performs the repair. According to claim 2,
The control unit
Connect to the metaverse service server before inviting the AS article,
A display device that outputs a metaverse-based platform, characterized in that a preliminary inspection of the product is performed through an artificial intelligence after-sales service technician. According to claim 2,
The control unit
Requesting the user to allow inspection of the product, wherein the inspection allowance includes at least one of the model name of the product, the installation environment of the product, and the log of the product,
A display device that outputs a metaverse-based platform, characterized in that it transmits information about the product to the AS technician based on the inspection allowable items of the product. According to claim 1,
The control unit
A display device that outputs a metaverse-based platform, characterized in that it abstracts and outputs the product in progress of repair. According to claim 1,
The menu includes an inspection menu,
The control unit
Connecting the AS center as the user selects the inspection menu,
A display device that outputs a metaverse-based platform, characterized in that when the AS engineer performs an inspection, the inspection result is output. According to claim 1,
The menu includes a repair record menu,
The control unit
When the user selects the repair record menu, a list of repair records is output,
When the user selects a first repair record from the repair record list, a display device that outputs a metaverse-based platform, characterized in that it outputs at least one of an image, video, and text corresponding to the first repair record. . According to claim 7,
The control unit
A display device that outputs a metaverse-based platform, characterized in that when outputting the video, the product rendering level is expressed differently depending on the user's authority. According to claim 1,
The control unit
Store usage records for the product,
A display device that outputs a metaverse-based platform, characterized in that the stored usage record is compressed when a first period has elapsed from the point of storage. According to clause 9,
The control unit
When a specific event occurs, a display device that outputs a metaverse-based platform, characterized in that the usage records before and after the specific event are not compressed. According to claim 1,
The control unit
When the AS technician accesses the platform, an AS technician mode is provided, wherein the AS technician mode is a mode that provides a blueprint and an exploded view of the product. A display device that outputs a metaverse-based platform. According to claim 1,
The platform is a display device that outputs a metaverse-based platform, characterized in that it includes a space where products and furniture registered by the user are arranged. A step of registering a product from a user;
Outputting a menu for the registered product within a metaverse-based platform, the menu including a repair menu;
Connecting to an after-sales service center as the user selects the repair menu; and
When an AS technician in the AS center performs repairs, a method of controlling a display device that outputs a metaverse-based platform, comprising the step of outputting a product in progress of repair.

Images