KR20110069577A - Image display method and apparatus thereof - Google Patents

Abstract

PURPOSE: An image display device and method thereof are provided to store the photographing time of an image, the storing location of a photographed image, and received user voice to a storing unit. CONSTITUTION: If a bookmark key is selected, a control unit receives a user speech through a microphone(S12, S13). The control unit detects the photographing time of a video corresponding to user voice reception time(S15). The control unit detects the storing location of the video(S16). The control unit stores the storing location of the video in a storing unit(S17). If a stored character is selected, the control unit detects the linked video(S18, S19).

Description

Image display method and device thereof IMAGE DISPLAY METHOD AND APPARATUS THEREOF

The present invention relates to an image display method and an apparatus thereof.

In general, a camera for capturing and displaying an image (movie and still image) captures an image and displays the captured image on a display unit, but among all the captured images, the user searches all images to find a desired image. Or play all video files.

SUMMARY OF THE INVENTION An object of the present invention is to provide a video display device and a method thereof capable of quickly and easily searching and displaying a video desired by a user from a video file (or still video).

An image display apparatus according to embodiments of the present invention includes a camera module for photographing an image; A display unit which displays the captured image; When a key for searching for an image is selected, a user voice is received, and a photographing time point of the photographed image corresponding to a point in time at which the user voice is received, a storage position of the photographed image, and the received user voice are combined. It is composed of a control unit for storing in the storage unit.

In accordance with one or more exemplary embodiments, an image display device includes: a camera module for photographing a video; A display unit which displays the captured video; Receiving a user voice when a key for searching the video is selected, converting the received user voice into a text, detecting a shooting time point of the captured video corresponding to the time point at which the user voice is received, and And a control unit for detecting a storage position of the captured video and including the shooting time point and the storage position in the converted text.

An image display method according to embodiments of the present invention includes the steps of photographing an image; Displaying the photographed image on a display unit; Receiving a user voice when a key for searching an image is selected; And storing the photographing time point of the photographed image corresponding to the point of time at which the user voice is received, the storage location of the photographed image, and the received user voice together in a storage unit.

According to embodiments of the present invention, an image display method includes: photographing a video; Displaying the photographed video on a display unit; Receiving a user voice when a key for searching the video is selected; Converting the received user's voice into a text; Detecting a photographing time point of the captured video corresponding to a point in time at which the user voice is received; Detecting a storage location of the captured video; And including the capturing time and the storage location in the converted text.

According to embodiments of the present invention, an image display apparatus and method thereof may further include receiving a user voice when a key for searching for an image is selected, and a photographing time point of a photographed image corresponding to a time point at which the user voice is received; By storing the storage location of the captured image and the received user voice together in the storage unit, there is an effect that the user can quickly and easily search and display the desired image from the video file.

According to embodiments of the present invention, an image display apparatus and a method thereof may include: receiving a user voice when a key for searching for an image is selected, and storing a captured still image corresponding to a point in time at which the user voice is received; By storing the received user voice together in the storage unit, the still image file can be searched and displayed quickly and easily.

Hereinafter, exemplary embodiments of an image display apparatus and a method thereof capable of quickly and easily searching and displaying an image desired by a user from a moving image file (or still image) will be described in detail with reference to FIGS. 1 to 11.

1 is a block diagram showing the configuration of a mobile communication terminal 100 for explaining an embodiment of the present invention. The mobile communication terminal (mobile phone) 100 may be implemented in various forms. For example, the mobile communication terminal 100 includes a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), and the like.

As shown in FIG. 1, the mobile communication terminal 100 includes a wireless communication unit 110, an A / V (Audio / Video) input unit 120, a user input unit 130, a sensing unit 140, and an output unit 150. ), A memory 160, an interface unit 170, a controller 180, a power supply unit 190, and the like. Not all components of the mobile communication terminal 100 shown in FIG. 1 are essential components, and the mobile communication terminal 100 may be implemented by more components than those shown in FIG. The mobile communication terminal 100 may also be implemented by components.

The wireless communication unit 110 includes one or more components for performing wireless communication between the mobile communication terminal 100 and a wireless communication system or wireless communication between the mobile communication terminal 100 and a network in which the mobile communication terminal 100 is located. It may include. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like. have.

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a pre-generated broadcast signal and / or broadcast related information and transmits the same to the mobile communication terminal 100. . The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, may be received by the mobile communication module 112. The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems, and in particular, digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), and media forward link (MediaFLO). Digital broadcast signals can be received using digital broadcasting systems such as only), digital video broadcast-handheld (DVB-H), integrated services digital broadcast-terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcasting systems that provide broadcasting signals as well as the digital broadcasting system described above. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, and / or a text / multimedia message.

The wireless internet module 113 refers to a module for wireless internet access, and the wireless internet module 113 may be built in or external to the mobile communication terminal 100. Here, wireless Internet technologies include wireless LAN (WLAN), Wi-Fi, WiBro, WiMAX, World Interoperability for Microwave Access (WMAX), HSDPA (High Speed Downlink Packet Access), and the like. Can be used.

The short range communication module 114 means a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The position information module 115 is a module for checking or obtaining the position of the mobile terminal (it is possible to check the position of the vehicle when the mobile terminal is mounted on the vehicle). One example is the Global Position System (GPS) module. The GPS module receives position information from a plurality of satellites. Here, the location information may include coordinate information represented by latitude and longitude. For example, the GPS module can measure the exact time and distance from three or more satellites and accurately calculate the current position by triangulating three different distances. A method of obtaining distance and time information from three satellites and correcting the error with one satellite may be used. In particular, the GPS module can obtain not only the location of latitude, longitude, and altitude but also accurate time together with three-dimensional speed information from the location information received from the satellite. As the location information module 115, a Wi-Fi Positioning System and / or a Hybrid Positioning System may be applied.

The A / V input unit 120 is for inputting an audio signal or a video signal, and the A / V input unit 120 includes a camera 121 and a microphone 122. May be included. The camera 121 processes an image frame such as a still image or a video obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be configured according to the configuration of the mobile terminal.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. In the call mode, the processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the mobile terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like. In particular, when the touch pad forms a mutual layer structure with the display unit 151, this may be referred to as a touch screen.

The sensing unit 140 may be an open / closed state of the mobile communication terminal 100, a location of the mobile communication terminal 100, a user contact presence, a bearing of the mobile communication terminal 100, an acceleration / deceleration of the mobile communication terminal 100, and the like. As described above, the current state of the mobile communication terminal 100 is sensed to generate a sensing signal for controlling the operation of the mobile communication terminal 100. For example, when the mobile communication terminal 100 is in the form of a slide phone, whether the slide phone is opened or closed may be sensed. In addition, the sensing unit 140 is responsible for sensing functions related to whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to an external device, and the like.

The interface unit 170 serves as an interface with all external devices connected to the mobile communication terminal 100. For example, the interface unit 170 is a port connecting a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, and an identification module. , Audio I / O (Input / Output) port, video I / O (Input / Output) port, earphone port, and the like. Here, the identification module is a chip that stores a variety of information for authenticating the usage rights of the mobile communication terminal 100, and includes a user identification module (UIM) and a subscriber identify module (SIM). ), A Universal Subscriber Identity Module (“USIM”), and the like. In addition, the device equipped with the identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Therefore, the identification module may be connected to the mobile communication terminal 100 through a port. The interface unit 170 receives data from an external device or receives power to transmit the data to each component inside the mobile communication terminal 100 or transmit data within the mobile communication terminal 100 to an external device.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 includes a display unit 151, an audio output module 152, an alarm unit 153, and the like. This may be included.

The display unit 151 displays and outputs information processed by the mobile communication terminal 100. For example, when the mobile communication terminal 100 is in a call mode, the mobile terminal 100 displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile communication terminal 100 is in a video call mode or a photographing mode, the mobile communication terminal 100 displays a photographed and / or received image, a UI, or a GUI.

The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, or a three-dimensional display. It may include at least one of (3D display). In addition, two or more display units 151 may exist according to an implementation form of the mobile communication terminal 100. For example, an external display unit (not shown) and an internal display unit (not shown) may be simultaneously provided in the mobile communication terminal 100.

When the display unit 151 and a sensor for detecting a touch operation (hereinafter referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 outputs the touch screen. In addition to the device can also be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.

In addition, the touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or capacitance generated at a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch. When there is a touch input to the touch sensor, the corresponding signal (s) is sent to a touch controller (not shown). The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can determine which area of the display unit 151 is touched.

Hereinafter, the proximity sensor 141 of the mobile communication terminal 100 will be described with reference to FIG. 2.

2 is a diagram illustrating a proximity touch process of the mobile communication terminal 100. Proximity-touch in the present invention means that the pointer is approached a predetermined distance away from the screen without actually touching the screen.

The proximity sensor 141 may be disposed in the inner region of the mobile communication terminal 100 surrounded by the touch screen or near the touch screen. The proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using mechanical force by using an electromagnetic force or infrared rays. The proximity sensor 141 has a longer life and higher utilization than a contact sensor.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the touch screen is configured to detect the proximity of the pointer by a change in an electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as "Proximity Touch", and the touch The act of actually touching the pointer on the screen is called "Contact Touch". The position of the proximity touch with the pointer on the touch screen means a position where the pointer is perpendicular to the touch screen when the pointer is in proximity touch.

In addition, the proximity sensor 141 detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state). do. Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 152 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile communication terminal 100. The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile communication terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, and key signal input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration. When a call signal is received or a message is received, the alarm unit 153 may vibrate the mobile terminal through a vibration means. Alternatively, when the key signal is input, the alarm unit 153 may vibrate the mobile communication terminal 100 through the vibration means in response to the key signal input. The user can recognize the occurrence of the event through the vibration as described above. Of course, the signal for event occurrence notification may also be output through the display unit 151 or the voice output module 152.

The haptic module 154 generates various tactile effects that the user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.

The haptic module 154, in addition to the vibration, the pin arrangement to move vertically with respect to the contact skin surface, the blowing force or suction force of the air through the injection or inlet, the grazing to the skin surface, the contact of the electrode (eletrode), the stimulation such as electrostatic force Various tactile effects can be produced, such as the effects of the heat-absorbing effect and the effect of reproducing a sense of cold using the elements capable of absorbing heat or heat.

The haptic module 154 may not only deliver the haptic effect through direct contact, but may also be implemented to allow the user to feel the haptic effect through a muscle sense such as a finger or an arm. The haptic module 154 may be provided with two or more according to the configuration aspect of the telematics terminal. The haptic module 154 may be provided where the contact with the user is frequent in the vehicle. For example, it may be provided in a steering wheel, a shift gear lever, a seat seat, and the like.

The memory 160 may store a program for processing and controlling the controller 180 and temporarily stores input / output data (for example, map data, phonebook, message, still image, video, etc.). It can also perform a function for.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory, etc.). Random Access Memory (RAM), Random Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), It may include a storage medium of at least one type of magnetic disk, optical disk. In addition, the mobile communication terminal 100 may operate a web storage that performs a storage function of the memory 150 on the Internet.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, the interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, An audio input / output (I / O) port, a video input / output (I / O) port, and an earphone port may be configured. Here, the identification module is a chip that stores various information for authenticating the use authority of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identify module (SIM), and universal user authentication. And a module (Universal Subscriber Identity Module (USIM)). In addition, the device equipped with the identification module (hereinafter referred to as an identification device) may be manufactured in the form of a smart card. Therefore, the identification module may be connected to the mobile terminal 100 through a port. The interface unit 170 receives data from an external device or receives power and transmits the data to each component inside the mobile terminal 100 or transmits the data inside the mobile terminal 100 to an external device.

The interface unit 170 may be a passage through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or various commands input by the user from the cradle. It may be a passage through which a signal is transmitted to the mobile terminal 100. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile communication terminal 100. For example, the controller 180 performs related control and processing for voice call, data communication, video call, and the like. In addition, the controller 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on a touch screen as text and an image, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The functions of the components applied to the mobile communication terminal 100 may be implemented in a computer-readable recording medium using software, hardware, or a combination thereof. Hardware implementations include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPCs), and controllers (FPGAs). It may be implemented using at least one of controllers, micro-controllers, microprocessors, electrical units for performing functions, etc. In some cases such embodiments are implemented by the controller 180. In a software implementation, embodiments such as a procedure or function may be implemented with a separate software module that performs at least one function or operation Software code may be written in a software application written in a suitable programming language. Software code is also stored in the memory 160 and controlled. It may be executed by the unit 180.

The voice recognition module 182 recognizes the voice spoken by the user and performs a corresponding function according to the recognized voice signal.

The navigation session 300 applied to the mobile communication terminal 100 displays a driving route on map data.

3 is a block diagram showing a vehicle navigation system for explaining an embodiment of the present invention.

As shown in Fig. 3, the vehicle navigation system includes an information providing center 30 which provides traffic information and various data (for example, programs, executable files, etc.); Telematics, which is mounted in a vehicle, receives traffic information through a long range wireless communication network 20 and / or a short range wireless communication network, and provides a road guidance service based on the GPS signal received through the satellite 10 and the traffic information. It consists of a terminal 200.

Hereinafter, the configuration of the telematics terminal 200 for explaining the embodiment of the present invention will be described with reference to FIG.

4 is a block diagram showing the configuration of a telematics terminal 200 for explaining an embodiment of the present invention.

As shown in FIG. 4, the telematics terminal 200 includes a control unit (for example, a central processing unit, a CPU) 212 for controlling the telematics terminal 200 as a whole, a memory 213 for storing various kinds of information, and The main board 210 includes a key controller 211 for controlling various key signals and an LCD controller 214 for controlling a liquid crystal display (LCD).

The memory 213 stores map information (map data) for displaying road guidance information on a digital map. In addition, the memory 213 stores a traffic information collection control algorithm for inputting traffic information according to a road situation in which the vehicle is currently driving, and information for controlling the algorithm.

The main board 210 is assigned with a unique device number for a code division multiple access (CDMA) module 206, which is a mobile communication terminal embedded in a vehicle, for locating a vehicle, tracking a driving route from a starting point to a destination, and the like. GPS module 207 for receiving a GPS signal or transmitting traffic information collected by a user as a GPS (Global Positioning System) signal, a CD deck (CD Deck) 208 for reproducing a signal recorded on a compact disk (CD) ), A gyro sensor 209 and the like. The CDMA module 206 and the GPS module 207 transmit / receive signals through the antennas 204 and 205.

In addition, the broadcast receiving module 222 is connected to the main board 210 and receives a broadcast signal through the antenna 223. The main board 210 includes a display unit (201) under the control of the LCD control unit 214 through the interface board 203, a front board 202 under the control of the key control unit 211, and a vehicle. The camera 227 for capturing the inside and / or the outside is connected. The display unit 201 displays various video signals and text signals, and the front board 202 is provided with buttons for inputting various key signals, and the main board 210 provides a key signal corresponding to a user-selected button. To provide. In addition, the display unit 201 includes a proximity sensor and a touch sensor (touch screen) of FIG. 2.

The front board 202 may include a menu key for directly inputting traffic information, and the menu key may be configured to be controlled by the key controller 211.

The audio board 217 is connected to the main board 210 and processes various audio signals. The audio board 217 includes a microcomputer 219 for controlling the audio board 217, a tuner 218 for receiving a radio signal, a power supply unit 216 for supplying power to the microcomputer 219, and various voices. It consists of a signal processor 215 for processing a signal.

In addition, the audio board 217 is composed of a radio antenna 220 for receiving a radio signal, and a tape deck 221 for reproducing an audio tape. The audio board 217 may further configure a voice output unit (for example, an amplifier) 226 for outputting a voice signal processed by the audio board 217.

The voice output unit (amplifier) 226 is connected to the vehicle interface 224. That is, the audio board 217 and the main board 210 are connected to the vehicle interface 224. The vehicle interface 224 may be connected to a hands-free 225a for inputting a voice signal, an airbag 225b for occupant safety, a speed sensor 225c for detecting the speed of the vehicle, and the like. The speed sensor 225c calculates a vehicle speed and provides the calculated vehicle speed information to the central processing unit 212.

The navigation session 300 applied to the telematics terminal 200 generates road guide information based on map data and vehicle current location information, and notifies the user of the generated road guide information.

The display unit 201 detects a proximity touch in the display window through a proximity sensor. For example, the display unit 201 detects the position of the proximity touch when the pointer (for example, a finger or a stylus pen) is in close proximity, and displays the position information corresponding to the detected position. Output to the control unit 212.

The voice recognition device (or voice recognition module) 301 recognizes a voice spoken by the user and performs a corresponding function according to the recognized voice signal.

The navigation session 300 applied to the telematics terminal 200 displays a driving route on map data, and a predetermined distance from a blind spot where the position of the mobile communication terminal 100 is included in the driving route. Wireless networks (eg, in-vehicle navigation devices) and / or mobile communication terminals carried by nearby pedestrians automatically via wireless communication (e.g., near field communication network). By receiving the position information of the surrounding vehicle from the terminal mounted on the surrounding vehicle, and receives the position information of the surrounding pedestrian from the mobile communication terminal carried by the surrounding pedestrian.

Meanwhile, the broadcast receiving module 222 may receive a broadcast signal including traffic information of TPEG format from a broadcasting station through the antenna 223. The broadcast signal includes not only video and audio data according to various standards such as terrestrial or satellite digital multimedia broadcasting (DMB), digital audio broadcasting (DAB), and digital video broadcasting (DVB-T, DVB-H), but also traffic information (TPEG). And additional information such as traffic information and various additional data according to a service, a binary format for scene (BIFS) data service. In addition, the broadcast receiving module 222 tunes a signal band provided with traffic information, demodulates the tuned signal, and outputs the demodulated signal to a TPEG decoder (included in the controller 407).

The TPEG decoder decodes the traffic information in the TPEG format and provides the controller 212 with various information including the traffic light information included in the traffic information.

Hereinafter, the format of the TPEG information will be described with reference to FIG.

5 is a diagram illustrating a format of TPEG information.

Referring to FIG. 5, the TPEG information consists of a sequence of message segments (hereinafter, referred to as a 'TPEG message').

The message segments may be applied to different applications, respectively. As an example, each TPEG message may include a TPEG-Congestion and Travel-Time information Application, a TPEG-Road Traffic Message Application, and a TPEG-Public Transport Information Application. ), Multimedia-based traffic and travel information applications (TPEG-Multimedia Based Traffic and Travel Information Application), and other applications. The traffic light information can be applied to any of the above applications.

Each TPEG application is assigned a unique identification number called an Application Identification (AID). The application identifier is used to decode the received TPEG message using the most suitable application decoder.

An identifier 0001 (hex) is assigned to the road traffic message application, an application identifier 0010 (hex) is assigned to the TPEG congestion traffic information application (TPEG-CTT), and an application identifier 0008 (hex) is assigned to the multimedia-based traffic and travel information application.

The TPEG message includes a message management container, an application status container, and a TPEG location container.

The content of the application state container varies depending on the type of TPEG message application. Traffic light information may be included in the application state container and transmitted. For example, when the TPEG message is a TPEG congestion traffic information message application (TPEGCTT), the traffic light information is transmitted in a TPEG-CTT container which is an application state container. In this case, the TPEG-CTT container provides congestion and travel time status information, prediction of congestion and travel time status information, additional information, and traffic light information. It may include.

The congestion degree and travel time state information includes information on an average link speed, an interval travel time, an interval delay, and a congestion type.

The congestion degree and travel time state prediction information includes information on prediction of average speed, prediction of travel time, and congestion tendency.

The additional information describes additional information or supplementary information related to congestion degree and travel time information in a text format.

The TPEG decoder decodes the TPEG message included in the broadcast signal and extracts traffic light information, road information, and various traffic information included in the TPEG message.

Hereinafter, an image display device and a method thereof according to embodiments of the present invention will be described with reference to FIGS. 6 to 11. Here, the image display device and the method according to the embodiments of the present invention, as well as a mobile communication terminal 100, a telematics terminal 200, a navigation device 400 equipped with a camera, a smart phone, a notebook computer (notebook computer), PDA (Personal Digital Assistants), PMP (Portable Multimedia Player) may be applied to a variety of terminals equipped with a camera.

6 is a block diagram illustrating a configuration of a video display device according to embodiments of the present invention.

As shown in FIG. 6, the video display device 400 according to the embodiment of the present invention includes a camera module 402 for capturing a video at the request of a user; When a bookmark key (e.g., a key for searching a specific portion of a video file) is selected by the user, the user voice is received through the microphone 405, the user voice is converted into a text, and the user voice is A control unit 401 for detecting a shooting time point of a moving picture corresponding to the received time point and detecting a storage position of the moving picture; A display unit 403 for displaying the video; And a storage unit 404 for storing a text corresponding to the user's voice, a photographing time of the video corresponding to the time when the user's voice is received, and a storage location of the video.

The control unit 401 links the text corresponding to the user's voice to the video file (video), and the user's voice having a recording point of time and a storage location of the video corresponding to the point in time at which the user's voice is received. The corresponding character is stored in a first folder of the storage unit 404, and the video file itself is stored in a second folder of the storage unit 404 in a different location from the first folder. That is, the controller 401 searches for a video linked to the selected text when the desired text is selected by the user among the characters existing in the first folder of the storage 404, and selects the searched video as the selected video. Playback starts from the point of capture included in the character. Therefore, the user can search and confirm a desired image quickly and easily by selecting only text.

In addition, the controller 401 controls the microphone 405 when a still image is captured by the camera module 402 and a bookmark key (for example, a key for searching for a still image file) is selected by the user. Receiving a user voice, converting the user's voice into a text, detecting a recording time of the still image, detecting a storage location of the still image, and capturing the still image to the text and the still image. You can also include a storage location for.

Hereinafter, an image display method for quickly and easily searching and displaying an image desired by a user from a video file will be described with reference to FIGS. 6 and 7.

7 is a flowchart illustrating an image display method according to a first embodiment of the present invention.

First, the controller 401 captures a video through the camera module 402 when the camera mode is selected by the user (S11). In this case, the display unit 403 displays the captured video on a real-time screen.

The controller 401 determines whether a bookmark key (for example, a key for searching for a specific portion of the video file) is selected by the user when the video is captured by the camera module 402. For example, the controller 401 may be a bookmark key (eg, a video) for searching (favorite) a specific video section of the video photographed by the user while the video is captured by the camera module 402. Or (icon for searching for a specific part of the still image file) is selected (S12).

The controller 401 receives a user voice through the microphone 405 when a bookmark key (or bookmark icon) for searching (favorite) a specific image section of the captured video is selected (S13). The controller 401 may receive the user's voice during the time when the bookmark key is selected by the user or the user's voice for a preset time (for example, 3 seconds to 5 seconds).

The controller 401 stores a user's voice received through the microphone 405 when the bookmark key (or bookmark icon) for searching (favorite) a specific video section of the captured video is selected. Save in a separate folder from. That is, the controller 401 is configured to display a user voice received through the microphone 405 when the bookmark key (or bookmark icon) for searching (favorite) a specific video section of the captured video is selected. By storing in a folder separate from the storage location, the user can search only a folder containing only the user's voice to search for an image corresponding to the user's voice easily and quickly.

The control unit 401 converts the user voice stored in the folder of the storage unit into a text (S14). For example, the controller 401 converts a user voice stored in a folder of the storage unit into a text through a program for converting the voice into text.

The controller 401 detects a photographing time point of a video corresponding to a time point at which the user voice is received (S15). For example, when the bookmark key is selected by the user (the time when the user's voice is received), the controller 401 detects a photographing time point of the video corresponding to the time when the bookmark key is selected.

The controller 401 detects a photographing time point of the video corresponding to the point in time at which the user voice is received, and detects a storage location of the video (S16).

The controller 401 stores a text corresponding to the user's voice, a photographing time of the video corresponding to the time when the user's voice is received, and a storage location of the video in the storage unit 404 (S17). Here, the control unit 401 links the text corresponding to the user's voice to the video file (video), the user having a recording point of time and a storage location of the video corresponding to the point in time when the user's voice is received The text corresponding to the voice is stored in the first folder of the storage unit 404, and the video file itself is stored in the second folder of the storage unit 404 in a different location from the first folder.

Thereafter, the controller 401 determines whether the first character (sentence) is selected by the user among the characters (sentences) existing in the first folder of the storage unit 404 (S18).

The controller 401 searches for a video linked to the selected character when the first character (sentence) is selected by the user among the characters (sentences) existing in the first folder of the storage unit 404 (S19). ).

The controller 401 searches for a video linked to the selected text, executes a video playback program, and displays the searched video through the video playback program (video player) based on a photographing time point included in the selected text. Playback from the time of shooting the video (S20). On the other hand, the controller 401 does not convert the user's voice into a text, but includes (links) the recording time of the video corresponding to the time when the user voice is received and the storage location of the video in the received user voice. Then, when the current user voice is received, the received current user voice is compared with the stored user voice to search for the same user voice as the current user voice, search for a video linked to the searched user voice, and then search for the searched user voice. The searched video may be reproduced from the recording time point of the video through the video playing program (video player) based on the included shooting time.

Therefore, the user can search and confirm a desired image quickly and easily by selecting only the characters stored in the first folder of the storage unit 404.

8 to 10 are exemplary diagrams illustrating an image reproduced through a video player when a stored character is selected according to the first embodiment of the present invention.

As shown in Fig. 8, the controller 401 selects a bookmark key (e.g., a key for searching for a specific portion of a video file) by the user when a video is captured by the camera module 402. When received, the microphone 405 receives and stores a user voice (eg, a beach view). The controller 401 converts the stored user's voice (eg, beach) into a text.

The controller 401 may be a user voice at which a recording time of a video corresponding to a time point at which the user voice (for example, a beach view) is received (for example, 1 minute and 14 seconds have elapsed since the first time the video was captured). Is a received time). The controller 401 detects a photographing time point of a video corresponding to the point in time at which the user voice is received, and detects a storage location of the video.

The control unit 401 is one minute from the time (eg, when the video is first recorded) of the video corresponding to the user's voice (for example, the beach appearance), the video recording time corresponding to the time when the user's voice is received When 14 seconds have elapsed), the storage location of the video is stored in a bookmark list of the storage unit 404.

For example, the controller 401 ignites when the user selects the bookmark key at the time when 1 minute and 14 seconds elapses from the time when the video is first recorded, and utters "the beach side" when the video is captured. Converts a user's voice into a text, and a recording time of the video corresponding to the time when the user's voice is received in the converted text (for example, a beach view) is 1 minute from when the video is first recorded. The second has elapsed), the storage location of the video.

The controller 401, when taking a video, when the user selects the bookmark key at the time 10 minutes and 25 seconds have elapsed since the first time the video was taken, and utters "pretty look on the beach", the user's voice Is converted into a character, and a recording time of the video corresponding to the time when the user's voice is received in the converted text (for example, a beautiful beach) is 10 minutes from the time when the video is first recorded. The second has elapsed), the storage location of the video.

The controller 401 selects the bookmark key at the time when 11 minutes 45 seconds have elapsed since the first time the video was captured, and then, when the user selects the bookmark key and utters a "gliding gull", the user's voice is generated. 11 minutes and 45 seconds have elapsed since the recording time of the video corresponding to the time when the user's voice was received in the converted text (eg, a seagull gliding). One point), and the storage location of the video.

Thereafter, the controller 401 selects a first character (1. beachside appearance) from among the characters included in the bookmark list (1. beachside appearance 2. beautiful appearance at the seaside 3. gliding seagull) by the user. Search for the video (video file) based on the video storage location included in the first character, and play the video by playing the video from the time point 1 minute 14 seconds has elapsed through a video playback program to reproduce the "beach view". .

As shown in Figure 9, the control unit 401 is a second character (2. pretty at the beach) among the characters included in the bookmark list (1. beach appearance 2. pretty at the beach 3. gliding seagull) ) Is selected by the user, the video is searched based on the video storage location included in the second text, and the video is played back from the time point when 10 minutes and 25 seconds have elapsed through a video playback program. Play "Pretty at the Beach".

As shown in FIG. 10, the controller 401 may include a third character (3. gliding gull) among the characters included in the bookmark list (1. seaside appearance 2. beautiful appearance at the seaside 3. gliding gull). If is selected by the user, the video (video file) is searched on the basis of the video storage location included in the third character, and the video is played back from the time point when 11 minutes and 45 seconds have elapsed through the video playback program. Play the pretty look at the beach.

Hereinafter, an image display method for quickly and easily searching and displaying a still image desired by a user will be described with reference to FIGS. 6 and 11.

11 is a flowchart illustrating an image display method according to a second embodiment of the present invention.

First, the controller 401 captures a still image through the camera module 402 when the camera mode is selected by the user (S21). In this case, the display unit 403 displays the captured still image on the screen.

The controller 401 determines whether a still image is captured by the camera module 402, and a bookmark key (eg, a key for searching for a still image file) is selected by the user. For example, the controller 401 determines whether a bookmark key (for example, an icon for searching for a still image file) is selected by the camera module 402 to search (favorite) a still image. (S22).

The controller 401 receives a user voice through the microphone 405 when a bookmark key (or bookmark icon) for searching (favorite) the captured still image is selected (S23). The controller 401 may receive the user's voice during the time when the bookmark key is selected by the user or the user's voice for a preset time (for example, 3 seconds to 5 seconds).

When the bookmark key (or bookmark icon) for searching (favorite) the still image is selected, the controller 401 may change a user voice received through the microphone 405 from a storage location of the still image. Save to a separate folder. That is, the controller 401 stores the user's voice received through the microphone 405 when the bookmark key (or bookmark icon) for searching (favorite) the captured still image is selected. By storing in a separate folder different from the user, the user can search only the folder containing only the user voice (characters corresponding to the user voice) to quickly and easily search for an image corresponding to the user voice.

The control unit 401 converts the user voice stored in the folder of the storage unit into a text (S24). For example, the controller 401 converts a user voice stored in a folder of the storage unit into a text through a program for converting the voice into text.

The control unit 401 detects a storage location of a still image corresponding to a point in time at which the user voice is received (S25).

The controller 401 stores the text corresponding to the user's voice in the storage unit 404 together with the storage location of the still image (S26). Here, the controller 401 links the text corresponding to the user's voice to the still image (still image file), stores the text corresponding to the user's voice in a first folder of the storage unit 404, The still image file itself is stored in a second folder of the storage unit 404 at a different location from the first folder.

Thereafter, the controller 401 determines whether the first character (sentence) is selected by the user from among the characters (sentences) present in the first folder of the storage unit 404 (S27).

The controller 401 searches for a still image linked to the selected character when the first character (sentence) is selected by the user among the characters (sentences) existing in the first folder of the storage unit 404 ( S28).

The controller 401 searches for a still image linked to the selected character and displays the retrieved still image (S29).

On the other hand, the controller 401 does not convert the user's voice into text, links the still image corresponding to the point in time at which the user's voice is received to the received user's voice, and then receives the received user's voice if the current user's voice is received. Compare the current user's voice with the stored user's voice to search for the same user's voice as the current user's voice, search for a still image linked to the retrieved user's voice, and display the retrieved still image on the display unit 403. .

Therefore, the user can search and confirm a desired still image quickly and easily by selecting only the characters stored in the first folder of the storage unit 404.

As described above in detail, the video display device and the method according to the first embodiment of the present invention receive a user voice when a key for searching an image is selected and correspond to a time point at which the user voice is received. By storing the photographing time of the photographed image, the storage location of the photographed image, and the received user voice together in the storage unit, it is possible to quickly and easily search and display the desired image from the video file.

According to a second aspect of the present invention, there is provided an image display apparatus and a method thereof, wherein a user voice is received when a key for searching an image is selected, and a storage position of a captured still image corresponding to a point in time at which the user voice is received. By storing the received user voice together with the storage unit, the still image file can be searched and displayed quickly and easily.

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

1 is a block diagram showing the configuration of a mobile communication terminal for explaining an embodiment of the present invention.

2 is a diagram illustrating a proximity touch process of a mobile communication terminal.

3 is a block diagram showing a vehicle navigation system for explaining an embodiment of the present invention.

4 is a block diagram showing the configuration of a telematics terminal 200 for explaining an embodiment of the present invention.

5 is a diagram illustrating a format of TPEG information.

6 is a block diagram illustrating a configuration of a video display device according to embodiments of the present invention.

7 is a flowchart illustrating an image display method according to a first embodiment of the present invention.

8 to 10 are exemplary diagrams illustrating an image reproduced through a video player when a stored character is selected according to the first embodiment of the present invention.

11 is a flowchart illustrating an image display method according to a second embodiment of the present invention.

* Explanation of symbols on the main parts of the drawings

401: control unit 402: camera module

403: display unit 404: storage unit

405: microphone

Claims (26)

A camera module for capturing an image; A display unit which displays the captured image; Receives a user voice when an input for searching for an image is received, and captures the photographed time point corresponding to the time point at which the user voice is received, a storage position of the photographed image, and the received user voice. And a control unit for storing the storage unit. The method of claim 1, wherein the image, A video display device, characterized in that the video. The method of claim 1, wherein the control unit, When an input for searching for the image is received, the received user voice is converted into a text, and a photographing time point of the photographed image corresponding to a point in time at which the user voice is received in the converted text, and the photographed image And a storage location of the video display device. The method of claim 3, wherein the control unit, And store the converted text in a storage location different from the storage location of the image. The method of claim 1, wherein the control unit, When the input for searching for the image is received, converts the received user's voice into text, detects a photographing time point of the photographed image corresponding to the point of time at which the user voice is received, and stores a location of the photographed image. And detect the image and include the capturing time and the storage location in the converted character. The method of claim 1, wherein the control unit, When the stored user voice is selected, the captured image is searched based on the storage position of the photographed image, and the displayed image is reproduced from the photographing time point based on the stored photographing time point. Device. The method of claim 3, wherein the control unit, When the converted character is selected, the image display is searched based on the storage position of the photographed image, and the image is displayed based on the stored photographing time point. Device. The method of claim 1, wherein the control unit, If a key for searching for the image is selected when the still image is captured, the user voice is received, the received user voice is converted into a text, and the storage location of the still image is included in the converted text. Video display device. The method of claim 1, wherein the control unit, After including the recording time of the video corresponding to the time when the user voice is received and the storage location of the video in the received user voice, if the current user voice is received, the received current user voice and the stored user voice is compared Thereby searching for the same user voice as the current user voice, searching for a video linked to the searched user voice, and playing the searched video from the shooting time point based on the shooting time point included in the searched user voice. Video display device. The method of claim 1, wherein the control unit, Link the still image corresponding to the point in time at which the user voice was received to the received user voice, and then, when the current user voice is received, compare the received current user voice with the stored user voice to be the same user as the current user voice. Search for an audio, search for a still image linked to the searched user's voice, and display the searched still image on the display unit. A camera module for shooting a video; A display unit which displays the captured video; Receiving a user voice when a key for searching the video is selected, converting the received user voice into a text, detecting a shooting time point of the captured video corresponding to the time point at which the user voice is received, and And a controller configured to detect a storage location of the captured video and to include the capturing time and the storage location in the converted text. The method of claim 11, wherein the control unit, Searching for the video based on a storage location included in the converted text when the converted text is selected, and playing the searched video from the recording time based on a recording time included in the converted text; Video display device. The method of claim 11, wherein the control unit, And store the converted text in a storage location different from the storage location of the video. Photographing an image; Displaying the photographed image on a display unit; Receiving a user voice when an input for searching for an image is received; And storing a photographing time point of the photographed image corresponding to a point in time at which the user voice is received, a storage position of the photographed image, and the received user voice together in a storage unit. . The method of claim 14, wherein the image, The video display method characterized by the video. The method of claim 14, wherein storing the user voice comprises: Converting the received user's voice into text when an input for searching for the image is received; And including a photographing time point of the photographed image corresponding to a point in time at which the user voice is received, and a storage location of the photographed image in the converted text. The method of claim 16, wherein the converted text is stored in a storage location different from the storage location of the image. The method of claim 14, wherein storing the user voice comprises: Converting the received user's voice into text when an input for searching for the image is received; Detecting a photographing time point of the photographed image corresponding to a point in time at which the user voice is received; Detecting a storage location of the captured image; And including the capturing time and the storage location in the converted text. 15. The method of claim 14, further comprising: retrieving the captured image based on a storage position of the captured image when the stored user voice is selected; And reproducing the searched image from the photographing time point on the basis of the stored photographing time point. The method of claim 16, further comprising: retrieving the captured image based on a storage position of the captured image when the converted character is selected; And reproducing the searched image from the photographing time point on the basis of the stored photographing time point. The method of claim 14, wherein storing the user voice comprises: Receiving a user voice when a key for searching for the image is selected when a still image is captured; Converting the received user's voice into a text; And including a storage location of the still image in the converted text. The method of claim 14, After including the recording time of the video corresponding to the time when the user voice is received and the storage location of the video in the received user voice, if the current user voice is received, the received current user voice and the stored user voice is compared Thereby searching for a user voice that is the same as the current user voice; Searching for a video linked to the searched user voice; And reproducing the searched video from the photographing time point based on the photographing time point included in the searched user's voice. The method of claim 14, After linking the still image corresponding to the point in time at which the user voice is received to the received user voice, if the current user voice is received, the received user voice is compared with the stored user voice to compare the received user voice with the same user. Searching for a user voice; Searching for a still image linked to the searched user voice; And displaying the retrieved still image on the display unit. Shooting a video; Displaying the photographed video on a display unit; Receiving a user voice when a key for searching the video is selected; Converting the received user's voice into a text; Detecting a photographing time point of the captured video corresponding to a point in time at which the user voice is received; Detecting a storage location of the captured video; And including the capturing time and the storage location in the converted text. 25. The method of claim 24, further comprising: searching the video based on a storage location included in the converted text when the converted text is selected; And reproducing the searched video from the photographing point of time based on the photographing point of time included in the converted sentence. 25. The method of claim 24, wherein the converted text is stored in a storage location different from the storage location of the video.

Images