KR101521220B1 - Mobile terminal and operation control method thereof - Google Patents

Abstract

And a method of controlling the operation of the portable terminal. The present invention relates to a method and apparatus for confirming an output value output from a gravity sensor, photographing a subject through a camera, storing an image and an output value generated by photographing, and, when a menu for calling an image is selected, And displaying the image. According to the present invention, irrespective of the degree of rotation of the main body, an image generated through the camera can be displayed in a predetermined vertical direction.

Body rotation, image, vertical direction, gravity sensor

Description

[0001] The present invention relates to a mobile terminal and an operation control method thereof,

The present invention relates to a mobile terminal and an operation control method thereof. More particularly, the present invention relates to a mobile terminal capable of displaying or storing an image generated through a camera in a state where a main body is rotated, .

A portable terminal is a portable device having at least one function that can carry out voice and video communication, a function to input and output information, and a function to store data while being portable.

In order to realize a complicated function, a mobile terminal implemented in the form of a multimedia device is being applied variously in terms of hardware and software. In the case of a portable terminal having a camera, a still image or a moving image can be photographed and stored using a camera, and continuous shooting is possible.

When the subject is photographed using the portable terminal, the subject of the subject can be photographed by rotating the body of the portable terminal according to the photographing environment. Generally, an image generated by photographing in a state where the main body is rotated is displayed on the display unit in the taken direction. Therefore, in a state in which the main body is not rotated, a user who calls or transmits an already generated image has a problem that the image displayed in the direction in which the image is taken is rotated or stored every time in a direction convenient for the user to view or transmit.

Accordingly, there is a need for a method that can always display an image generated through the camera of the portable terminal in a constant direction for easy viewing by the user regardless of the degree of rotation of the main body.

Accordingly, it is an object of the present invention to provide a portable terminal and an operation control method capable of displaying and transmitting an image generated through a camera of the portable terminal in a predetermined vertical direction.

According to an aspect of the present invention, there is provided a method of controlling a mobile terminal operation, the method comprising: checking an output value output from a gravity sensor; photographing a subject through a camera; storing the image and the output value generated by the photographing; And displaying the image based on the stored output value when a menu calling the image is selected.

According to another aspect of the present invention, there is provided a portable terminal comprising: a gravity sensor for confirming a direction of a gravitational acceleration; a camera for photographing a subject; a display; and an image generated by the camera, And a control unit for storing the output value and displaying the image on the display unit based on the stored output value when a menu for calling the image is selected.

According to the present invention, irrespective of the degree of rotation of the main body, an image generated through the camera can be displayed in a predetermined vertical direction.

Hereinafter, the present invention will be described in detail with reference to the drawings.

The portable terminal described in this specification includes a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and navigation.

FIG. 1 is a block diagram of a portable terminal according to an exemplary embodiment of the present invention. Referring to FIG. Referring to FIG. 1, a mobile terminal according to an exemplary embodiment of the present invention will be described in terms of its functional components.

1, the portable terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, A memory 160, an interface unit 170, a control unit 180, and a power supply unit 190. When such components are implemented in practical applications, two or more components may be combined into one component, or one component may be divided into two or more components as necessary.

The wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 113, a wireless Internet module 115, a short distance communication module 117, and a GPS module 119.

The broadcast receiving module 111 receives at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. At this time, the broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may refer to a server for generating and transmitting at least one of a broadcast signal and broadcast related information and a server for receiving at least one of the generated broadcast signal and broadcast related information and transmitting the broadcast signal to the terminal.

The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal. The broadcast-related information can also be provided through a mobile communication network, in which case it can be received by the mobile communication module 113. Broadcast-related information can exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems. In particular, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) ), Digital Video Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. In addition, the broadcast receiving module 111 may be configured to be suitable for all broadcasting systems that provide broadcasting signals, as well as the digital broadcasting system. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 113 transmits and receives a radio signal to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 115 refers to a module for wireless Internet access, and the wireless Internet module 115 can be embedded in the mobile terminal 100 or externally. The short-range communication module 117 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology. A GPS (Global Position System) module 119 receives position information from a plurality of GPS satellites.

The A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 123. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. Then, the processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 123 receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 113 and output when the voice data is in the call mode. The microphone 123 may be a variety of noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

The user input unit 130 generates key input data that the user inputs to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, a finger mouse, and the like. Particularly, when the touch pad has a mutual layer structure with the display unit 151 described later, it can be called a touch screen.

The sensing unit 140 senses the current state of the portable terminal 100 such as the open / close state of the portable terminal 100, the position of the portable terminal 100, Thereby generating a sensing signal. For example, when the portable terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. In addition, a sensing function related to whether or not the power supply unit 190 is powered on, whether the interface unit 170 is coupled to an external device, and the like can be handled.

The sensing unit 140 may include a gravity sensor 143. The gravity sensor 143 is a concept that includes all kinds of sensors that sense the direction in which gravity acts in relation to the rotation state or the rotation state of the portable terminal. The gravity sensor 143 connects the weight to the variable resistor and detects the current state of the terminal by the change of the resistance due to the rotation or places a conductive object at the center and corresponds to the direction in which the conductive object comes in contact with the rotation The rotation state can be detected.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display unit 151, an audio output module 153, and an alarm unit 155.

The display unit 151 displays and outputs the information processed by the portable terminal 100. For example, when the portable terminal 100 is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the portable terminal 100 is in the video communication mode or the photographing mode, the photographed or received images can be displayed individually or simultaneously, and the UI and the GUI are displayed.

Meanwhile, as described above, when the display unit 151 and the touch pad have a mutual layer structure to constitute a touch screen, the display unit 151 can be used as an input device in addition to the output device. If the display unit 151 is configured as a touch screen, it may include a touch screen panel, a touch screen panel controller, and the like. In this case, the touch screen panel is a transparent panel attached to the outside, and can be connected to the internal bus of the portable terminal 100. The touch screen panel keeps a watch on the contact result, and if there is a touch input, sends the corresponding signals to the touch screen panel controller. The touch screen panel controller processes the signals, and then transmits corresponding data to the controller 180 so that the controller 180 can determine whether the touch input has been made and which area of the touch screen has been touched.

The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, And a display (3D display). There may be two or more display units 151 according to the implementation mode of the portable terminal 100. [ For example, the portable terminal 100 may include an external display unit (not shown) and an internal display unit (not shown) at the same time.

The audio output module 153 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 153 outputs sound signals related to functions performed in the portable terminal 100, for example, a call signal reception tone, a message reception tone, and the like. The sound output module 153 may include a speaker, a buzzer, and the like.

The alarm unit 155 outputs a signal for notifying the occurrence of an event of the portable terminal 100. Examples of events occurring in the portable terminal 100 include call signal reception, message reception, key signal input, and the like. The alarm unit 155 outputs a signal for notifying the occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. When a call signal is received or a message is received, the alarm unit 155 may output a vibration to notify it. Alternatively, when the key signal is input, the alarm unit 155 can output the vibration by the feedback to the key signal input. This vibration output allows the user to recognize the occurrence of an event. Of course, a signal for notifying the occurrence of an event may also be output through the display unit 151 or the sound output module 153.

The memory 160 may store a program for processing and controlling the control unit 180 and may store a function for temporarily storing input or output data (e.g., a phone book, a message, a still image, .

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM , And a ROM. ≪ / RTI > In addition, the portable terminal 100 may operate a web storage for storing the memory 150 on the Internet.

The interface unit 170 serves as an interface with all external devices connected to the portable terminal 100. Examples of the external device connected to the portable terminal 100 include a card socket such as a wired / wireless headset, an external charger, a wired / wireless data port, a memory card, a SIM / UIM card, / Output, Video I / O, and Earphone. The interface unit 170 receives data from the external device or receives power from the external device and transmits the data to each component in the portable terminal 100 so that data in the portable terminal 100 can be transmitted to the external device .

The controller 180 typically controls the operation of the respective units to control the overall operation of the mobile terminal 100. For example, voice communication, data communication, video communication, and the like. In addition, the control unit 180 may include a multimedia playback module 181 for multimedia playback. The multimedia playback module 181 may be configured in hardware in the controller 180 or separately from software in the controller 180. [

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The portable terminal according to the present invention has been described in terms of components according to functions. Hereinafter, with reference to FIG. 2 and FIG. 3, the portable terminal related to the present invention will be described in more detail from the viewpoint of the components according to the external form. Hereinafter, a slider type portable terminal having a front touch screen and a slider type keypad among various types of portable terminals such as a folder type, a bar type, a swing type, a slider type, . However, the present invention is not limited to a slider type portable terminal, but can be applied to all types of portable terminals including the above-mentioned type.

2 is a perspective view of a portable terminal according to an embodiment of the present invention. Referring to FIG. 2, the portable terminal includes a first body 100A and a second body 100B configured to be slidable along at least one direction on the first body 100A.

The state where the first body 100A is disposed in a state of being overlapped with the second body 100B may be referred to as a closed configuration and the first body 100A may be referred to as a second body 100B ) May be referred to as an open configuration.

While the portable terminal 100 is in the closed state, it operates mainly in the standby mode, but the standby mode is also canceled by the user's operation. While the portable terminal 100 is open, it operates mainly in a communication mode, but it is also switched to a standby mode by a user's operation or a predetermined period of time.

The case constituting the outer appearance of the first body 100A is formed by the first front case 100A-1 and the first rear case 100A-2. Various electronic components are embedded in the space formed by the first front case 100A-1 and the first rear case 100A-2. At least one intermediate case may be additionally disposed between the first front case 100A-1 and the first rear case 100A-2. Such cases may be formed by injection molding of a synthetic resin, or may be formed of a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the first sound output module 153a, and the first camera 121a may be disposed in the first body 100A, specifically, the first front case 100A-1.

The display unit 151 includes a liquid crystal display (LCD), an OLED (Organic Light Emitting Diodes), and the like that visually express information. The touch pad may be superimposed on the display unit 151 in a layer structure so that the display unit 151 may operate as a touch screen so that information can be input by a user's touch.

The first acoustic output module 153a may be implemented in the form of a receiver or a speaker. The first camera 121a may be adapted to photograph an image or a moving image of a user or the like.

The case constituting the appearance of the second body 100B is formed by the second front case 100B-1 and the second rear case 100B-2. The first operation unit 130a may be disposed on the front face of the second body 100B, specifically, the second front case 100B-1. The second user input unit 130c, the microphone 123 and the interface unit 170 may be disposed on at least one of the first front case 100B-1 and the second rear case 100B-2.

The first user input unit 130a receives a command for controlling the operation of the portable terminal. The first user input unit 130a may include an input key having a function corresponding to a mouse function such as a joystick key, a touch pad, a track ball, a pointing stick, a finger mouse, and the like.

The first and second user input units 130a and 130c may be collectively referred to as a manipulating portion 130 and may be any type of tactile manner in which the user operates in a tactile manner . For example, the user input unit 130 may be implemented as a dome switch or a touch pad capable of receiving a command or information by a push or a touch operation of a user, or may be a wheel, a jog type, Method or the like.

In terms of functionality, the first user input 130a is for entering commands, numbers, letters, symbols, etc., such as start, end, scroll, and the like. Also, the second user input unit 130c may operate as a hot-key for activating a special function in the portable terminal.

The microphone 123 may be implemented in a form suitable for receiving voice, sound, etc. of the user. The interface unit 170 enables the portable terminal according to the present invention to exchange data with an external device. For example, the interface unit 170 may be at least one of a connection terminal for connecting to an earphone, a port for short-range communication, or power supply terminals for supplying power to the portable terminal 100, have. The interface unit 170 may be a card socket that accommodates an external card such as a user authentication module such as a subscriber identification module (SIM) or a user identity module (UIM), or a memory card for information storage.

A power supply unit 190 for supplying power to the portable terminal is mounted on the second rear case 100B-2. The power supply unit 190 may be a rechargeable battery, for example, and may be detachably coupled to the second body 100B for charging or the like.

3 is a rear perspective view of the portable terminal shown in FIG. Referring to FIG. 3, a second camera 121b may be further mounted on the rear surface of the second rear case 100B-2 of the second body 100B. The second camera 121b has a photographing direction substantially opposite to that of the first camera 121a, and may have pixels different from those of the first camera 121a.

For example, the first camera 121a has low pixels so that it is easy to capture a face of a user in the case of a video call or the like and transmit the face to the other party. The second camera 121b photographs a general object and immediately transmits It is preferable to have a high pixel.

A third user input unit 130d may be additionally mounted on the rear surface of the second rear case 100B-2 of the second body 100B. The third user input unit 130d may be implemented with a wheel, and may operate as a special function key such as a scroll in the portable terminal.

A flash 125 may be further disposed adjacent to the second camera 121b. The flash 125 illuminates the subject when the subject is photographed by the second camera 121b.

An antenna (not shown) for communication or the like may be disposed inside the second front case 100B-1 or the second rear case 100B-2.

On one side of the second rear case 100B-2, a broadcast signal receiving antenna 105 may be disposed in addition to an antenna for communication. The antenna 105 may be installed to be able to be drawn out from the second body 100B. A part of the slide module 100C that slidably connects the first body 100A and the second body 100B is disposed on the first rear case 100A-2 side of the first body 100A. The other part of the slide module 100C may be disposed on the second front case 100B-1 side of the second body 100B and may not be exposed to the outside as shown in Fig.

In addition, a fourth user input unit 130e serving as a selection or confirmation key for a specific function may be disposed on one side of the second rear case 100B-2. The fourth user input unit 130e may operate as a hot-key for activating a special function in the portable terminal.

In the above description, the second camera 121b and the like are disposed on the second body 100B, but the present invention is not limited thereto. At least one of the structures 105, 121b, and 125 described as being arranged in the second rear case 100B-2, such as the second camera 121b, is a first body 100A, 1 rear case 100A-2. In such a configuration, there is an advantage that the structures disposed in the first rear case 100A-2 in the closed state are protected by the second body 100B. Also, the first camera 121a may be rotatably formed so that the second camera 121b can be photographed up to the photographing direction, even if the second camera 121b is not separately provided.

4 is a flowchart illustrating a method of controlling an operation of a portable terminal according to an exemplary embodiment of the present invention.

As shown in Fig. 4, an execution menu capable of executing the camera 121 based on the user command is selected (S400). When the subject is photographed through the camera 121 in step S405, the control unit 180 displays the image generated by the photographing on the display unit 151 (S410).

Next, the control unit 180 stores the photographed image in the memory 160 together with the output value output from the gravity sensor 143 when the image is photographed in step S405 (S415). For example, when the main body is rotated and an image is generated, the degree of rotation can be stored together with the image.

Next, the controller 180 determines whether an image call menu is selected (S420). If it is determined in operation S420 that the image calling menu is selected, the control unit 180 displays the image stored in operation S415 on the display unit 151 based on the stored output value (S425). That is, when the vertical direction of the image generated in the state where the main body is not rotated is the first direction, the image is displayed such that the vertical direction of the image is always the first direction based on the output value in step S425. For example, when an image is generated in a state where the main body is rotated 180 degrees, the image displayed in step S425 is rotated and displayed so that the up and down directions of the image are easy for the user to see.

If the image call menu is selected, or if an image is displayed in step S425, the controller 180 determines whether an image transmission menu is selected (S430). If it is determined in operation S430 that the image transmission menu is selected, the control unit 180 transmits the image stored in operation S415 based on the stored output value (S435). The image may be transmitted to the other party together with the stored output value, and may be rotated and transmitted to the other party based on the stored output value. The image can be sent as well as the other party's website. Also, the image transmitted to the other party can be displayed so that the up and down directions of the image are easy for the user to see based on the body of the other party's mobile terminal.

On the other hand, if it is determined in step S430 that the image transmission menu is not selected, the image is not transmitted.

5 to 7 are views showing a method of controlling an operation of a portable terminal according to an embodiment of the present invention, together with a screen displayed on the display unit.

When the subject is photographed without rotating the main body, the generated image 500 is displayed on the display unit so that the vertical direction of the image is the first direction, as shown in Fig. 5 (a). When the main body is rotated by 180 degrees, as shown in FIG. 5B, the generated image 505 is displayed on the display unit so that the vertical direction of the image is the second direction. When the main body is rotated by -90 degrees, the generated image 510 is displayed on the display unit so that the vertical direction of the image is the third direction, as shown in Fig. 5 (c).

When the image call menu is selected, an album view screen 515 is displayed as shown in FIG. 6 (a), and one image 520 of a plurality of images is selected. Regardless of whether the selected image is an image generated in Figure 5 (a), Figure 5 (b), or Figure 5 (c), as shown in Figure 6 (b) 525, the vertical direction of the image is always displayed in the first direction. That is, even if the main body is rotated by 180 degrees or the main body is rotated by -90 degrees, the generated image is also displayed on the basis of the output value outputted by the gravity sensor.

When the image transmission menu is selected, the image transmission menu 530 is displayed, as shown in FIG. 7 (a), and the image is transmitted when image transmission is selected. As shown in Fig. 7 (b), in the other party's portable terminal, the transmitted image is displayed in the first direction in the vertical direction of the image. That is, the image may be transmitted together with the output value of the gravity sensor, and may be rotated and transmitted according to the output value of the gravity sensor, so that the vertical direction of the image can be maintained constant in the other mobile terminal.

In addition, the configuration and method of the embodiments described above can be applied to a portable terminal and its operation control method according to the present invention, Or some of them may be selectively combined.

Meanwhile, the present invention can be embodied as a processor-readable code on a processor-readable recording medium such as a mobile station modem (MSM). The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium readable by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and also a carrier wave such as transmission over the Internet. In addition, the processor readable recording medium may be distributed over networked computer systems so that code readable by the processor in a distributed manner can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

1 is a block diagram of a portable terminal according to an embodiment of the present invention;

2 is a front perspective view of a mobile terminal according to an embodiment of the present invention,

3 is a rear perspective view of a portable terminal according to an embodiment of the present invention,

4 is a flowchart illustrating a method of controlling an operation of a portable terminal according to an exemplary embodiment of the present invention.

5 to 7 are views showing a method of controlling an operation of a portable terminal according to an embodiment of the present invention, together with a screen displayed on the display unit.

Claims (10)

A method for controlling an operation of a portable terminal including a gravity sensor, Confirming an output value indicating a degree of rotation of the main body output from the gravity sensor, and photographing a subject through a camera; Storing the image generated by the photographing and the output value individually; Rotating and displaying the image based on the stored output value when a menu for calling the image is selected; And Transmitting the image and the stored output value to a predetermined external device when the menu for transmitting the image is selected; And controlling the operation of the portable terminal. delete The method according to claim 1, Wherein the transmitting the image and the stored output value to a predetermined external device comprises: And transmits the rotated image based on the stored output value to the external device together with the output value. delete The method according to claim 1, Wherein rotating and displaying the image comprises: Wherein the image is rotated and displayed such that the main body does not rotate but has the same vertical direction as the up and down direction of the generated image. A gravity sensor for confirming the direction of gravitational acceleration and outputting an output value indicating the degree of rotation of the main body; A camera for photographing a subject; A display unit; A wireless communication unit; And Wherein the gravity sensor outputs the image generated by the camera and the output value output from the gravity sensor separately, and when the menu for calling the image is selected, the image is rotated on the display unit based on the stored output value, A controller for simultaneously transmitting the image and the output value to a predetermined external device through the wireless communication unit when the menu for transmitting the image is selected; . delete The method according to claim 6, Wherein the control unit transmits the rotated image based on the stored output value together with the output value to the external device. delete The method according to claim 6, Wherein the controller rotates and displays the image so that the main body has the same vertical direction as the up and down direction of the generated image without rotating the main body.

Images