JP6457170B2 - Portable electronic devices - Google Patents

Description

  The present invention relates to a portable electronic device having a touch panel display screen.

  In recent years, portable electronic devices having a touch panel have been rapidly put into practical use. Conventionally, a notebook PC is connected to a projector and the display data of the notebook PC is projected and displayed on a screen for presentation. Recently, a portable electronic device having a touch panel excellent in portability is used instead of the PC. Is increasing.

  As techniques for connecting a portable electronic device having a touch panel to a projector or the like and projecting and displaying display data displayed on the portable electronic device, techniques such as Patent Document 1 and Patent Document 2 are known.

  For example, in Patent Document 1, a handwritten image is combined with a display content in the middle of a presentation and displayed, and the combined handwritten image is automatically deleted after a set time has elapsed or by a button operation. An input display device is disclosed. Patent Document 2 discloses a touch panel electronic device that can appropriately project and display the position of a touch operation in accordance with the display content of an operation target when a touch panel mobile terminal is connected to a projector for presentation. A device is disclosed.

JP 2007-080005 A JP 2013-73595 A

  However, when a presentation is performed with a portable electronic device connected to a projector or the like, the presenter not only allows the listener to easily grasp the current operation position, but also emphasizes and emphasizes in the display data. In some cases, it is desirable for the listener to easily grasp the above.

  Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to provide a portable electronic device that allows a listener to easily grasp a region to be emphasized in display data.

In order to solve the above-described problems, a portable electronic device according to the present invention includes a storage unit that stores image data, a touch panel that displays a first image based on the first image data, and the first image data as another electronic device. An external output unit that outputs to the touch panel, a touch operation detection unit that detects a touch operation performed by the user on the touch panel, and the touch operation detected by the touch operation detection unit is part of an image displayed on the touch panel An operation determination unit that determines whether or not the first operation specifies a region, and when the operation determination unit determines that the touch operation is a first operation that specifies a partial region An image generation unit that generates second image data using the first image data, and the first image data is output to the other electronic device via the external output. When the second image data is generated, the first image is displayed on the touch panel, and the second image data is replaced with the other electronic device from the external output unit instead of the first image data. And a display control unit for outputting to the display.

  According to the portable electronic device of the present invention, it is possible for the listener to easily grasp the contents to be emphasized among the displayed contents.

1 is an external perspective view of a mobile phone 100. FIG. 1 is a configuration diagram of a mobile phone 100. FIG. It is a figure which shows the output of the image data to an external device. It is a figure which shows an example of 1st operation which the operation determination part 116 determines. It is a figure which shows an example of the production | generation of the 2nd image data which the image generation part 117 performs. 4 is a flowchart for explaining processing performed in mobile phone 100.

  Hereinafter, a mobile phone 100 will be described as one embodiment of a portable electronic device according to the present invention. In the present embodiment, description will be made using the mobile phone 100. However, the description in the present embodiment can be applied to a terminal device other than the mobile phone, such as a personal computer (PC) having a PDA, a tablet, and a touch panel.

  FIG. 1 is an external perspective view of the mobile phone 100. The housing is provided with a touch panel 102, a speaker 103, a microphone 104, and an operation unit 105. In addition, an external output terminal 111 for connecting to an external device is provided on the side surface of the mobile phone 100. On the touch panel 102, key groups such as cursor keys and numeric keys, icons, and the like are displayed based on instructions from the user. The touch panel 102 can display an image based on image data stored in the storage unit 110 described later. When an external device such as a television or a projector is connected to the external output terminal 111, the mobile phone 100 can output data held by the mobile phone 100 from the external output terminal 111 to the connected external device. The external device may be directly connected to the external output terminal 111 or indirectly connected via a cable or the like.

  FIG. 2 is a configuration diagram of the mobile phone 100. The cellular phone 100 includes a touch panel 102, a speaker 103, a microphone 104, an operation unit 105, an antenna 106, a radio unit 107, a signal processing unit 108, a storage unit 110, an external output terminal 111, and a control unit 114.

  The radio unit 107 modulates / demodulates a signal transmitted / received via the antenna 106. The wireless unit 107 can receive a call request transmitted from another mobile phone via the antenna 106. The wireless unit 107 can receive a call request transmitted from another mobile phone. The wireless unit 107 outputs the received call request to the control unit 114. The wireless unit 107 can receive data such as an electronic mail transmitted from another mobile phone and output the data to the control unit 114.

  The signal processing unit 108 performs processing for transmitting an audio signal input from the microphone 104 via the wireless unit 107, and processing for outputting an audio signal received from the antenna 106 via the wireless unit 107 to the speaker 103. I do.

  The microphone 104 outputs the input voice to the signal processing unit 108 as a voice signal.

  The speaker 103 outputs the audio signal processed by the signal processing unit 108 or the audio data received from the control unit 114 as audio.

  The operation unit 105 can accept an operation by a user. The operation unit 105 outputs the accepted operation to the control unit 114. The operation unit 105 includes hard keys and the like.

  The touch panel 102 includes a display unit 112 and an input unit 113.

  The display unit 112 includes an LCD (Liquid Crystal Display), and has a function of displaying images such as characters and icons on the LCD based on instructions from the control unit 114.

  The input unit 113 detects a touch by the user, and outputs the coordinate value of the touched position to the control unit 114 and the storage unit 110 for each unit time (for example, 1/60 seconds) during detection. . In this embodiment, the touch means that the user touches the input unit 113 with a finger or the like, and the detach means that when the user touches the input unit 113 with a finger, the touching finger is used to input the input unit 113. In this case, when the user is touching the input unit 113 with a finger, the user's finger that is touching moves while maintaining contact. The input unit 113 determines that the touch has been made when the coordinate value is detected. When the coordinate value detected by the input unit 113 is no longer detected, it is determined to be detached. When the detected coordinate value changes with time, the input unit 113 determines that it is a slide. Note that touching the input unit 113 is not limited to the user's finger. A pen other than the user's finger may be used. The input unit 113 may be realized by any method such as a resistance film method, an optical method, and a capacitive coupling method used in the general touch panel 102. The input unit 113 may detect a plurality of touches by the user at the same time. The input unit 113 may detect a new touch by the user when one touch by the user is detected. The input unit 113 may output the coordinate value of the already touched position and the coordinate value of the newly touched position to the control unit 114. In addition, the input with respect to the input part 113 by a user may be called touch operation. The touch operation is an operation performed on the input unit 113 by the user from the touch state to the detach state.

  The storage unit 110 includes a ROM, a RAM, an EEPROM, a nonvolatile RAM, a flash memory, an HDD, and the like, and stores a program processed by the control unit 114.

  In addition, the storage unit 110 has a function of storing coordinate values output from the input unit 113 for each unit time (for example, 1/60 seconds) while detecting a touch by the user. That is, the memory | storage part 110 memorize | stores the coordinate value output between the touch state and the detached state. The storage unit 110 outputs a plurality of coordinate values output between the touch state and the detached state to the control unit 114 described later.

  The storage unit 110 stores a plurality of application programs.

  The storage unit 110 also stores image data displayed on the display unit 112 or image data output via the external output terminal 111. The storage unit 110 stores the image data generated by the control unit 114. Note that first image data and second image data described later are image data stored in the storage unit 110.

  The storage unit 110 can store various data based on instructions from the control unit 114.

  The external output terminal 111 is connected to an external device such as a display device such as a television or a projection device such as a projector. Data held by the mobile phone 100 can be output to an external device. The external device may be directly connected to the external output terminal 111 or indirectly connected via a cable or the like.

  The external output terminal 111 may be connected to an external device using wireless communication. In this case, the external output terminal 111 has a function capable of near field communication.

  FIG. 3 is a diagram illustrating an example when an external device is connected to the external output terminal 111. In FIG. 2, a display device 300 having a display unit 301 on which an image is displayed is shown as an example of an external device. A cable 200 for connecting the mobile phone 100 and the display device 300 is shown in FIG. One end of the cable 200 is connected to the external output terminal 111 of the mobile phone 100, and the other end of the cable 200 is connected to an input terminal included in the display device 300. The cellular phone 100 outputs image data displayed on the touch panel 102 from the external output terminal 111. The display device 300 receives the image data output from the external output terminal 111 via the cable 200. The display device 300 displays an image based on the received image data on the display unit 301. In the present embodiment, the external device is described as indicating the display device 300, but the external device is not limited to the display device 300. As described above, the external device may be a projection device such as a projector. In FIG. 3, an image including the object 402 and the object 403 is displayed on the display unit 112, and the same image is also displayed on the display unit 301.

  The control unit 114 includes an external device detection unit 115, an operation determination unit 116, an image generation unit 117, and a display control unit 118.

The control unit 114 can control the overall operation of the mobile phone 100. The control unit 114 includes processing means such as a CPU (Central Processing Unit). The control unit 114 includes a plurality of CPUs, and executes these functions by assigning the functions of the external device detection unit 115, the operation determination unit 116, the image generation unit 117, and the display control unit 118 to individual CPUs. May be. The control unit 114 may include only a single CPU, and one CPU may execute the functions of the external device detection unit 115, the operation determination unit 116, the image generation unit 117, and the display control unit 118. Regardless of the above, the control unit 114 may include a plurality of CPUs, or may include only a single CPU.

  In addition, the storage unit 110 stores functions related to the external device detection unit 115, the operation determination unit 116, the image generation unit 117, and the display control unit 118 as programs, and the control unit 114 reads programs from the storage unit 110 as necessary. May be executed and the functions of the external device detection unit 115 and the like may be executed. In this case, the control unit 114 illustrated in FIG. 2 represents the control unit 114 after acquiring and executing the program from the storage unit 110.

  The external device detection unit 115 can detect whether or not an external device is connected to the external output terminal 111. When the external output terminal 111 is connected to an external device, the external device detection unit 115 notifies the operation determination unit 116 and the display control unit 118 that the connection has been detected. Further, when the connection between the external output terminal 111 and the external device is released, the external device detection unit 115 notifies the display control unit 118 that the connection is released.

  The operation determination unit 116 is an operation for designating a specific partial region of the first image in which the user's touch operation is displayed on the display unit based on the coordinate values stored between the touch state and the detachment state. It can be determined whether or not.

  The determination performed by the operation determination unit 116 will be described with reference to FIG. FIG. 4A is a diagram showing that an image is displayed on the display unit 112. As shown in FIG. 4B, if the user's touch operation is an operation that encloses a partial area of the image displayed on the display unit 112 such as a trajectory 400, the operation determination unit 116 performs a specific operation. Some areas can be identified. Therefore, the operation determination unit 116 determines that the touch operation by the user is an operation for designating a part of the region (the region 400 in FIG. 4B) from the image displayed on the display unit 112.

  On the other hand, as shown in the trajectory 401 in FIG. 4C, the operation determination unit 116 cannot specify a specific partial region in the trajectory 401. Therefore, the operation determination unit 116 determines that the touch operation by the user is not an operation for specifying a partial area from the image displayed on the display unit 112.

  In FIG. 4B, the locus of the touch operation by the user is described as a square. However, the locus is not necessarily limited to a square but may be a locus such as a circle or a triangle. In addition, even when the touch operation trajectory does not clearly surround a part of the image, the operation determination unit 116 can estimate a partial region of the image from the touch operation trajectory. The estimated area may be regarded as a partial area of the image. In the present embodiment, an operation for specifying a part of the area from the image displayed on the display unit 112 may be referred to as a first operation.

For example, the area 401 specified by the user in FIG. 4B may be displayed on the display unit 112 while the user is in the area. Further, the area 401 may be continuously displayed on the first image even after second image data described later is output from the external output terminal 111. Further, the region 401 may not be displayed on the display unit 112.

  When the operation determination unit 116 determines that a part of the first image has been specified, the image generation unit 117 uses the first image data stored in the storage unit and the information from the operation determination unit 116. Based on this, new second image data is generated.

  The second image data is an image in which the area designated by the user is emphasized as compared with the first image data. An example of the second image data is shown in FIG. FIG. 5 shows an example of a second image displayed based on the second image data. FIG. 5 is an example when the operation determination unit 116 determines that the region 400 shown in FIG. 4B is the first operation. The image shown in FIG. 5 is an image that is output from the external output terminal 111 to an external device and displayed on the display unit 301 or the like. The image of FIG. 5 may be displayed on the display unit 112.

  FIG. 5A grays out a region other than the designated region in order to emphasize the designated region as compared with other regions. In other words, areas other than the designated area are displayed in light gray. In FIG. 5A, since the area including the object 403 is the designated area, the object 402 is grayed out. In addition, the area | region displayed with light gray is an area | region shown with a dotted-line diagonal line. The image generation unit 117 generates the second image data shown in FIG. 5A based on the first image data and the information from the operation determination unit 116. Note that the image data in FIG. 5A is created by combining the first image data with image data that is gray image data and in which only a specific area is not gray. In FIG. 5A, the area other than the designated area has been described as gray. However, the area is not necessarily gray. You may use colors other than gray, such as black, red, yellow, and white. Since areas other than the designated area are grayed out, the user's line of sight can be collected in a specific area.

In FIG. 5B, in order to emphasize the designated area as compared with the other areas, only the designated area is cut out, and the image data after cutting is used as the second image data. That is, the image shown in FIG. 5B is only an image included in the designated area. In FIG. 5B, the object 403 is displayed because it is in the specific area, but the object 402 is not included in the second image because the object 402 is outside the specific area. Since the area other than the specific area is not displayed, only the designated area can be emphasized.

  Note that FIG. 5 is an example, and the image generation performed by the image generation unit 117 is not limited to the mode of FIG. Any display mode may be used as long as the area specified by the user can be distinguished from other areas. In the present embodiment, the image generation unit 117 will be described as generating the second image data in the manner shown in FIG.

  The display control unit 118 can display image data on the display unit 112. In addition, when an external device is connected to the external output terminal 111, the display control unit 118 can output image data to the external device via the external output terminal 111.

  For example, when the display control unit 118 displays an image based on the first image data on the display unit 112 and an external device is connected to the external output terminal 111, the display control unit 118 outputs the first image data to the external device. To do. Specifically, as illustrated in FIG. 3, the display device 300 displays the same image as that displayed on the display unit 112. The mobile phone 100 and the display device 300 display images based on the same first image data.

  The display control unit 118 generates the second image data by the image generation unit 117 when the image based on the first image data is displayed on the display unit 112 and the first image data is output to an external device. Then, the second image data is output to the external device instead of the first image data. That is, since an image based on the first image data is displayed on the display 113 and an image based on the second image data is displayed on the external device, the image displayed on the display unit 112 and the image displayed on the external device are displayed. Is different. For example, the display device 300 displays the second image based on the second image data shown in FIG. 5A from the state where the first image based on the first image data is displayed as shown in FIG. Switch to the state to do.

  Next, the operation of the mobile phone 100 according to the present embodiment will be described with reference to FIG.

  The control unit determines whether or not the first image based on the first image data is displayed on the display unit 112 (S11). When the first image is displayed on the display unit 112 (YES in S11), the external device detection unit 115 determines whether or not an external device is connected (S12). When it is determined that an external device is connected (YES in S12), the display control unit 118 outputs the first image data from the external output terminal 111 (S13). The external device displays a first image based on the first image data. That is, the state shown in FIG. 3 is obtained.

When the first image data is output from the external output terminal 111, the operation determination unit 116 determines whether or not the user has performed a first operation (S14). The first operation is an operation for designating a specific area such as the area 400 as already described with reference to FIG. When it is not determined that the operation is the first operation (No in S14), the control unit determines whether or not an operation for ending output to the external device is performed by the user (S21). When an operation for ending output to the external device is detected, the display control unit 118 ends the process of outputting the first image data from the external output terminal 111 (S22). In this case, the display control unit 118 may continue the process of displaying the first image on the display unit 112. Further, the process of displaying the first image on the display unit 112 may be terminated in accordance with the process of S21.

  If the operation determination unit 116 determines that the operation performed by the user is the first operation, the operation determination unit 116 notifies the image generation unit 117 of the result (Yes in S14).

  When the first operation is detected, the image generation unit 117 generates second image data based on the region designated by the first operation and the first image data (S15). For example, when the area 400 in FIG. 4B is detected as the first operation, the image generation unit 117 generates the image data shown in FIG. 5B. That is, an area other than the area designated by the first operation is grayed out.

  When the image generation unit 117 generates the second image data, the display control unit 118 outputs the second image data from the external output terminal 111 (S16). The external device displays a second image based on the second image data. In this case, the first image displayed on the display unit 112 in FIG. 3 is displayed on the display unit 112 of the mobile phone 100, and the second image shown in FIG. 5A is displayed on the external device. . That is, the image displayed on the display unit 112 is different from the image displayed on the external device.

  When the second image data is output from the external output terminal 111, the control unit 114 detects whether or not an operation for ending output to the external device has been performed by the user (S17). When the operation for ending the output is detected, the display control unit 118 ends the output of the second image data (S18). The display control unit 118 may continue the display of the first image on the display unit 112 while terminating the output of the second image data.

  With the above operation, when the same image is displayed on the mobile phone 100 and the external device, if the user designates a specific area, the image displayed on the mobile phone 100 is not changed and displayed on the external device. The image to be changed is changed. Thereby, for example, when the user shares an image displayed on the mobile phone 100 with another person, when the user shares the image with another person by outputting the image to an external device, the mobile phone It is possible to collect other people's gazes in the feature area without changing 100 images. Since the image of the mobile phone 100 is not changed, the user can explain to other people while viewing the image of the mobile phone 100.

  In the present embodiment, the display control unit 118 has been described by outputting the second image data from the external output terminal 111 to the external device, but this is not necessarily the only operation. When the display control unit 118 displays an image based on the first image data on the display unit 112 and outputs the second image data to an external device, when the touch operation by the user is the second operation, The output of the second image data may be terminated and the first image data may be output to an external device. That is, since the image displayed on the display unit 112 and the image displayed on the external device are both images based on the first image data, the same image is displayed. The operation determination unit 116 may determine whether or not the operation is the second operation based on an output from the input unit. The second operation is, for example, a slide operation, an operation in which touch and detach are repeated a plurality of times in a predetermined time.

  The display control unit 118 displays an image based on the first image data on the display unit 112 and outputs the second image data to an external device. When the touch operation by the user is the third operation, The display of the image based on the first image data may be terminated, and the image based on the second image data may be displayed on the display unit 112. That is, since the image displayed on the display unit 112 and the image displayed on the external device are both images based on the second image data, the same image is displayed. Note that the operation determination unit 116 may determine whether the operation is the third operation based on an output from the input unit. The third operation is, for example, a slide operation, an operation that repeats touching and detaching a plurality of times in a predetermined time, and the like.

The display control unit 118 displays an image based on the second image data on the display unit 112 and outputs the second image data to an external device. When the touch operation by the user is the fourth operation, The image based on the first image data may be displayed on the display unit 112, and the first image data may be output to an external device. That is, since the image displayed on the display unit 112 and the image displayed on the external device are both images based on the second image data, the same image is displayed. Note that the operation determination unit 116 may determine whether the operation is the third operation based on an output from the input unit. The third operation is, for example, a slide operation, an operation that repeats touching and detaching a plurality of times in a predetermined time.

  In addition, when the display control unit 118 displays an image based on the second image data on the display unit 112 and outputs the second image data to the external device, the connection between the external device and the external output terminal 111 is released. When this happens, an image based on the first image data is displayed on the display unit 112.

  In the present embodiment, the first image data is output from the external output terminal 111 when an external device is connected, but this is not necessarily the case. The display control unit 118 may output the first image data from the external output terminal 111 when a predetermined operation is performed by the user when an external device is connected. The predetermined operation includes, for example, an operation for executing an application program for outputting image data to an external device, an operation for executing a function for outputting image data to the external device through a menu operation, and the like.

  In the present embodiment, the operation determination unit 116 performs the determination process after the first image data is output to the external device, but this is not necessarily the case. For example, when the first image data is output to the external device, the determination process may be started when the user performs a predetermined operation on the touch panel. The predetermined operation is, for example, an operation for executing a function for executing a determination process via a menu operation or the like.

  In this embodiment, the number of areas specified by the first operation is one, but the number of areas specified is not necessarily one. For example, when the user performs the first operation a plurality of times, a plurality of areas may be designated. A specific operation will be described. When the operation determination unit 116 starts the determination process, the operation determination unit 116 stores information related to the area specified by the first operation detected after the start in the storage unit. When the operation determination unit 116 detects a predetermined operation by the user, the operation determination unit 116 The determination process ends. When the operation determination unit 116 finishes the determination process, the operation determination unit 116 outputs information related to the designated area stored in the storage unit to the image generation unit 117. As described above, the operation determination unit 116 can detect a plurality of first operations until a predetermined operation is detected, and is designated corresponding to each of the detected first operations. Information regarding the area is stored in the storage unit 110. Then, after a predetermined operation, information regarding a plurality of specific areas stored in the storage unit 110 is output to the image generation unit 117. Thereby, the image generation part 117 can generate | occur | produce 2nd image data based on the information regarding several specific area | regions, and 1st image data. The predetermined operation is an operation for ending the determination process.

  Although the mobile phone 100 according to the present embodiment has the external output terminal 111 and outputs to the external device via the external output terminal 111, the content is not necessarily limited thereto. For example, instead of the external output terminal 111, the mobile phone 100 has a projection unit having a projector function capable of projecting an image displayed on the display unit 112, and the present application is applied to an image projected from the projection unit. You may implement the content described in the example. In this case, since no external device is connected, the projection from the projection unit may be controlled based on a user operation.

  When the second image data is output from the external output terminal 111 and the area 401 is displayed on the display unit 112, the user may move the area 401 by operating the area 401. In addition, the size of the area 401 may be changed. In this case, since the region designated by the user changes as the region 401 is moved or changed in size, the image generation unit 117 generates new second image data, and the generated second image data is You may output to an external apparatus via the external output terminal 111. FIG.

  In addition, when the second image data is output from the external output terminal 111, when the user performs any operation or input to an area other than the area 401 of the first image, the image generation unit performs the operation. Alternatively, new second image data may not be generated based on the input content. For example, when the image in FIG. 5B is displayed on an external device, even if the user displays some information in an area other than the area 401 of the first image, the displayed information is displayed in the second image data. It does not have to be reflected. That is, the image generation unit 117 does not have to generate new second image data based on the content of the operation performed on the area other than the area 401.

  In addition, the embodiment of the present invention can be variously modified as appropriate within the scope of the technical idea shown in the claims.

DESCRIPTION OF SYMBOLS 102 Touch panel 103 Speaker 104 Microphone 105 Operation part 106 Antenna 107 Radio | wireless part 108 Signal processing part 110 Memory | storage part 111 External output terminal 114 Control part 115 External apparatus detection part 116 Operation determination part 117 Image generation part 118 Display control part

Claims (4)

A display unit, an external output unit, and a display control unit;
The display control unit
When the external output unit is connected to another electronic device, the display unit and the other electronic device shift to a duplication mode for displaying the first image,
In the duplication mode, when there is a first operation on a partial area of the first image displayed on the display unit, a second image in which only an image related to the partial area is extracted from the first image. Switch from the duplication mode to the extended mode to display the second image on the other electronic device,
In the extended mode, when there is a second operation to end the display of the second image on the display unit, the mode returns to the replication mode;
A portable electronic device characterized by The display control unit causes the display unit to display the first image when the second image is displayed on the other electronic device, and an operation on the first image displayed on the display unit is performed. In the third operation, switching the image to be displayed on the display unit from the first image to the second image,
The portable electronic device according to claim 1 . When the display control unit displays the second image on the display unit and the output from the external output unit to the other electronic device is completed, the display control unit displays the first image on the display unit. Displaying,
The portable electronic device according to claim 2 . In the case where the second image is displayed on the other electronic device, the display control unit maintains the display of the second image even if there is a fourth operation for other than the partial area. ,
The portable electronic device according to claim 1 .

Images