JP2006262190A - Data output device and data output method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To obtain a data output device and a data output method capable of selecting feeling data to be output for reproduction to an external output apparatus in accordance with the external output apparatus. <P>SOLUTION: A user 161 can reproduce video and sound by his/her own portable terminal device 100, and sends these viewing data (feeling data) to a large viewing device 168 to be able to perform impressive reproduction. At this point, data to be transmitted to the viewing device 168 are limited so as to prevent display of reception display, etc., of e-mail displayed on a display of the portable terminal device 100 from being displayed on a display screen 169, and on the contrary, data selection such as transmitting data that can not be reproduced inside is possible. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a data output device and a data output method for outputting sensory data for stimulating various human senses such as images and sounds to an external output device.

  Not only mobile phones, but also small portable terminal devices such as PHS (Personal Handy-phone System), PDA (Personal Digital Assistant) or portable game terminals are convenient to carry and are being moved or moved by transportation. It is widely used as a portable device that can be carried first. However, these small portable terminal devices inevitably have a small screen area due to their size. For the same reason, a large speaker cannot be used, and the spatial distance when a plurality of speakers are arranged cannot be increased. For this reason, there is a problem that it is impossible to reproduce content such as movies and games that have been made in detail with sufficient expression ability. Moreover, it is not powerful for businesses that place importance on reality, such as studying English conversation using the videophone function, and is not an appropriate output means.

Therefore, a proposal has been made to connect a mobile phone to a home television as an external output device and reproduce an image or the like (see, for example, Patent Document 1). In this proposal, a video signal is output from an external connection terminal for charging of a mobile phone, and the video signal is extracted from an AC adapter used for charging and connected to a home television. Specifically, the connector side of the AC adapter for charging is connected to the external connection terminal for charging of the mobile phone, and the power plug connected to the outlet such as a wall is not connected to the outlet when charging. Then, a video signal is taken out from a video output terminal newly provided on the power plug side and connected to a home television.
JP 2004-56653 A (paragraph 0008, FIG. 1)

  As described above, in the conventional proposal, the charging AC adapter is used for outputting the video signal. Therefore, image information represented by a video signal output from a mobile phone is displayed as it is on a television set for home use or the like.

  FIG. 12 shows an example of an image displayed when the video signal output from the mobile phone terminal is input to the television as it is. On the television screen 501, a reception level mark 505 indicating the reception level of the radio wave of the mobile phone terminal and a remaining battery level are displayed on the upper part of the front surface of the landscape image composed of the mountains 502, 503 and the moon 504 to be originally projected. A remaining battery level mark 506 is displayed. Also, assuming that an e-mail is just received or a voice communication (incoming call) is received, information on the sender of the e-mail or the sender of the voice communication is registered in the phone book. For example, a registered image 508 about the sender who sent the e-mail or the sender of the voice communication, the name 509 of the sender, and the incoming telephone number 510 are displayed. In this specification, an electronic mail means an electronic mail transmitted / received via a communication network regardless of the name used for a mobile phone or the like.

  Therefore, if the person watching the video projected on this television includes a person other than the user of the mobile phone terminal, private information such as the sender of the e-mail or the sender of the voice communication Will be suddenly shown to someone other than the user. Of course, when only one user of the mobile phone terminal is playing a movie downloaded from the web, for example, such a privacy problem does not occur. However, for example, when watching a movie, there is a problem that some information of the movie is lost due to an image other than the movie that is suddenly displayed. In addition, marks such as the reception level mark 505 and the remaining battery level mark 506 may be obstructive. Furthermore, taking the case of an incoming e-mail or voice communication as shown in FIG. 12 as an example, the conversation of an actor or the like is caused by sudden output of an e-mail ringing tone or voice communication ringing tone. May not be heard or may be annoying.

  The mobile terminal device typified by the mobile phone has been described above. However, it stimulates various human senses such as video and sound from a relatively large device such as a desktop personal computer or a display to other external output devices. A similar problem occurs when sensory data is output. For example, even if there is no problem in outputting a message or notification sound that informs the employee in charge of a call from the outside to a personal computer located in the management department of a store, there is no problem in searching for products in the store. It is not preferable that the same message or notification sound is output to the personal computer released to the customer for the reason.

  On the other hand, it may be better not to reproduce sensory data that may be reproduced by an external output device from the viewpoint of office efficiency and cost reduction on the output device from which the sensory data is distributed.

  SUMMARY OF THE INVENTION An object of the present invention is to provide a data output apparatus and a data output method that can select sensory data to be output for reproduction according to an external output device.

  In the present invention, (b) internal output means for outputting part or all of sensory data for stimulating various human sensations such as images to a built-in output device, and (b) part or all of sensory data is externally provided. An external output means for outputting to the output device; and (c) a sensory data type correspondence setting means for setting a correspondence relationship between the types of sensory data to be output when outputting sensory data to the internal output means and the external output means, (D) The data output device includes sensory data type selection means for selecting the type of sensory data output from the internal output means and the external output means in accordance with the setting contents of the sensory data type correspondence setting means.

  That is, in the present invention, in addition to the internal output means for outputting part or all of sensory data for stimulating various human senses such as images to an internal output device, external output means for outputting to an external output device is provided. Yes. Then, the type of sensory data is selected and output by the internal output unit and the external output unit according to the correspondence described by the sensory data type correspondence setting unit. For example, when movie data is output as sensation data, the video data and sound data are output from the external output means, and the external output device reproduces them. For example, the internal output means outputs only this to the built-in output device for reproduction, or it does not output from either the internal output means or the external output means.

  In the present invention, (b) internal output means for outputting all sensory data for stimulating various human sensations such as images to a built-in output device, and (b) part or all of the sensory data is externally output. An external output means for outputting to the device; (c) a sensory data type correspondence setting means for setting a correspondence relation between the types of sensory data output when outputting sensory data to the internal output means and the external output means; D) When outputting sensory data only from the external output means, the data output device is provided with sensory data type selecting means for selecting the type according to the setting contents of the sensory data type correspondence setting means.

  That is, in the present invention, in addition to the internal output means for outputting part or all of sensory data for stimulating various human senses such as images to an internal output device, external output means for outputting to an external output device is provided. Yes. When sensory data is output only from the external output means, the selection is made according to the correspondence described by the sensory data type correspondence setting means. For example, when movie data is output as sensory data, when sensory data is output only from the external output means, for example, a simulated theater device equipped with a vibration generator is provided as an external output device. In this case, the vibration data of the sensory data in addition to the video data and the sound data can be output to the external output device and reproduced as output data.

  In the present invention, (a) whether part or all of sensory data that stimulates various human sensations such as video is reproduced on the own device or transferred to an external output device and reproduced on the external output device. (B) a type discriminating step for discriminating the type of an external output device as a transfer destination when it is discriminated that the data is transferred to an external output device for playback at the playback device discriminating step; C) a selection step for selecting sensory data that can be transferred among sensory data in relation to the type of external output device determined in this type determination step; and (d) a sensory selected as transferable in this selection step. An output step of outputting data to an external output device.

  That is, in the present invention, it is first determined whether part or all of the sensory data is to be played back by the own device or transferred to the external output device and played back by the external output device, and then transferred to the external output device for playback. When it is determined, the type of external output device of the transfer destination is determined, the playback capability or playback environment is checked, and based on this, sensory data that can be transferred is selected. ing. Then, the sensory data selected as transferable is output to the external output device. As a result, it is possible to perform appropriate reproduction according to the capability of the external output device and the environment in which it is arranged.

  As described above, according to the present invention, when sensory data that can be played back by the device itself is played back by an external output device, it is not output as it is, but can be selected according to the external output device. . For this reason, it is possible to adopt an output form in consideration of the environment in which sensory data is reproduced as in the case where the own device is a private device and the external output device is a device intended for an unspecified person.

  Hereinafter, the present invention will be described in detail with reference to examples.

  FIG. 1 shows a configuration of a portable terminal device as a data output device in an embodiment of the present invention. The mobile terminal device 100 includes a CPU (central processing unit) 101, a ROM (read only memory) 102 as a storage medium storing a control program executed by the CPU, and a RAM (randomly storing various data). A control unit 104 in which an access memory is arranged is provided. The control unit 104 is connected to each unit in the mobile terminal device 100 via the bus 105. Of these, the first radio unit 107 transmits and receives various data using a radio base station (not shown) and an antenna 108, and is a part that performs so-called telephone communication. The second wireless unit 109 is a device for outputting viewing data composed of images and sounds in the mobile terminal device 100 to an output device (not shown) located nearby by wireless such as infrared rays. As an example, the second wireless unit 109 performs infrared communication proposed by IrDA (InfraRed Data Association), wireless LAN (local area network), or Bluetooth (Bluetooth) communication.

  The operation unit 111 includes various key switches such as dial keys (not shown), and is a part for inputting operation data. The transmitter / receiver unit 112 connects a speaker 114 for calling and a microphone 114 for the user of the portable terminal device 100 to make a voice call. The camera unit 115 acquires a still image or a moving image by a CCD (Charged Coupled Device) or a C-MOS (Complementary Metal Oxide Semiconductor) camera. The main speaker 116 is a device that outputs a sound other than that for calling, such as a sound notifying that a call has been made. The display 117 includes a display unit such as a liquid crystal display or an organic EL (Electro Luminescence) display. The external connection unit 118 includes a connector for outputting the above-described viewing data to the above-described output device. The sensor unit 119 includes various sensors such as a sensor that detects a voltage of a battery (not shown) that is used as a power source of the mobile terminal device 100. Note that the display 117 does not have to be one, and there may be two or more.

  FIG. 2 shows a circuit portion related to viewing data processing in the portable terminal device of this embodiment. This circuit portion includes a portion that is functionally realized by the CPU 101 shown in FIG. 1 executing a control program and a portion that is configured by hardware such as an actual circuit. The mobile terminal device 100 includes a viewing data synthesis unit 121. The viewing data synthesizing unit 121 receives visual video data and sound data composed of sound, synthesizes them according to the purpose of use, and outputs them to the viewing data selecting unit 122. Here, sound data 131 representing various sounds is input from the sound input unit 123 to the viewing data synthesis unit 121. For example, the sound acquired from the microphone 114 in FIG. 1, the sound of the other party received by the first wireless unit 107, or the like. The camera unit 115 inputs camera output data 132 composed of a still image or a moving image to the viewing data synthesis unit 121. The image input unit 124 inputs image data 133 representing an image other than the camera output data 132 to the viewing data combining unit 121. For example, in the case where the other party's image data sent from the other party's portable terminal device accompanying the call or the portable terminal device 100 is connected to the Internet via the first wireless unit 107, it is not shown. Data when image data composed of still images and moving images is sent from the content server can be listed.

  The viewing data synthesizing unit 121 includes first viewing data 134 as original viewing data composed of the sound data 131, the camera output data 132, and the image data 133, and the additional viewing data output from the additional information generating unit 136. The second viewing data 137 as data is input, and these are combined in various combinations. Here, as additional viewing data, text data 142 sent from the other party of the telephone or e-mail obtained from the address book 141, or a battery remaining amount detection unit 143 constituting a part of the sensor unit 119 of FIG. The battery remaining amount data 144 indicating the remaining battery capacity obtained from the mail, the receiving destination data 146 indicating the mail receiving destination obtained from the mail transmitting / receiving unit 145, and the outgoing / incoming time obtained from the first wireless unit 107 They are the outgoing / incoming call control data 147, icon data 149 representing the shape and color of icons obtained from the icon registration unit 148, and sound data 152 consisting of various sounds obtained from the sound data registration unit 151. These additional viewing data are input to the additional information generation unit 136.

  The additional information generation unit 136 generates text information using a character pattern storage unit (not shown) based on the input text data 142, battery remaining amount data 144, reception destination data 146, and outgoing / incoming call control data 147. Or by selecting a desired icon from the icon registration unit 148 and acquiring it as icon data 149 to generate image information, or by selecting a desired sound from the sound data registration unit 151 to obtain sound information. Is generated. Of these, the text information and the image information are input to the viewing data combining unit 121 as a part of the second viewing data 137 by designating the image display position on the display 117. The sound data 152 selectively acquired from the sound data registration unit 151 is also input to the viewing data synthesis unit 121.

  A viewing data setting unit 154 is connected to the viewing data combining unit 121 and the viewing data selecting unit 122. The viewing data setting unit 154 is connected to the operation unit 111. The user operates the operation unit 111 in a state where the mobile terminal device 100 is set to the viewing data setting mode, thereby setting the output restriction content when viewing data including images and sounds is output to the outside. Can be done. Therefore, the viewing data synthesizing unit 121 synthesizes the viewing data with reference to the setting data 155 by the viewing data setting unit 154. Similarly, the viewing data selection unit 122 refers to the setting data 155 to select the output destination of the viewing data. The viewing data selection unit 122 is connected to the display 117, the call speaker 113, the main speaker 116, the external connection unit 118, and the second wireless unit 109 as viewing data selection destinations.

  In the mobile terminal device 100 according to an embodiment of the present invention, when the external connection unit 118 or the second wireless unit 109 outputs image data as viewing data in order to reduce power consumption and extend battery life. The display drive of the display 117 is stopped. Similarly, when the external connection unit 118 or the second wireless unit 109 outputs sound data as viewing data, the driving of the main speaker 116 is stopped. However, when the selection of the output device that outputs the viewing data is set by the viewing data selection unit 122, the viewing data is output from the external connection unit 118 or the second wireless unit 109. The display 117 can be set to operate.

  FIG. 3 shows a viewing system that uses the portable terminal device 100 configured as described above to output viewing data to a large viewing device at a party venue. In this example, the user 161 of the mobile terminal device 100 rents a rental server 163 on the Internet 162, and a background sound is added to a moving image or a still image previously captured by the camera unit 115 (FIG. 1) such as a family trip. The viewing data that combines these is stored. The user 161 can access the rental server 163 and download necessary viewing data by connecting to the Internet 162 from the nearest base station 164 via the mobile communication network 165. The downloaded viewing data can be reproduced using the built-in main speaker 116 and the display 117 shown in FIG. 1, but can also be transmitted to the outside from the second wireless unit 109.

  The party venue 167 is provided with a large viewing device 168. The viewing device 168 includes a large display screen 169 such as a liquid crystal and a pair of left and right speakers 170 and 171 and further includes a receiving unit 172 that receives radio waves transmitted from the second radio unit 109 shown in FIG. is doing. As the viewing device 168, for example, a large television can be used. The viewing data received by the receiving unit 172 of the viewing device 168 is demodulated, and an image thereof is displayed on the display screen 169 and sound is output from the speakers 170 and 171. If there are a plurality of viewers 174 and 175 in front of the viewing device 168, the user 161 can allow these users to view viewing data such as family trips using these powerful playback means. Although not shown, the same playback is performed by inputting viewing data from a data input terminal (not shown) of the viewing device 168 via the cable (connector connection) from the external connection unit 118 of the mobile terminal device 100. May be.

  FIG. 4 shows a setting state when the viewing data received by the user or once received by the user is output to the external viewing device wirelessly. This will be described with reference to FIG. The control unit 104 of the portable terminal device waits for a menu screen display request, and when the user operates the operation unit 111 to make the request (step S201: Y), the menu screen is displayed (step S202). . From this menu screen, the user operates the operation unit 111 to select “external output setting mode” (step S203: Y). When another mode is selected from the menu screen (steps S203: N, S204: Y), the selected mode (for example, “Internet connection mode”, “e-mail transmission / reception mode”, or viewing data is externally transmitted). "External output mode" to be output to the viewing device is selected, and the selected mode is executed (step S205).

  When “external output setting mode” is selected (step S203: Y), the control unit 104 reads data for external output setting from the ROM. Then, this is sent to the display 117 to display an external output setting screen (step S206).

  FIG. 5 shows the display contents of the external output setting screen. The display 117 shown in FIG. 1 displays each item shown in FIG. 5, a setting registration button 181 and a cancel button 182. Of course, many mobile terminal devices 100 represented by mobile phones cannot display these display contents at a time. Therefore, in the case of a display having a relatively small display area, it is possible to make changes that are normally performed, such as displaying them by scrolling or displaying them in a hierarchical structure. In the case of the mobile terminal device 100 according to the present embodiment, the external output is set using a pull-down menu or a radio button. However, this is changed as appropriate according to the type of the mobile terminal device 100 and the like. Of course you can.

  On the external output setting screen of the display 117, an item for specifying “output means” is displayed as (1). The user 161 selects either “connector” as the external connection unit 118 or “wireless” as the second wireless unit 109 with a radio button. In the case of the example shown in FIG. 3, “wireless” is selected.

  Next, the user 161 performs new registration or update registration processing of the “external output device”. Communication with the corresponding external output device is performed in accordance with the selection of “output means” in (1), and the ID (Identification) of the external output device is displayed in the external output device ID column 183. . In this example, since “wireless” has been selected as the “output unit” in (1), the mobile terminal device 100 operates the second wireless unit 109 to be in the vicinity and enter a wireless standby state. Wireless communication with the viewing device 168. As a result, the “first wireless device ID” acquired from the viewing device 168 is displayed in the external output device ID column 183 as identification information. The “first wireless device ID” may display not only the original ID but also information such as the manufacturer, model number, or nickname of the external output device. As a result, the user 161 can easily confirm the external output device to which the visual information is to be output. Such display of information can be easily realized by the user 161 or the manufacturer of the mobile terminal device 100 associating it with a table (not shown) together with the identification information.

  Unlike the above example, for example, when a “connector” is connected as the “output unit” in (1), the mobile terminal device 100 communicates with an external output device (not shown) connected to the external connection unit 118 (FIG. 1). To obtain the ID. Then, for example, the identification information is displayed in the external output device ID column 183 as “first connector device ID”.

  When “wireless” is selected as the “output unit” and the mobile terminal device 100 includes a plurality of wireless communication units as the second wireless unit 109, the wireless units 100 are arranged in a predetermined order. The communication means tries to communicate with surrounding external output devices. As a result, if, for example, an external output device that communicates with a wireless LAN and an external output device that communicates with Bluetooth happen to be in a state of waiting for communication, the external output device ID field 183 displays the respective external outputs. A plurality of device IDs are displayed. In this case, the user 161 selects only one external output device from which viewing data is to be externally output.

  When the identification information is displayed in the external output device ID column 183 in this way, the control unit 104 searches the viewing data setting unit 154 shown in FIG. 2 to set the viewing device 168 having the same identification information in the past. If it has been read, this is read, and the display of each radio button is reflected for each subsequent item. If the external output form specified by these display contents is adopted, the user 161 may press the “setting registration” button 181 as it is (step S207 in FIG. 4: Y). Thereby, the setting content is overwritten and saved as the setting content corresponding to the identification information in the viewing data setting unit 154 (step S208), and is sent to the viewing data composition unit 121 and the viewing data selection unit 122 as setting data 155. The external output device is set (step S209).

  On the other hand, as a result of searching the viewing data setting unit 154 when the identification information is displayed in the external output device ID column 183, when the viewing device 168 having the same identification information has not been set in the past, Settings for items after (3) in FIG. 5 are performed. Thereafter, the “setting registration” button 181 is pressed (step S207: Y). Even if the viewing device 168 has been set in the past, if a part of the setting content is changed during the current viewing, the necessary items among the items after (3) in FIG. 5 are corrected. Thereafter, a “setting registration” button 181 may be pressed.

  Next, each setting item will be briefly described. In the item “remaining battery level” in (3) of FIG. 5, a setting is made as to whether or not to display the remaining battery level mark 506 shown in FIG. When the “Display when battery level is low” radio button is selected as shown in the figure, the battery level mark 506 is not displayed on the viewing device 168 when the battery level is not low, but the battery level is low. Only when this happens, the remaining battery level mark 506 is displayed. Thereby, it is possible to prevent the occurrence of a problem that the user 161 does not notice until the mobile terminal device 100 suddenly stops operating. On the other hand, in a state where the mobile terminal device 100 is operated in a state where power is supplied from a power supply device (not shown), the user 161 can select “not display”.

  In the item “Radio wave intensity” of (4), whether or not to display the reception level mark 505 shown in FIG. 12 on the output viewing device 168 is set. Here, in consideration of the environment of viewing at the party venue 167, the radio field intensity is not displayed.

  In the “Received mail” section of (5), when the electronic mail is received in a state where the original viewing data is being output to the viewing device 168, it is set whether or not the viewing device 168 itself performs the notification. Is called. As shown in the figure, when “notify all at once” is selected, it is confirmed that the mail has been received using the viewing device 168 regardless of whether it is registered in the address book 141 shown in FIG. It is never output.

  On the other hand, when “collective notification” is selected, regardless of whether or not the sender is registered in the address book 141 when an e-mail is sent to the mobile terminal device 100. Information that can be notified is output to the viewing device 168. When “notify all at once” is selected, the range of the details at which the e-mails are notified all at once can be similarly selected by radio buttons. For example, as shown in FIG. 12, if the viewing apparatus 168 does not want to output the image 508 registered by the sender who sent the e-mail, the radio button may be checked in the details of “Registered image”. Similarly, when the sender's name 509 such as “Mai-ke” is not displayed, the radio button is checked in the detail of “Name”. Note that if the radio button is checked in the detail of “sound”, it is possible to prevent the viewing device 168 from outputting a sound notifying the reception of the mail. Also, unlike this example, a radio button may be checked for the details to be output.

  Next, “individual notification setting” for received mail will be described. When a very important e-mail is scheduled to be received from a specific person, the receiving device 168 can receive the e-mail from the specific person even if the notification of e-mail reception from other persons is ignored. It is necessary to notify with. In such a case, “individual notification setting” is performed. When the “individual notification setting” radio button is selected, the control unit 104 reads the names registered in the address book 141 and the data of the e-mail addresses and displays a pop-up window (not shown) on the display 117. The user 161 may select an e-mail transmission source to be notified from among them. Therefore, an e-mail transmission source that is not registered in the address book 141 is not a target of notification of “individual notification setting”.

  In the “incoming call (call)” section of (6), settings are made when a call is made while viewing data is being output to the viewing device 168. When “collective non-notification other than own terminal” is selected, output in which viewing data is output by viewing data selection unit 122 when mobile terminal device 100 of user 161 has a call function like a mobile phone. When the device selection is set, the mobile terminal device 100 is notified by a ringing tone or the like, but the viewing device 168 is not notified of the incoming call by sound or text. About the form of notification on the mobile terminal device 100 side, a unique setting in the mobile terminal device 100 itself such as only sounding a buzzer is possible.

  When the “received signal batch off” is selected, the incoming call itself is not performed as in the case where the mobile terminal device 100 is powered off. In the case where the output of viewing data to the viewing device 168 is performed by an important customer, and it is not possible to make a call, the mobile terminal device 100 may be normally turned off. However, when the mobile terminal device 100 is used as an output device for the viewing device 168, the power cannot be turned off. Therefore, in such a case, “reception batch off” is selected with a radio button.

  The “individual notification setting” can also be performed in the “incoming (call)” section. When “individual notification setting” is performed, the telephone number of the transmission source is checked when a call is made, and the target of notification of the viewing device 168 only for the telephone number of the telephone number that is permitted to receive (call). And At this time, the form of notification such as whether the notification is performed only on the display screen 169 or by sound using the speakers 170 and 171 can be freely selected from a pop-up menu (not shown).

  When each item displayed on the display 117 is selected, or when the mobile terminal device 100 can be set with the displayed content, the user 161 selects a “setting registration” button. On the other hand, when it is not necessary to set the setting content displayed on the display 117 in the viewing data setting unit 154 (FIG. 2), the user 161 selects the “Cancel” button. In this case, the viewing data setting unit 154 holds the content set immediately before, and the viewing data composition unit 121 and the viewing data selection unit 122 are controlled by this content.

  FIG. 6 shows how the mobile terminal device is controlled when an e-mail arrives from the outside or a phone call is made while viewing data is being output. When the user 161 shown in FIG. 3 is ready for viewing, the user 161 operates the operation unit 111 shown in FIG. 1 to set the mobile terminal device 100 to the “external output mode” and further instructs the start of external viewing. When the control unit 104 detects this instruction, it determines the start of external viewing (step S221: Y), and the setting content corresponding to the identification information of the viewing device 168 currently set from the viewing data setting unit 154 is essentially the main content. The additional data permitted to be output is combined with the viewing data output from the speaker 116 or the display 117 by the viewing data combining unit 121, and these are externally connected to the second wireless unit 109 via the viewing data selection unit 122. The corresponding one of the units 118 is output (step S222). For example, if “display when battery level is low” is set for the remaining battery level as shown in FIG. 5, the display mark is displayed on the display screen 169 of the viewing device 168 until the remaining battery level is low. Will not be displayed.

  In the output state of step S222, the control unit 104 monitors whether an incoming call for calls or an e-mail is received (steps S223 and S224). If an incoming call for a call is detected (step S223: Y), the additional information permitted to be output when the incoming call is received for this call is added to the original viewing data, and is output from the output means to the viewing device 168. It will be output (step S225). For example, as shown in FIG. 5, if the state is “not notified collectively except for the mobile terminal device 100 as a receiving terminal”, the image and sound accompanying the incoming call such as a ringing tone at the time of incoming call can be viewed. The data synthesizer 121 does not synthesize the viewing data, and therefore, the additional information is not reproduced by the viewing device 168.

  On the other hand, for example, if “collective notification” is selected and “phone number” and “sound” are selected as notification targets, the speaker 170 of the viewing device 168 is received at the time of the incoming call. , 171, and the telephone number of the incoming call is displayed on a part of the display screen 169 as text information. If the setting content permits the output of an image or sound from the mobile terminal device 100 simultaneously with the viewing device 168, the corresponding image data is output in parallel from the display 117, and the sound data is output from the main speaker 116. Will be output in parallel. For example, when a call is made in a state where viewing data distributed from the rental server 163 of FIG. 3 and stored in the mobile terminal device 100 is output to the viewing device 168, the viewing data is output to the viewing device 168 according to the setting contents. In this state, the user 161 can make a call with the other party. At this time, the contents of the call, the ring tone, or the name of the other party can be prevented from being output to the viewing device 168 depending on the setting contents.

  When the control unit 104 detects the reception of the e-mail in the output state of step S222, the additional information permitted to be output at the time of receiving the e-mail is added to the original viewing data, and the viewing unit 168 receives the output from the output unit. (Step S226). For example, as shown in FIG. 5, if it is in a state of “not notified collectively except for the mobile terminal device 100 as a receiving terminal”, a notification sound accompanying reception of an e-mail, an image or sound accompanying reception, and the like. The viewing data synthesizing unit 121 does not synthesize the viewing data, and thus the additional information is not reproduced by the viewing device 168.

  In contrast, for example, it is assumed that “collective notification” is selected and “mail address” and “registered image” are selected as notification targets. In this case, the e-mail address of the sender is displayed as text information on a part of the display screen 169 of the viewing device 168, and an image 508 registered for the sender is also displayed as shown in FIG. If the setting content permits the output of an image or the like from the mobile terminal device 100 at the same time as the viewing device 168, the corresponding image data is output in parallel from the display 117, and the sound data is the object of notification. If it is selected, it will be output from the main speaker 116 in parallel. In addition, when “individual notification setting” is selected, only when an e-mail from the specified specific person is received, the information set by the person is displayed as a part of the display screen 169 of the viewing device 168. In the case of display or sound, the set information is output from the speakers 170 and 171.

  As described above, when the process at the time of receiving a call or receiving an e-mail is performed (steps S225 and S226), the control unit 104 (FIG. 1) determines whether an instruction to end external viewing is given. (Step S227). If the instruction to end the external viewing is not given (N), the process returns to step S222, and information obtained by adding the permitted additional information to the viewing data other than when a call is received or when an e-mail is received is output to the viewing device 168. Will be. If an instruction to end external viewing is given in step S227 (Y), the processing in the external output mode is ended (END).

  In the embodiment described above, when the portable terminal device 100 outputs viewing data to other output means, the identification information of the output means is acquired in advance and the output content is set. For this reason, when viewing data is output to the same output means (for example, the viewing device 168 shown in FIG. 3), when viewing data is viewed with the additional information limited under the same conditions as before, You do not need to set this limit on Even if the viewing conditions are slightly different from the previous conditions, it is only necessary to read out the previous conditions for viewing and make corrections. Can be set. Therefore, viewing using an external output device in a form that matches each condition is possible, and powerful images and sounds can be reproduced.

  Further, in this embodiment, the user 161 borrows the rental server 163 from the Internet 162 and stores viewing data such as moving family videos and still images accumulated therein. Therefore, if the portable terminal device 100 that can access the rental server 163 is possessed, the viewing data can be output to an external output device installed at any location without carrying around the viewing data. Of course, various viewing data received from the Internet 162 or the mobile communication network 165 without going through the rental server 163 may be sent to these external output devices as they are.

  <First Modification of Invention>

  In the embodiment described above, the output contents are set for each external output device. However, the external output device is classified into several categories, and the output of video signals and sounds is limited for each category. May be.

  FIG. 7 shows a part of the identification information / device classification correspondence table showing the correspondence between the identification information of each external output device and the device classification in the first modification of the present invention. In the column of “external output device” in the identification information / device classification correspondence table 301, an external output device ID as identification information of the output means connected by wire or wireless is written. Further, in the “device classification” column, the contents of the restriction on the output with respect to the video signal and the sound are classified into several device classifications such as [1], [2], and [3]. In the “Remarks” column, a memo is written about how each external output device is used. For example, when the “external output device” is “TV-XXX”, the “device classification” is [1], and it is mainly assumed that the family watches at home. On the other hand, when the “external output device” is “TV-YYY”, the “device classification” is [2], which is when viewing data is output for work on the television set in the company. It is assumed that it will be used for Therefore, in general, when the data from the mobile terminal device is output to the former “TV-XXX”, the output restriction of the additional information is not strict.

  FIG. 8 is an example of an output content table for each external output device showing the output content of the external output device in each device classification when the mobile terminal device of the first modified example receives a call or email. Represents a part. Such an output content table 302 for each external output device is similar to the identification information / device classification correspondence table 301 shown in FIG. 7, and viewing data setting as a nonvolatile memory area of the RAM 103 shown in FIG. It may be stored in the unit 154.

  In the output contents table 302 for each external output device, the name of a member such as “Takeshi” is written in the “Name” column. In the “group” column, a set to which these members belong is described. For example, a case where a plurality of members form a group such as members of “company” or members belonging to the same private “circle” is called “group”. The handling of these “groups” and the respective external output devices does not necessarily match. For example, “Mai-ke” and “Jon” belong to the same 15th group, but the contents in [1] of “Device classification” are different. This is an example of when each member makes a call or sends an e-mail and the handling is different even within the same group. The same group settings are set as a group (the same setting). You may make it do.

  In the “telephone number / mail address” column, the telephone number and e-mail address of each member are written. “Image (file name)” is an image representing each member, and corresponds to an icon representing each member registered in the icon registration unit 148 of the previous embodiment. The column of “external output device information output” corresponds to “device classification” such as [1], [2], and [3]. For example, when a call is made from “Takeshi” when a connection is made to an external output device whose device classification is [1], only the telephone number is displayed on the display of the external output device. When an e-mail is received, a notification that it has been received is displayed on the display of the external output device. On the other hand, similarly, when a call is made from “I can do it” when connection is made to an external output device whose device classification is [1], as shown in FIG. The image is displayed on the display of the external output device. In addition, when an e-mail is received, the name and image of “Mai-ke” are displayed on the display.

  FIG. 9 shows the flow of processing when a call is received in this modification. This will be described with reference to FIGS. In addition, in order to distinguish the portable terminal device of this modification from an Example, it describes as 100 A of portable terminal devices. The control unit 104 monitors incoming calls for calls (step S321). If there is an incoming call (Y), it is checked whether the mobile terminal device 100A is outputting viewing data to the external output device (step S322). If not outputting to the external output device (N), the incoming call is notified by outputting the incoming call information to the main speaker 116 and the display 117 shown in FIG. 1 inside the portable terminal device 100A (step S323).

  On the other hand, when viewing data is being output to the external output device (step S322: Y), the caller number of the telephone is acquired (step S324), and the ID is acquired from the external output device being output. The device classification is determined using the identification information / device classification correspondence table 301 (step S325). Then, the output contents table 302 for each external output device is searched to read out the corresponding “incoming” contents (step S326). If the content of the corresponding “incoming call” exists and can be read (step S327: Y), an incoming call notification using an external output device is performed with the indicated content (step S328). For example, as described above, when a call is made from “Takeshi” when the connection is made to the external output device whose device classification is [1], only the telephone number is displayed on the display of the external output device. When a call is made from “Jon” when connection is made to an external output device with the same device category [1], notification of an incoming call using the external output device is not performed. Become.

  When viewing data is being output to an external output device when an incoming call is received, and the external output device is checked, it may not correspond to any of the device categories registered in the identification information / device category correspondence table 301 . In addition, even if it corresponds to one of the device categories, the caller may not be registered in the output content table 302 for each external output device. For these reasons, when the search of the output content table 302 for each external output device fails in step S327 (N), in this modification, the process ends without notification of an incoming call using the external output device (end). ). This is to prevent viewing by an external output device from being hindered on the assumption that there are many situations in which there is no particular need for notification that an erroneous call has been made. Of course, the user can change the contents of the incoming notification in this case.

  FIG. 10 shows the flow of processing when an e-mail arrives in the first modification. This will be described with reference to FIGS. The control unit 104 monitors reception of an email (step S341). If the electronic mail is received (Y), it is checked whether the mobile terminal device 100A is outputting viewing data to the external output device (step S342). If it is not outputting to the external output device (N), the reception of the e-mail is notified by outputting the incoming information to the main speaker 116 and the display 117 shown in FIG. 1 inside the mobile terminal device 100A (step S343).

  On the other hand, when viewing data is being output to the external output device (step S342: Y), the sender number of the e-mail is acquired (step S344), and the ID is acquired from the external output device being output. Then, the device classification is determined using the identification information / device classification correspondence table 301 (step S345). Then, the output content table 302 for each external output device is searched to read the content of the corresponding “mail” (step S346). If the content of the corresponding “mail” exists and can be read (step S347: Y), an email reception notification using the external output device is performed with the content indicated (step S348). For example, as described above, when an e-mail is sent from “Takeshi” when a connection is made to an external output device whose device classification is [1], only an indication that the e-mail has been received is displayed on the outside. Displayed on the output device display. If an e-mail is sent from “Jon” when a connection is made to an external output device with the same device category [1], the notification of e-mail reception using the external output device is Will not be done.

  When viewing data is being output to an external output device when an e-mail is received, and the external output device is checked, it does not correspond to any of the device categories registered in the identification information / device category correspondence table 301 There is a case. In addition, even if it corresponds to one of the device categories, the sender of the e-mail may not be registered in the output content table 302 for each external output device. For these reasons, when the search of the output content table 302 for each external output device fails in step S347 (N), in this modification, the process ends without notification of reception of the e-mail using the external output device. (End) This is to prevent viewing by an external output device under the assumption that in such cases, notification of reception such as spam mail is often unnecessary. Of course, it is possible for the user to change the contents of the notification by receiving the e-mail in this case.

  <Second Modification of Invention>

  FIG. 11 corresponds to FIG. 3 and shows a viewing system as a second modification. In the viewing system of the second modified example, in addition to reproducing video and sound with the large viewing apparatus 168 shown in FIG. 3, the odor output provided with the odor selection unit 401 and the reception unit 402 that receives the data to be selected. The device 403 outputs an odor 404 according to the odor reception data. Further, the seat 406 on which the user 161 sits is provided with a vibration generating device 408, which applies vibration based on the vibration information received by the receiving unit 409. The scent output device 403 contains a plurality of chemical substances or natural substances that are the source of the scent (not shown) inside, and decodes the scent received data and takes them out alone or in combination to blow. Thus, a plurality of types of predetermined odors can be selectively output to the user 161.

  When the mobile terminal device 100B receives the sensory data 411 as data from a server (not shown), the mobile device 100B can reproduce only the video data and the sound data. However, by transmitting the viewing data demodulated separately from the sensory data 411 to the viewing device 168 as an external output means, the video data and the sound data are converted into a large-screen stereo sound (or 5.1 channel surround sound). Can be reproduced. Similarly, by transmitting odor data separated and demodulated from the sensory data 411 to the odor output device 403, in conjunction with the scene being reproduced by the viewing device 168, for example, the smell of a refreshing tree in the forest, etc. Can be reproduced. Similarly, by transmitting the vibration data separated and demodulated from the sensory data 411 to the seat 406, it is possible to experience vibration associated with the scene being reproduced.

  As shown in the second modification, the external output means does not have to be a single means, and may be a combination of a plurality of means. Also, it is not always necessary to send sensory data to the external output device in a manner that restricts various human senses. Conversely, sensory data that cannot be reproduced by the sending device may be sent to the external output device for reproduction. There may be. As a result, not only images and sounds but also more senses can be given to the user to increase the force at the time of reproducing the sense data. Also, when an e-mail is received, a specific seat previously associated with the user 161 is vibrated so that other viewers can be notified of the fact that the e-mail has been received without disturbing other viewers. It is also possible to take a technique.

  In the embodiment and the modified example, the reproduction of viewing data or sensory data captured from the outside such as a server has been described. However, an image or sound acquired by an output device such as a mobile terminal device by the camera unit 115 (FIG. 1), for example. Of course, the present invention can be similarly applied to the selection of various data when the data is output to the external output device.

It is a block diagram showing the structure of the portable terminal device as a data output device in one Example of this invention. It is the block diagram which showed the circuit part regarding the process of viewing-and-listening data in the portable terminal device of a present Example. It is a system configuration | structure figure showing the viewing-and-listening system which has output viewing-and-listening data to the large sized viewing-and-listening device in a party hall using the portable terminal device of a present Example. It is a flowchart showing the mode of the setting at the time of outputting to the external viewing-and-listening apparatus wirelessly the viewing-and-listening data received in the portable terminal device in this Example, or once received. It is the top view of the display which showed the display content of the external output setting screen in a present Example. 6 is a flowchart illustrating control of the mobile terminal device when an e-mail arrives from outside or a phone call is made while viewing data is being output in the embodiment. It is explanatory drawing which shows the principal part of the identification information and apparatus classification correspondence table in the modification of this invention. It is explanatory drawing which shows the principal part of the output content table classified by external output apparatus in the 1st modification of this invention. It is a flowchart showing the process when the telephone call arrives in the 1st modification of this invention. It is a flowchart showing the process when an electronic mail arrives in the 1st modification. It is a system configuration figure showing a viewing-and-listening system as the 2nd modification of the present invention. It is the front view which showed an example of the image | video displayed when the video signal output from a mobile telephone terminal is input into a television as it is.

Explanation of symbols

100 Mobile terminal device (data output device)
101 CPU
102 ROM
DESCRIPTION OF SYMBOLS 104 Control part 109 2nd radio | wireless part 113 Call speaker 114 Microphone 116 Main speaker 117 Display 118 External connection part 121 Viewing data synthesizing part 122 Viewing data selection part 136 Additional information generation part 154 Viewing data setting part 168 Large viewing apparatus ( External output device)
169 Display screen 172, 402, 409 Receiver 301 Identification information / device classification correspondence table 302 Output content table for each external output device 403 Odor output device (external output device)
406 Seat (external output device)
411 Sensory data

Claims (16)

Internal output means for outputting a part or all of sensory data for stimulating various human senses such as images to a built-in output device;
An external output means for outputting a part or all of the sensory data to an external output device;
Sensory data type correspondence setting means for setting a correspondence relationship between types of sensory data to be output when outputting the sensory data to the internal output means and the external output means;
A data output apparatus comprising: a sensory data type selection unit that selects a type of sensory data output from the internal output unit and the external output unit according to the setting contents of the sensory data type correspondence setting unit. An internal output means for outputting all sensory data that stimulate various human senses such as video to a built-in output device;
An external output means for outputting a part or all of the sensory data to an external output device;
Sensory data type correspondence setting means for setting a correspondence relationship between types of sensory data to be output when outputting the sensory data to the internal output means and the external output means;
A data output device comprising: a sensory data type selection unit that selects the type of sensory data according to the setting contents of the sensory data type correspondence setting unit when outputting the sensory data only from the external output unit.   3. The data output device according to claim 1, wherein the output of the internal output means and the external output means is alternatively selected.   The data output apparatus according to claim 1 or 2, wherein the internal output means and the external output means output the sensory data in parallel in time.   3. The data output device according to claim 1, wherein the sensory data includes at least image data for stimulating vision and sound data for stimulating hearing.   3. The data output device according to claim 1, wherein the sensory data includes at least odor data that stimulates olfaction.   3. The data output device according to claim 1, wherein the sensory data includes at least vibration data for detecting vibration.   Call data transmission / reception means for transmitting / receiving call data, and incoming call detection means for detecting an incoming call from the other party of the call, wherein the sensory data type correspondence setting means receives an incoming call out of the sensory data output from the external output means 3. The data output device according to claim 1, wherein a correspondence relationship between the types of sensory data is set so as to limit notifications associated with the data.   An e-mail receiving means for receiving e-mail; and an e-mail reception detecting means for detecting reception from the other party of the e-mail transmission, wherein the sense data type correspondence setting means is a sensation output from the external output means. 3. The data output apparatus according to claim 1, wherein the correspondence relationship between the types of sensory data is set so as to limit notifications associated with reception of electronic mail among data.   An external output device type discriminating unit for discriminating the type of the external output device to be output by the external output unit, and the sensory data type correspondence setting unit is configured to output the sensory data according to the type of the external output device. The sensory data type selection means selects the type of sensory data output from the external output means according to the type of the output device. The data output device according to claim 1 or 2.   The external output device to be output by the external output means is classified into a plurality according to the restriction contents accompanying the selection of the sensory data type selection means, and the sensory data type correspondence setting means is an external output device. Correspondence between types of sensory data to be output when outputting the sensory data according to the classification is set, and the sensory data type selection means outputs from the external output means according to the classification of the partial output device 3. The data output device according to claim 1, wherein a type of sensory data to be selected is selected.   A connection presence / absence determining means for determining whether or not the external output means is connected to the external output means when receiving an incoming call, and the sensory data type selecting means selects a type of sensory data output from the external output means 3. The data output device according to claim 1, wherein the data output device is a data output device.   13. The data output device according to claim 12, wherein the connection determined by the connection presence / absence determining means is wired.   13. The data output apparatus according to claim 12, wherein the connection determined by the connection presence / absence determining means is wireless. A playback device determination step for determining whether part or all of sensory data that stimulates various human sensations such as video is played back on the own device or transferred to an external output device and played back on the external output device;
A type determining step for determining the type of the external output device of the transfer destination when it is determined in this reproducing device determining step that the data is transferred to the external output device for playback;
A selection step of selecting sensory data that can be transferred among the sensory data in relation to the type of external output device determined in the type determination step;
A data output method comprising: an output step of outputting sensory data selected as transferable in the selection step to the external output device.   16. The data output method according to claim 15, wherein in the selection step, selection of information relating to reception of the information that is the basis of the sensory data is performed.

Images