JP2011154411A - Document data generating device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily attach an image obtained by imaging, without depending on a mail format. <P>SOLUTION: A mobile communication terminal selects the mail format before generating a mail, and then, performs control to continuously shoot images for a certain period of time during the generation of the mail. After the continuous imaging, when the format of the mail under generation is the mail format by hypertext, an animation file of a GIF format is generated based on the continuously shot images, and attached to a mail content under generation, and also description is made so as to display in line the animation file generated at the position of a current cursor. When the format of the mail under generation is the mail format by plain text, the continuously shot images are defined as frames, thereby compressing and encoding the respective frames by an encoding system based on the encoding system of an MPEG-4 format. Then, the animation file is generated and attached to the mail under generation. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a document data generation apparatus and a program for generating a mail text such as an e-mail as a document, and more particularly to a technique for attaching data based on the captured image described above.

Conventionally, a highly expressive electronic document is created using a description language that describes the logical structure and appearance of a sentence together with a display document, represented by HTML (Hyper Text Markup Language), and this is created as an e-mail message. There is a technology for transmitting as content.
In recent years, there is an electronic mail creation function in a communication terminal such as a mobile phone having a document creation function using the above description language.
Specifically, the above communication terminal employs a technique for decorating an electronic document displayed by inserting an image file in a GIF (Graphics Interchange Format) format stored in advance in the document, and improving the display contents. (For example, refer to Patent Document 1).
On the other hand, for the purpose of enhancing the expressive power of electronic documents, a short-time video file photographed with a built-in camera is attached to a plain text document (for example, see Patent Document 2), or pictograph icons. Has also been adopted (see, for example, Patent Document 3).

JP 2004-310352 A JP 2004-201191 A JP 2005-346252 A

As described above, there are two types of e-mail formats in the communication terminal: a plain text format and a hypertext format using a description language such as HTML, and a decoration method according to the format is used.
However, since these two formats look similar on the display to the user of the communication terminal, it is not easy to determine what decoration is possible or impossible when generating a mail document. In particular, when attaching a still image or a moving image acquired by imaging processing, there is a problem that it is difficult to determine what attachment method is desirable.

  The present invention has been made in view of the above-described problems, and an object thereof is to easily attach an image acquired by imaging without depending on a document format.

  In order to achieve the above object, the invention described in claim 1 is a setting means for setting a format of a document to be generated, an imaging means, and an imaging control means for controlling the imaging means to continuously take images. If the document format set by the setting means is a format using a description language that describes the logical structure and appearance of the sentence together with the display document, an animation file is generated from the continuously captured images. First generating means for generating a moving image file from the continuously captured images when the format of the document set by the setting means is a plain text format; And a control means for controlling to attach the one generated by the second generation means to a document to be generated.

  In order to achieve the above object, the invention described in claim 2 includes a setting unit that sets the format of a document to be generated, an imaging control unit that controls the imaging unit to continuously capture images, When the format of the document set by the setting means is a format using a description language that describes the logical structure and appearance of a sentence together with a display document, an animation file is generated from the continuously captured images. If the format of the document set by the setting unit is a plain text format, a second generation unit that generates a moving image file from the continuously captured images, the first generation unit Alternatively, the second generation means functions as a control means for controlling to attach to the document to be generated.

  According to the present invention, an image acquired by imaging can be easily attached without being influenced by the document format.

It is a figure which shows the circuit structure of the portable communication terminal to which this invention is applied. It is a figure which shows the memory content of a program memory notionally. It is a flowchart which shows the process of mail preparation mode. It is a figure which shows the state of the captured image continuously shot. It is a figure which shows the display content of a display part. It is a figure which shows the display content of a display part.

Hereinafter, embodiments to which the present invention is specifically applied will be described in detail.
FIG. 1 shows a circuit configuration of a mobile communication terminal having an imaging function to which the present invention is applied. In the figure, the mobile communication terminal includes a control unit 1 that controls the entire circuit, and a program memory 2, a signal processing unit 5, an audio processing unit 8, an imaging processing unit 11, a display control unit 13, The key input unit 14 and the memory 15 are electrically connected to each other via the bus 100.
The program memory 2 stores a program executed by the control unit 1 for operating the mobile communication terminal. More specifically, as shown in FIG. 2, a storage unit (an imaging processing program storage unit 201, an image processing program storage unit 202, a hypertext for storing various programs for causing the control unit 1 to execute each configuration of the present invention. In addition to a format mail editing program storage unit 203, a plain text format mail editing program storage unit 204, and a communication processing program storage unit 205), a storage unit 206 for storing other programs is included. The program stored in them is read based on the above.
Note that FIG. 2 is shown to facilitate understanding of the configuration of the present invention, but the execution contents of the various programs may be included in the execution contents of the program stored in the program memory 2. .

  The wireless communication unit 4 transmits / receives a wireless signal from the antenna 3 under the control of the signal processing unit 5 and performs primary modulation / primary demodulation processing by a predetermined wireless modulation / demodulation method such as a CDMA method. The signal processing unit 5 modulates audio data, mail data (document data), animation GIF file, and moving image file digitally processed by the CELP method input via the bus 100 according to the control of the control unit 1 by the QPSK method. The data input to the wireless communication unit 4 is demodulated, and the data input from the wireless communication unit 4 is demodulated and output to the bus 100. The sound processing unit 8 performs CELP coding on the sound input via the microphone 6 and outputs the sound, while converting the CLEP encoded data input from the bus 100 into a sound signal and outputs the sound signal from the speaker 7.

  The imaging unit 10 includes an image capture device composed of CMOS or CCD, a DSP, and the like, and digitally processes an image formed through the imaging lens 9. The imaging processing unit 11 performs drive control of the image capture device of the imaging unit 10 (specifically, continuous reading processing related to continuous shooting and the like) and outputs a digitized captured image to the bus 100. The display unit 12 displays various data (email data, animation GIF, moving image) through the display control unit 13 under the control of the control unit 1.

The operation unit key input unit 14 includes a numeric keypad 141 for detecting input of characters and alphanumeric characters in addition to designation of a telephone number to be transmitted, and a cursor key for detecting designation of a current cursor position in a mail creation mode described later. 142, and a determination key 143 for detecting various determinations, image capturing and storage instructions.
The memory 15 is used as a working memory (application heap) when the control unit 1 executes various programs stored in the program memory 2, and stores still image files, moving image files, and animation files acquired by imaging. In addition, it also stores various downloaded data.

FIG. 3 is a flowchart showing a mail creation mode process executed by the mobile communication terminal.
First, when the mobile communication terminal detects power-on, it reads out the program from the communication processing program storage unit 204 stored in the program memory 2 and executes it, and performs negotiation processing and communication processing with the external wireless communication network. Suppose you are going.
When the mail creation mode is started, first, as a generated document, a selection screen that prompts the user to select whether the mail format to be created is a plain text format or a hypertext format is displayed (step S01). Then, by detecting the operation of the cursor key 142 and the enter key 143 of the key input unit 14 in response to this display, it is determined whether the selection of either the plain text format or the hypertext format is detected. (Step S02).

If any format is not detected, the process returns to the process of step S01. On the other hand, if any format is detected, information indicating the selected mail format is set as a setting content in a predetermined storage area of the memory 15. Temporarily stores and holds (step S03).
Then, after storing and storing in step S03, the control unit 1 is detected by selection detection in step S02 of the hypertext format mail editing program storage unit 203 or the plain text format mail editing program 204 in the program memory 2. One editing program is read and executed, and the creation screen is displayed on the display unit 12 (step S04).

Thereafter, by detecting the operation of the numeric keypad 141, the cursor key 142, and the enter key 143 by the user, the electronic document that is the content of the mail is input and the mail is created (step S05), and the mail is further created. It is determined whether or not a process end instruction has been detected (step S06).
Of the emails created by this process, in the hypertext format, not only text input, but also text and background color editing, text font size change, text scrolling, blinking, layout change, etc. , And can be arbitrarily edited with contents that can be specified by a tag in the Html format.

If a mail creation end instruction is detected in step S06, it is determined in step S20 whether or not a mail creation end instruction has been detected. If no mail creation end instruction is detected, key input is further performed. It is determined whether a moving image shooting instruction has been detected by detecting a predetermined operation on the unit 14 (step S07).
When the moving image shooting instruction is not detected, the process proceeds to step S04. However, when the moving image shooting instruction is detected, the control unit 1 further reads out and executes the programs from the imaging processing program storage unit 201 and the image processing program storage unit 202, respectively. Then, the imaging unit 10 and the imaging processing unit 11 are activated.
Then, the mail contents (electronic document) input / created are saved and saved in the temporary memory 15, and the imaging unit 10 is periodically driven to display the sequentially output captured images on the display unit 12. The imaging processing unit 11 and the display control unit 13 are controlled (step S08).

Then, in this live view display state, it is determined whether or not a shooting instruction has been detected based on whether or not the user's operation of the enter key 143 has been detected (step S09).
When the shooting instruction is not detected, the process returns to step S08. However, when the shooting instruction is detected, the imaging unit 10 and the imaging processing unit 11 continuously capture captured images by acquiring captured images. The process is started (step S10), and it is determined whether or not a certain time, which is a time corresponding to the capacity allowed to be attached to an e-mail, has passed (step S11).
If the predetermined time has not elapsed, it is determined whether or not a shooting end instruction has been detected by detecting the user's operation of the enter key 143 (step S12).

If the shooting end instruction is not detected in step S12, the process returns to the determination in step S11. If it is determined in step S11 that a certain time has elapsed, or if it is determined that the shooting end instruction is detected in step S12, the imaging unit 10 Then, the imaging processing unit 11 is instructed to end image capture (step S13), and information indicating the mail format temporarily stored in step S03 is read (step S14).
Thereafter, it is determined whether the information indicating the read mail format is a hypertext mail format or a plain text mail format (step S15). A GIF-format animation file is generated from the plurality of images (step S16).

FIG. 4 shows the concept of generating an animation file in step S16.
In the figure, it is assumed that there are five images 111 to 115 captured during steps S10 to S13. The images 111 to 115 include subject image areas A1 to A5 and the image area of the subject B in common, and a GIF-format animation file including five frames is generated from these five images. .

When the animation file is generated in step S <b> 16, the control unit 1 reads the mail data temporarily saved in the memory 15 and controls the display control unit 13 to display it on the display unit 12.
Then, according to the hypertext mail editing program, the animation file generated in step S15 is attached to the mail content being created as a GIF icon, and the animation file generated at the current cursor position is inline as an animation GIF icon. The display is described (step S17).

FIG. 5 shows a display mode of the display unit 12 in this case.
In the figure, the user is the email body.
"Hello!
I'm at the station now.
I will go there.
nice to meet you! "
In the process of generating the input, after creating up to "I am at the station now", finish the creation once and shoot the video, and then enter "I will go there" again Show.
In addition, e-mail address indicating the transmission destination of the mail to 121, the e-mail subject "Hello!" Is to 122, the file name of the file that is attached to this e-mail to 123 (animation file), and, to 124 Is the body of the email,
"Hello!
I'm at the station now.
I will go there.
nice to meet you! "
The contents 125 of the animation file are inserted and displayed as a GIF icon between “I am at the station now” and “I am going to go there”.

On the other hand, if it is determined in step S15 that the mail format is plain text, each frame is compressed and encoded by an encoding method compliant with the MPEG-4 format encoding method using a plurality of captured images as frames. And a moving image file is generated (step S18).
Then, according to the plain text mail editing program, the moving image file generated in step S18 is attached to the mail being created (step S19).

FIG. 6 shows a display mode of the display unit 12 in this case.
In the figure, e-mail address indicating the transmission destination of the mail to 121, the e-mail subject "Hello!" Is to 122, the file name of the file (video file), which is attached to this e-mail to 127 and, The mail text is displayed.
And after the process of step S17, S19, it transfers to step S04 again.
If a mail creation end instruction is detected in step S06, it is further determined whether a transmission instruction is detected (step S20).

  If the transmission instruction is not detected, the process proceeds to step S04. If the transmission instruction is detected, the mail body (including the attachment file if there is an attachment file) is transmitted to the input destination address. The antenna 3, the wireless communication unit 4, and the signal processing unit 5 are controlled (step S21), and this process is terminated.

  As described above, according to the present invention, whether to generate an animation file or a moving image file from a plurality of captured images is selected according to the selected and detected mail format. An image acquired by imaging can be easily attached.

In this embodiment, the mail format is determined based on selection detection before mail creation (document generation). However, the present invention is not limited to this. For example, a mail editing program executed before shifting to the imaging process However, the determination may be made based on whether the program is a hypertext format mail editing program or a plain text format mail editing program.
In the above case, since it is not necessary to set the mail format before creation, there is a merit that convenience is further improved.

  In the present embodiment, the case where the present invention is applied to a mobile communication terminal is illustrated. However, the present invention is not limited to this, and an animation file is generated from a plurality of images continuously captured by imaging or the like. As long as it is an embodiment using the above, it can be applied to various hardware, systems, and software such as computer software and network server systems.

DESCRIPTION OF SYMBOLS 1 Control part 2 Program memory 10 Imaging part 11 Imaging processing part 12 Display part 13 Display control part 125 Animation file 203 Hypertext format mail edit program memory | storage part 204 Plain text format mail edit program memory | storage part

Claims (2)

Setting means for setting the format of the document to be generated;
Imaging means;
Imaging control means for controlling the imaging means to continuously capture images;
When the format of the document set by the setting means is a format using a description language that describes the logical structure and appearance of a sentence together with a display document, an animation file is generated from the continuously captured images. 1 generating means;
When the format of the document set by the setting unit is a plain text format, a second generation unit that generates a moving image file from the continuously captured images;
Control means for controlling to attach the one generated by the first generation means or the second generation means to a document to be generated;
A document data generating apparatus comprising: Computer
Setting means for setting the format of the document to be generated,
Imaging control means for controlling the imaging unit to continuously capture images;
When the format of the document set by the setting means is a format using a description language that describes the logical structure and appearance of a sentence together with a display document, an animation file is generated from the continuously captured images. 1 generating means,
When the format of the document set by the setting unit is a plain text format, a second generation unit that generates a moving image file from the continuously captured images;
A program that functions as a control unit that controls to attach the one generated by the first generation unit or the second generation unit to a document to be generated.

Images