JP2004129278A - Camera - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a camera useful for computer processing and reproduction of image and transmission of image data at a high speed. <P>SOLUTION: This camera records a main image file, having main image data and a sub-image file containing a sub-image, which is a reduced image of the main image in a storing means, as separate files each. When recording, the main image file and the sub-image file can be distinguished by a file name extension attached to the main image file, and the sub-image file can be identified as a sub-image by an extension of the sub-image file. <P>COPYRIGHT: (C)2004,JPO

Description

The present invention relates to recording of image data with a camera having an image sensor.

Digital still cameras that record image data, audio data, control data, and the like as files on recording media such as IC memory cards, magnetic media (hard disks and floppy disks), and magneto-optical media have been put to practical use.

The digital still camera described above captures an image as image data, and can be easily processed by a computer and transmitted with image data. Therefore, the field of use of the digital still camera is expected to expand in the future. However, no specific technology that can contribute to particularly high-speed image reproduction processing and image data transmission has been proposed.

Therefore, an object of the present invention is to provide a camera useful for performing processing by a computer, high-speed image reproduction, and image data transmission.

(1) In order to solve the above problems, a camera according to the present invention includes an optical system for obtaining a subject image,
An image sensor that photoelectrically converts a subject image obtained through the optical system,
An imaging circuit that converts a subject image photoelectrically converted by the imaging element into an electric signal,
An A / D conversion circuit that converts an electric signal from the imaging circuit into digital data;
A coder for encoding the digital data converted by the A / D conversion circuit;
Storage means for recording image data encoded by the coder,
Has,
A main image file having main image data and a sub image file having a sub image composed of a reduced image of the main image are recorded in the storage unit as separate files,
A main image file and a sub-image file can be distinguished from each other by an extension of a file name attached to the main image file, and the fact that the file is a sub-image can be identified by an extension of the sub-image file and recorded. Is performed.

(2) A camera according to another aspect of the present invention includes:
The camera according to (1), wherein the sub-image is an image obtained by reducing the main image and performing compression.

(3) A camera according to still another aspect of the present invention includes:
The camera according to (1), wherein in recording the main image and the sub-image in the storage unit, the main image is stored in a separate file while the sub-image data is stored in a batch file.

According to the present invention, a main image file having main image data and a sub image file having a sub image composed of a reduced image of the main image are recorded in the storage means as separate files, respectively, and are attached to the main image file. Recording is performed such that the main image file and the sub image file can be distinguished by the extension of the file name, and that the file is a sub image can be identified by the extension of the sub image file.

As described above, in the camera according to the present invention, when performing processing and image data transmission by the computer, the file name and extension are added to the camera in advance so that the contents of the image file can be identified. When editing by copying or transmitting image data from a camera to a computer, etc., it is possible to easily understand the type of image simply by looking at its hierarchical structure and file name, and perform editing and classification. Significant work efficiency can be realized. Further, when only the sub-image can be reproduced without reproducing the main image, the speed of the processing can be increased. In the second aspect, since the sub-image is also a compressed image, the total amount of data can be reduced. Further, since the sub-image data is stored in a batch file, the processing can be sped up at the time of reproducing a so-called index image in which a plurality of reduced images are displayed in parallel on the screen, and the sub-image data is collectively collected. Because it can be copied, moved or deleted, it is useful when editing.

Next, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a configuration block diagram showing an application example of an image handling apparatus according to the present invention to a digital still camera.
The subject image is converted into an electric signal via an optical system (lens) 1 by an imaging circuit 2 having an imaging device such as a CCD, which is a photoelectric conversion unit. The converted electric signal is subjected to a predetermined clamping process in the clamp circuit 3, converted into digital data in the A / D conversion circuit 4, and written into the frame memory 11. Writing and reading of the frame memory 11 are controlled by the memory controller 10 under the control of the system controller 16. The image data read from the frame memory 11 is digitally processed by the digital process circuit 5 together with the character data sent from the character generator 9, and then converted into an analog signal by the D / A conversion circuit 6. The converted analog image signal is supplied to the external terminal EXT and the electronic viewfinder 8 after being amplified by the amplifier circuit 7.

At the time of data recording, image data read from the frame memory 11 is orthogonally transformed by a DCT / IDCT (discrete cosine transform / inverse discrete cosine transform) circuit 12, and the obtained orthogonal coefficients are encoded by a coder / decoder 13. Compression processing is performed by a compression method conforming to the JPEG method or the like. The image data compressed in this way is recorded on the IC memory card 15 as storage means. Here, the memory card may be detachable from the apparatus main body, or may be built in and fixed in advance.

At the time of reproduction, the image data read from the IC memory card 15 is subjected to decompression processing through the processing of the coder / decoder 13 and the DCT / IDCT circuit 12, and is written to the frame memory 11. The image data read from the frame memory 11 is output to an external terminal EXT and an electronic viewfinder 8 via a digital process circuit 5, a D / A conversion circuit 6, and an amplification circuit 7.

(4) The system controller 16 exchanges data via the data bus B1, and controls the entire operation of the camera. For example, it controls the display on the display unit 17 composed of an LCD or the like, and controls the camera operation based on operation information from the operation unit 18. The system controller 16 also controls the character generator 9 to control desired character information output, and controls communication with the outside via the data bus B2 and the data input / output unit 19. The auxiliary memory 14 is a work memory used for various data processing.

In the configuration shown in FIG. 1, in the present invention, a sub-image (for example, a thinned image, a reduced image, or a reduced image) is obtained by extracting a part of image information of one image (hereinafter, referred to as a main image). Image, etc.), storing the generated image in a memory, transmitting the image to another image handling device, and the like.

The recording of the sub-image in the memory is performed through the operation of the system controller 16, and there are various recording modes as described below.

By the way, in a digital still camera that records image data, audio data, control data, and the like as a file on a recording medium such as a memory card, a magnetic medium (a hard disk or a floppy disk), and a magneto-optical medium, the data is also recorded on the recording medium in a file format. May be recorded. At this time, it is desirable that the memory management be performed in a standard DOS (disk operating system) format by a personal computer or the like in terms of data compatibility. Then, control information for controlling the operation and associating each file is recorded as a control file (also referred to as a control file or a relational file, hereinafter referred to as a relational file) on the recording medium. Are also being considered.

The first recording mode is for recording main image data and sub-image data in an image file during recording in the file format. FIG. 2 shows three examples of recording modes. By recording in such an image file, the frame number can be managed as before, and movement, copying, deletion, etc. can be handled together without being conscious of the main image and the sub image.
In FIG. 2A, when one piece of image data is recorded, a file header portion, a main image data portion, and subsequently a sub-image data portion are sequentially recorded in the image file. As a result, it is easy to delete only the sub-images, to easily add a plurality of sub-images, and to easily reproduce the main image. In FIG. 2B, a file header portion, a sub-image data portion, and subsequently a main image data portion are sequentially recorded. Therefore, at the time of the search in the sub-image reproduction mode, a higher-speed search can be performed. FIG. 2C shows a recording mode when there are a plurality of sub-images. The main image data is written from the main data start address following the file header portion, and the sub-image data is written from the sub-image data 1 start address. After the data 1 is written, the sub-image data 2 is written from the sub-image data 2 start address.

FIG. 3 shows an entry example of a file header. Following the standardized format tuple and recording date tuple, the option tuple 1 contains the parameters of the sub-image data 1, and the option tuple 2 contains the sub-image data 1. 2 are recorded, and main image data and sub-image data are continuously recorded as image data. The sub-image data parameters include a sub-image data start address, a sub-image data type (compressed / uncompressed, pixel size, etc.), and a reduction ratio 1 / (2 n) for the main image. It can be. When a reduced sub-image is created, it is easier to record only the reduction ratio than to record the pixel size as a parameter, and the data amount is small. There is a creation date of the sub-image data and the like. Thus, in addition to the effects described above, it is easy to extract only the main image.

Fig. 4 shows an example of the recording format for the file header. Following the format tuple and the recording date tuple, the parameters of the recorded sub-image data are recorded in the option tuple 1, the main body of the sub-image data 1 is recorded in the option tuple 2, and the sub-image data 2 is recorded in the option tuple 3. Is recorded. The main image data body is recorded in an area other than the file header of the image file. Examples of the sub-image data parameters include the presence and number of sub-image data, the type of sub-image data (compressed / uncompressed, pixel size, reduction ratio, etc.).

FIG. 5 is a diagram showing an example of recording in an image header (JPEG header) when the main image data is compressed and recorded in the JPEG format, which is a format of a personal computer image data format.
The JPEG header following the file header has data such as SOI (Start of Image) marker, APP (Application Marker) has sub-image data itself, and SOS marker has main image data has EOI (End).
of Image) marker is recorded. By doing so, the same effect as in the case of the example shown in FIG. 2 can be obtained. As image data formats for personal computers, in addition to JPEG, there are TIFF, PICT, BMP and the like, and the present invention can be applied to these methods.

FIG. 6 shows an example in which the sub-image data is recorded in a separate file from the main image data, and the data associated with the data is recorded in the above-described relational file. Since one image becomes one file by recording in another file, image management can be performed with a file management image. According to this relational file, the association information is managed collectively, so that data management becomes easy.

As shown in FIG. 1A, a main image file composed of a file header and main image data is defined as a file (FILE) 1 and a file header and sub-images are defined as a file 2 as illustrated in FIG. As shown in FIG. 3C, a sub-image 1 file composed of the main body of the sub-image data 2 is prepared, as shown in FIG. A relational file as shown in (D) is prepared. For example, in the relational file of FIG. 9D, “MAIN5” indicates that the main image data of the fifth frame is recorded in the file (FILE) 1 of FIG. This indicates that the sub-image data of the frame is recorded in the files 2 and 3 in FIGS.

In FIG. 7, the sub-image data is recorded in a separate file from the main image data body, and the relevant information about the sub-image data file is recorded in the file header of the main image data file (FIG. 7A). Here is an example. The file header includes a format tuple, a recording date tuple, an option tuple 1 in which a sub-image file name 1 is recorded, and an option tuple 2 in which a sub-image file name 2 is recorded. FIG. 4B shows a file in which the main body of the sub-image data 1 is recorded, and FIG. 4C shows a file in which the main body of the sub-image data 2 is recorded. In this way, if the main image is read, the sub-image is inevitably understood. Also, if the file header of the sub-image data and the related information about the main image data file are recorded, the relation of the main image can be known from the sub-image, and it is not necessary to read an extra file.

FIG. 8 shows an example in which main image data and sub-image data are recorded in separate files, and these data are identified and associated by file names. In this example, the main image data file and the sub image data file are distinguished by the extension. As a result, the operation of reproducing only the main image or reproducing only the sub-image becomes easy. In addition, since the file can be identified from the file name without reproducing the image of the file, image management by file operation becomes possible to some extent.

An example of a main image data file with an extension “J6I” is shown on the left side of FIG. In the extension “J6I”, “J” indicates JPEG which is a compression method, “6” indicates 68 Pin, and “I” indicates Image.
On the right side of the drawing, an example of a sub-image data file with an extension “T6N” (N is a natural number) is shown. Of the extension “T6N”, “T” indicates the sub-image data whose “Thumbnail” (thumbnail), “6” indicates 68 Pin, and “N” indicates the frame number of the sub-image data.

FIG. 9 shows an example of a directory structure in which the main image data and the sub-image data are similarly recorded in different files, and the files are associated with each other in a directory. By using this directory, not only the same effect as in the case of using the file name but also the management of the frame number becomes easy. This is different from the other file recording example in that a directory in which only the main image is recorded is created, so that the frame number management in the conventional directory entry can be performed as it is.

In this example, it is assumed that the directory “MAIN” includes the main image data group, the directory “SUB1” includes the data group of the sub-image 1, and the directory “SUB2” includes the data group of the sub-image 2. Show. For example, the sub-image 1 of the file "DSC002.J6I" is displayed as "$ SUB1 \ DSC002.J6T", and the sub-image 2 of the file "DSC002.J6I" is displayed as "$SUB2@DSC002.J6T".

FIG. 10 shows an example in which main image data and sub-image data are recorded in separate files, and the main image file is a separate file, but the sub-image file is stored in a batch file. According to this method, by displaying the sub-image data in a batch file, index display (reproduction of only the sub-image) and the like can be easily performed. In addition, batch deletion of sub-images and the like can be easily performed.

(A) in the figure, a format image tuple, a recording date tuple, an option tuple, and a header portion in which a sub-image data offset address is recorded, followed by a main image file DSC001. An example of J6I is shown, and FIG. 13B shows a main image file in which main image data is recorded, following a header in which a format tuple, recording date tuple, option tuple, and sub-image data offset address are recorded. DSC011. An example of J6I is shown, and FIG. 10C shows only one sub-image file for recording sub-image data of these main image data. Following the file header, the file DSC001. J6I sub-images are recorded as sub-image data 1 in the same manner as sub-image data 2, sub-image data 3, and so on. The sub-image of J6I is recorded as sub-image data 11, and up to sub-image data 12.

The file header of the sub-image batch file includes the number of sub-images, the image parameters of the sub-images, the start address and end address of each sub-image data, the file name of the main image for each sub-image, and the like. When the batch file is used as the index file, the main image can be searched from the sub image.

FIG. 11 shows an example in which the image data recording start address is specified in cluster units. The main image data is recorded in clusters 1, 2, 3,..., The sub-image data 1 is recorded in clusters 10, 11,..., And the sub-image data 2 is recorded in clusters 20, 21,. According to this embodiment, when the sub-image data 1 is deleted, the sub-image portion itself in the FAT chain of the image file need only be deleted and the FAT chain rewritten without operating the sub-image data itself. On the other hand, when a conventional recording start address is designated, in order to erase only the sub-image data 1, it is necessary to erase the sub-image data 1 and then pack the sub-image data 2 into the erased place. Therefore, by setting the recording start address to 2 n bytes, high-speed image retrieval, extraction of only the main image, and erasure of the sub-image data are also facilitated.

Next, an operation sequence of the digital still camera according to the embodiment of the present invention will be described with reference to a flowchart of FIG.

After power-on, initialization processing of camera operating conditions such as zooming initialization is performed (step S1), and it is determined whether or not the camera is in a sub-image creation mode (step S2). Is displayed on the display unit 17 and a flag indicating the fact is set (step S3), and then it is determined whether or not an area selection mode for selecting an area to be taken out as a sub-image from the main image (step S4). If the mode is not the sub-image creation mode in step S2, the process proceeds to step S13 described later.

In step S4, if the mode is the area selection mode, the fact that the mode is the area selection mode is displayed, a flag indicating that fact is set (step S5), and it is determined whether or not the mode is the image reduction mode for reducing the image (step S5). Step S6). When the mode is not the area selection mode, the process proceeds to step S6. Here, in the case of the image reduction mode, display indicating that the mode is the image reduction mode and flag setting are performed (step S7). Is determined (step S8). Due to the reduction, the whole image can be grasped in a small size.

In step S8, in the case of the image compression mode, whether the compression rate is fixed or the size (data amount) is fixed as the technique used in the compression is determined. To determine, it is determined whether the mode is the fixed size mode (step S9). Here, in the case of the fixed size mode, after compression, the fact that the size is fixed is displayed and a flag is set (step S10). A message is displayed and a flag is set (step S11). If it is determined in step S8 that the mode is not the image compression mode, the fact that the mode is the non-compression mode is displayed and a flag is set (step S12).

After the processing in steps S10 to S12, an operation input by an operation from the operation unit 18 is detected (step S13), power OFF is determined (step S14), and if the power is OFF, the power is turned OFF and the operation is terminated. If the power is not OFF, various processes corresponding to the input operation are executed (step S15), and the process returns to step S13.

FIG. 13 is a flowchart showing an image data recording processing sequence when sub-image data is recorded after recording main image data.

For example, the processing is started in response to a recording instruction by an operation from the operation unit 18, and firstly, the frame memory follows the processing by the optical system 1, the imaging circuit 2, the clamp circuit 3, and the A / D conversion circuit 4 shown in FIG. 11 is performed (step S21), and the main image data read from the frame memory 11 is subjected to main image compression processing by the DCT / IDCT circuit 12 and the coder / decoder 13 (step S22). ), The compressed main image data is recorded on the IC memory card 15 (step S23). Next, it is determined whether to create a sub-image (step S24). This determination is made, for example, based on the presence or absence of the flag set as the sub-image creation mode in step S3 in FIG.

If it is determined in step S24 that a sub-image is to be created, a sub-image creation process is executed (step S25). After the sub-image recording process on the IC memory card (step S26), a file maintenance process is executed. (Step S27), the process ends. If it is determined in step S24 that a sub-image is not to be created, the file maintenance process of step S27 is executed as it is. As a file maintenance process, for example, when a file is managed and recorded in the DOS format, there is a format writing process such as a directory entry or FAT.

FIG. 14 is a flowchart showing the creation sequence of the sub-image creation process in step S25 of FIG.
First, it is determined whether or not the mode is an area selection mode for selecting a sub-image creation area for the main image (step S31). If the mode is the area selection mode, an area size change process for changing the size of the area (step S32) is performed. After executing the area position change process (step S33) for changing the position, the determination in step S34 is performed. In this case, if it is determined in step S31 that the mode is not the area selection mode, the image is similarly reduced. It is determined whether or not to perform. Here, when it is determined that the image is to be reduced, after the image is reduced by performing thinning-out reading of the image data from the frame memory 11 or the like (step S35), the image must be reduced in step S34. If determined, it is determined whether to compress the image (step S36). Here, when it is determined that the image is to be compressed, it is determined whether or not the fixed size is instructed in order to determine whether to compress the image or to fix the size (data amount) during compression ( Step S37).

If it is determined in step S37 that the size is constant, a compression process is performed with the size after compression being constant (step S38). If it is not determined that the size is constant, the compression process is performed with a constant compression ratio (step S38). Step S39), the process ends. If it is determined in step S36 that the image is not to be compressed, the image data read from the frame memory 11 is not compressed, and an uncompressed data conversion process such as conversion to a format required for personal computer processing is executed. (Step S40), the process ends. In this case, when the image data is handled in the camera, the above conversion process is not executed, and the image data is written to the IC memory as it is. The reduced compressed image may be created by recording only the DC component of the orthogonal coefficients output from the DCT / IDCT circuit 12 to obtain a 1/8 reduced image. By this processing, not only a good image quality with higher reproducibility than the reduced image obtained by the normal thinning processing can be obtained, but also the memory control can be the same for the main image and the sub-image, so that the circuit is simplified.

In the example shown in FIG. 14 described above, the image processing apparatus has three specific sub-image generating means as the sub-image generating means, namely, an area selecting means, an image reducing means, and an image compressing means. However, the present invention is not limited to the above-described example. For example, the present invention is not limited to the above-described example. Of course, it is also possible to employ a configuration having one or two units, or a configuration in which the processing order of the three units is appropriately changed. In this case, the first processed sub-image generating means is the first sub-image generating means, and the second processed sub-image generating means is the second sub-image generating means. The processing timing of the actual data by the sub-image generation means and the second sub-image generation means includes simultaneous processing on the previous frame memory 11 or time-division processing.

The procedure of this uncompressed data conversion processing is shown in the flowchart of FIG. In FIG. 15, first, it is determined whether or not to store the data in the format of the computer (step S41). If the format is not the format of the computer, the process is terminated. The conversion is performed (step S42), and the process ends.
As the data recording method at the time of non-compression, there are two general methods, the RGB method and the YCbCr method. However, the RGB method is suitable for reproduction on a personal computer, and the YCbCr method is suitable for reproduction on a camera.

副 The sub-image recording process in step S26 of FIG. 13 is executed according to the procedure of the flowchart shown in FIG. That is, an image write address is created (step S51), sub-image data is written to the created address (step S52), and a sub-image start address is written to a file header (step S53), thereby enabling rapid reproduction.

Although the writing of data to the file header has been described with reference to FIG. 4, as shown in FIG. 17, first, the file header is interpreted (step S61), and an option tuple for each sub-image is created (step S62). ), The sub-image data is written into this tuple (step S63), tuple maintenance is executed (step S64), and the process is terminated. This tuple maintenance is a process of writing the size of a file header determined after the writing is completed.

FIG. 18 is a flowchart showing a procedure for recording the sub-image data shown in FIG. 5 in the JPEG header. First, the JPEG header is interpreted (the JPEG format is interpreted) (step S71), an application (APP) marker is created (step S72), and sub-image data is written to the created APP marker (step S73).

FIG. 19 is a flowchart showing a sub-image recording sequence for associating image data using the relational file shown in FIG.
First, a sub-image data file is created (step S81), and the presence or absence of a relational file is determined (step S82). If there is a relational file, the relational file is read and interpreted (step S83). For example, after creating a relational file (step S85), information related to the main image data is written (step S84), and the process ends.

FIG. 20 is a flowchart showing a sub-image recording sequence for performing association by the file header shown in FIG.
In this sequence, a sub-image data file is created (step S91), and after interpreting the main image data file header (step S92), relevant information is written into the main image file header (step S93), and the process ends.

FIG. 21 is a flowchart showing a sub-image recording sequence for performing the association by the file name shown in FIG.
In this sequence, the file name configuration is confirmed, an appropriate file name that does not contradict the configuration is created (step S101), and a sub-image data file is created with the created file name (step S102). finish.

FIG. 22 is a flowchart showing a sub-image recording sequence for performing association in a directory as shown in FIG.
First, the presence / absence of a directory is determined (step S111). If there is, a directory for a sub-image is searched (step S112), and then the presence / absence of a sub-image is determined (step S113). If there is a sub-image, the process returns to step S111 to search the next directory. If there is no sub-image, a sub-image data file writing process is executed (step S114), and the process ends. If it is determined in step S111 that there is no directory, a sub image directory is created (step S115), and the process proceeds to step S114.

FIG. 23 is a flowchart showing a sequence for recording sub-image data using the sub-image batch file as shown in FIG.
In this sequence, first, the presence or absence of a sub-image file is determined (step S121). If there is, a sub-image batch file is searched (step S122), and the number of sub-images and data written in the file header are determined. Is confirmed, and a sub-image data recording start address is created (step S123). If it is determined in step S121 that there is no sub-image file, a sub-image batch file is created (step S124), and the process proceeds to step S123. After the processing of step S123, the sub-image data is written (step S125), the relevant information with the main image data is written (step S126), and the processing ends.

Next, the operation of the digital still camera during continuous shooting will be described with reference to FIG.
The recording operation is started in response to pressing of the shutter button or the like. First, an imaging process for obtaining main image data is executed (step S131), and the obtained main image data is compressed (step S132). Is recorded (step S133), it is determined whether or not the mode is the sub image creation mode (step S134). Here, in the sub-image creation mode, it is determined whether or not continuous shooting is set (step S135), and if continuous shooting is set, the creation condition of the sub-image is determined (step S136). This determination is a process for determining which image, of the main images obtained by continuous shooting, is to have a sub-image created.

Thereafter, it is determined whether to create a sub-image by detecting a flag (step S137). If a sub-image is to be created, a sub-image creation and recording process is executed (step S138), and the same as described above. A simple file maintenance process is executed (step S139). If it is determined in step S134 that the sub-image creation mode is not set, and if it is determined in step S137 that no sub-image is created, the process directly proceeds to step S139. If it is determined, the process shifts to step S138. After performing the file maintenance processing in step S139, it is determined whether or not to continue recording (continuous shooting operation continues) (step S140). If it is determined to continue recording, the process returns to the imaging processing in step S131. If it is determined not to continue recording, the process ends.

FIG. 25 is a flowchart illustrating an example of a sequence for determining the sub-image creation condition at the time of continuous shooting in step S136 in FIG.
This example shows an operation when a sub-image is created for the first main image of a plurality of main images obtained by continuous shooting, and the created sub-image is any one of the plurality of main images. It is good.

That is, first, it is determined whether or not a main image for which a sub-image is to be created has been obtained or not (step S141). It is set (step S142), and the processing is terminated. If it is not the first sheet, the sub-image creation flag is cleared (step S143), and the processing is terminated. In this example, the main image for which a sub-image is to be created may be set as the last image in the continuous shooting.

FIG. 26 is a flowchart showing a sequence for automatically selecting and creating a main image for creating a sub image from a plurality of main images in accordance with the continuous shooting speed, unlike FIG. In this example, a high-speed continuous shooting mode and a low-speed continuous shooting mode are set as the continuous shooting mode. One main image is output for every four images in the high-speed continuous shooting mode, and one main image is used for every two images in the low-speed continuous shooting mode. 9 shows an example of obtaining a sub-image for an image.

After the start of the operation, it is determined whether or not the continuous shooting is the first image (step S151). If it is the first image, the counter value i is initialized to 0 (step S152), and the continuous shooting is in the high-speed continuous shooting mode. It is determined whether or not it is (step S153). If it is determined in step S151 that it is not the first sheet, the process directly proceeds to step S153.

If it is determined in step S153 that the current mode is the high-speed continuous shooting mode, it is determined whether the counter value i is greater than 2 (step S154). After that (step S155), the counter value i is set to 0 (step S156), and the process ends.

If it is determined in step S153 that the mode is the low-speed continuous shooting mode, it is determined whether or not the counter value i is larger than 0 (step S157). If it is larger, the process proceeds to step S155. Then, the sub-image creation flag is cleared (step S158), the counter value i is incremented by 1 (step S159), and the process ends. If it is determined in step S154 that the counter value i is not larger than 2, the process proceeds to step S158.

In the present embodiment, the counter value i is first reset to 0, and during high-speed continuous shooting, comparison is made with "2" in step S154, and during low-speed continuous shooting, comparison is made with "0" in step S157. It is possible to automatically instruct and create one out of four sub-images at the time of shooting and one out of two at the time of low-speed continuous shooting.

By the above-described processing, the sub-image data is recorded on a recording medium such as an IC memory card. The recorded sub-image data is reproduced on a monitor screen connected to the electronic viewfinder 8 and the external terminal EXT in FIG. Thus, the retrievability of the recorded image information is improved.

FIG. 27 shows a display example of a so-called picture-in-picture in which a sub-image is simultaneously displayed in a screen on the monitor on which a main image is displayed.

FIG. 28 shows an example in which a frame number and sub-image number information are displayed as characters in a part (upper right part) of the main image screen displayed on the monitor.

FIGS. 29 and 30 show examples of setting an area to be taken out as a sub-image as desired from the main image displayed on the monitor as a selection area together with the size of the area.

With respect to the display main image of FIG. 29A, the image of the central portion designated by the selected area is taken out as a sub-image based on the designation of the area as shown in FIG. Is displayed.

{Circle around (2)} The image of the selected area selected with respect to the main image of FIG. 30A is displayed based on the area large / small designation and the area position designation as shown in FIG.

FIG. 31 shows an example in which a main image is reduced and a compressed image is used as a sub-image, while a part of the main image is used as a sub-image in FIGS. 29 and 30. (B) shows a sub-image obtained by reducing the main image shown in FIG. 3 at a data size of 30 kB, and FIG. (C) shows a sub-image obtained by further compressing a sub-image reduced at a data size of 30 kB. ing.

FIG. 32 is a flowchart showing an image reproduction sequence. This reproduction sequence will be described below. When the reproduction mode (including frame advance) is set and the reproduction operation is started, first, a file discrimination process is performed (step S161), the file of the frame to be reproduced is determined, and whether or not the frame can be reproduced is determined. Is determined (step S162). Here, if the image can be reproduced, it is determined whether or not the image is the main image (step S163). If the image is the main image, the main image is reproduced (step S164), and then the presence or absence of the sub image is determined. (Step S165). If it is determined in step S165 that there is a sub-image, a process of displaying sub-image information is performed as shown in FIGS. 27 and 28 (step S166), and the process ends. If it is determined in step S165 that there is no sub-image, display processing without a sub-image is performed (step S167).

If it is determined in step S163 that the image is not the main image, the image is a sub image, so that only the sub image is reproduced (step S168), and the process ends. If it is determined in step S162 that the file cannot be reproduced, the file is an audio file, a data file of a personal computer, or the like. S169), and ends the processing.

FIG. 33 shows a flowchart of a sub-image creation sequence at the time of reproduction. This sequence assumes an example in which a main image has already been reproduced and displayed, and a sub-image is to be created from this. According to this example, it is possible to select a sub-image as desired while observing the main image slowly, as compared with generating a sub-image when the apparatus is in a recording state. Can be

When the sub-image creation operation is started, it is determined whether or not a sub-image already exists (step S171). If a sub-image already exists, a sub-image addition preparation process is executed (step S172). This preparation processing is preparation processing such as a writing format of the sub-image data and embedding of the sub-image data in the main image data. If there is no sub-image in step S171, step S172 is skipped and the process moves to step S173. After executing the sub-image creation process (step S173) and the sub-image recording process (step S174), the file maintenance process (step S175) is executed, and the process ends.

By the way, at the time of interval reproduction or multi-reproduction, only the sub-image is reproduced, and it is effective at the time of high-speed reproduction search. When there is no sub-image, skip, mute, character display and the like can be performed.

Next, the erasing sequence of the sub-image data will be described with reference to the flowchart in FIG.
When the erasing operation is started by inputting an erasing command or the like, first, it is determined whether or not the mode is for erasing only the sub-image (step S181), and if so, the presence or absence of the sub-image is determined (step S182). ). Here, if there is a sub image, it is determined whether or not there is one sub image (step S183). If there is one sub image, the sub image is deleted (step S184), the process is terminated, and one sub image is obtained. If not, a sub-image selection process for selecting which sub-image of the plurality of sub-images is to be deleted is executed (step S186), and the process proceeds to step S184.

If it is determined in step S182 that there is no sub-image, a warning is displayed by displaying on the monitor that there is no sub-image (step S187). If it is determined in step S181 that the mode is not the erase mode for only the sub-image, the main image and the sub-image are erased (step S188), and the process ends.
In the above processing, it is of course possible to delete only the main image.

FIG. 35 is a flowchart showing a sequence of an embodiment for performing batch erasure when a sub-image is written in another file.

(4) When a sub-image is recorded in a batch file, the batch file can be deleted at the same time. However, when the sub-image is recorded in another file, there is a demand to delete the sub-image accompanying the deletion of the main image. The present embodiment is a sequence that satisfies this demand.

First, a process of searching for a sub-image and searching for a sub-image corresponding to the main image to be deleted is executed using, for example, a file header or a relational file of the main image (step S191). Next, it is determined whether or not there is a sub-image (step S192). If there is, the sub-image is deleted (step S193), and the process returns to step S191. If it is determined in step S192 that there is no sub image, the main image is deleted (step S194), and the process ends.

Next, an embodiment of an image handling apparatus for transmitting the sub-image data obtained by the above-described processing via a wired line such as a telephone line or a wireless line will be described.

FIG. 36 is a flowchart showing a procedure for transmitting the sub-image data and the main image data. In the figure, on the transmission side, after starting the transmission operation, first, only the sub-image data is transmitted (step S201). After receiving the sub-image data, the receiving side reproduces the data (step S301), selects a necessary image (step S302), and transmits designation information such as a frame number and a file name of the selected image to the transmitting side. (Step S303).

(4) The transmitting side that has received the designation information transmits the main image data of the designated frame number to the receiving side (step S202). The receiving side receives the designated main image data, reproduces and confirms it, transmits an end signal notifying the end of the operation to the transmitting side (step S304), and ends the processing.

FIG. 37 is a flowchart of an embodiment in which a sub-image is automatically created and transmitted in real time in response to a request from the receiving side.

(4) The transmitting side automatically creates data of the reduced sub-image (step S211) and transmits the created sub-image data (step S212). After receiving the sub-image, the receiving side reproduces the image (step S311), selects a sub-image creation mode (for example, area selection) of the image (step S312), and transmits the selected creation mode to the transmission side (step S312). Step S313).

The transmitting side automatically creates a sub-image in the received creation mode (step S213), and transmits the created sub-image (step S214).
After receiving the sub-image, the receiving side reproduces it (step S314), transmits a communication end signal to the transmitting side (step S315), and ends the processing.

The sequence shown in FIG. 37 will be specifically described with reference to FIG. 38. The transmitting side automatically creates a reduced image (A2) from the main image (A1) by thinning processing and transmits it as a sub-image (steps S211 and S212). ).

The receiving side receives and reproduces the sub-image, selects a required area portion based on the reproduced sub-image (B1) by area selection (B2), and transmits the area selection information to the transmitting side (step). S311 to S313).

(4) The transmitting side automatically creates a sub-image (C2) for the area selecting section of the main image (C1) based on the received area information and transmits it to the receiving side (steps S213 and S214).

Finally, the receiving side reproduces the received sub-image, reproduces the sub-image meeting the request as shown in (D), and transmits a communication end signal (steps S314 and S315).

1 is a configuration block diagram showing an application example of an image handling apparatus according to the present invention to a digital still camera. FIG. 4 is a diagram illustrating three examples of recording modes according to an embodiment of the present invention. FIG. 8 is a diagram illustrating an example of entry of a file header according to the embodiment of the present invention. FIG. 7 is a diagram illustrating an example of a recording format for a file header according to an embodiment of the present invention. FIG. 7 is a diagram illustrating recording in a JPEG header when main image data is compressed and recorded in a JPEG format according to an embodiment of the present invention. FIG. 6 is a diagram illustrating an example in which sub-image data is recorded in a file different from main image data in an embodiment of the present invention, and data associated with the data is recorded in a relational file. FIG. 8 is a diagram illustrating an example in which sub-image data is recorded in a file different from main image data and related information about a sub-image data file is recorded in a file header of a file for main image data in the embodiment of the present invention. FIG. 6 is a diagram illustrating an example in which main image data and sub image data are recorded as separate files in the embodiment of the present invention, and identification and association of these data are performed by file names. FIG. 6 is a diagram illustrating an example of a directory structure in which main image data and sub image data are recorded in separate files and the files are associated in a directory according to the embodiment of the present invention. FIG. 11 is a diagram illustrating an example in which main image data and sub-image data are recorded in separate files according to an embodiment of the present invention, and the main image file is a separate file, but the sub-image file is stored in a batch file. FIG. 6 is a diagram illustrating an example in which an image data recording start address is specified in cluster units in the embodiment of the present invention. 5 is a flowchart illustrating an operation sequence of the digital still camera according to the embodiment of the present invention. 6 is a flowchart illustrating an image data recording processing sequence when recording sub image data after recording main image data according to an embodiment of the present invention. 14 is a flowchart illustrating a creation sequence of a sub-image creation process in step S25 of FIG. 15 is a flowchart showing a procedure of an uncompressed data conversion process in FIG. 14 is a flowchart showing a sub-image recording processing procedure in step S26 in FIG. 9 is a flowchart illustrating a processing procedure for writing data to a file header. 15 is a flowchart showing a recording procedure of the sub-image data shown in FIG. 14 in a JPEG header. 7 is a flowchart showing a sub-image recording sequence for associating image data using the relational file shown in FIG. 8 is a flowchart illustrating a sub-image recording sequence for performing association by the file header illustrated in FIG. 7. 9 is a flowchart illustrating a sub-image recording sequence for performing association by a file name illustrated in FIG. 8. 10 is a flowchart showing a sub-image recording sequence for performing association in the directory shown in FIG. 9. 11 is a flowchart showing a sequence for recording sub-image data using the sub-image batch file shown in FIG. 10. 6 is a flowchart illustrating an operation sequence at the time of continuous shooting of the digital still camera in the embodiment of the present invention. 25 is a flowchart illustrating a sequence example of determining a sub-image creation condition at the time of continuous shooting in step S136 in FIG. 24. 9 is a flowchart illustrating a sequence for creating a sub-image from a plurality of main images in accordance with a continuous shooting speed according to an embodiment of the present invention. FIG. 11 is a diagram illustrating a display example of a picture IN picture in which a sub image is simultaneously displayed in a screen on which a main image is displayed on a monitor according to the embodiment of the present invention. FIG. 8 is a diagram illustrating an example in which a frame number and sub-image number information are displayed as characters in a part (upper right part) of a main image screen displayed on a monitor according to an embodiment of the present invention. FIG. 11 is a diagram illustrating an example in which an area to be taken out as a sub-image from a main image displayed on a monitor is set as a selected area together with the size of the area according to the embodiment of the present invention. FIG. 11 is a diagram illustrating an example in which an area to be taken out as a sub-image from a main image displayed on a monitor is set as a selected area together with the size of the area according to the embodiment of the present invention. FIG. 7 is a diagram illustrating an example in which a main image is reduced and an image subjected to a compression process is used as a sub image in the embodiment of the present invention. 6 is a flowchart illustrating an image reproduction sequence according to the embodiment of the present invention. 6 is a flowchart illustrating a sub-image creation sequence at the time of reproduction according to the embodiment of the present invention. 6 is a flowchart illustrating a sub-image erasing process sequence according to the embodiment of the present invention. 9 is a flowchart illustrating a sequence of performing batch erasure when a sub-image is written in another file according to the embodiment of the present invention. 6 is a flowchart illustrating a transmission procedure of sub-image data and main image data according to the embodiment of the present invention. 6 is a flowchart illustrating a processing procedure for automatically creating and transmitting a sub-image in real time in response to a request from a receiving side in the embodiment of the present invention. FIG. 38 is a diagram specifically illustrating the sequence in FIG. 37.

Explanation of reference numerals

DESCRIPTION OF SYMBOLS 1 Optical system lens 2 Imaging circuit 3 Clamp circuit 4 A / D conversion circuit 5 Digital process circuit 6 D / A conversion circuit 7 Amplification circuit 8 Electronic viewfinder 9 Character generator 10 Memory controller 11 Frame memory 12 DCT / IDCT (discrete cosine transform) / Inverse discrete cosine transform)
13 Coder / Decoder 14 Auxiliary Memory 15 IC Memory Card 16 System Controller 17 Display Unit 18 Operation Unit 19 Data Input / Output Unit

Claims (3)

An optical system for obtaining a subject image,
An image sensor that photoelectrically converts a subject image obtained through the optical system,
An imaging circuit that converts a subject image photoelectrically converted by the imaging element into an electric signal,
An A / D conversion circuit that converts an electric signal from the imaging circuit into digital data;
A coder for encoding the digital data converted by the A / D conversion circuit;
Storage means for recording image data encoded by the coder,
Has,
A main image file having main image data and a sub image file having a sub image composed of a reduced image of the main image are recorded in the storage unit as separate files,
A main image file and a sub-image file can be distinguished from each other by an extension of a file name attached to the main image file, and the fact that the file is a sub-image can be identified by an extension of the sub-image file and recorded. A camera. The camera according to claim 1, wherein the sub-image is an image obtained by performing compression after reducing the main image. 2. The camera according to claim 1, wherein, in recording the main image and the sub image in the storage unit, the main image is stored in a separate file while the sub image data is stored in a batch file.

Images