KR100921686B1 - Computer-readable recording media recording stereoscopic video file formats and corresponding stereoscopic video files - Google Patents

Abstract

The present invention relates to a stereoscopic video file format and to a computer readable recording medium for recording a stereoscopic video file accordingly. As described above, the present invention includes a first region for storing different element streams (ES); A second area for storing stereoscopic video stream arrangement information of the stereoscopic video ES in the first region and identification information supporting sample unit identification of the fragment for the stereoscopic video ES in the first region; The region comprises at least one third region each storing an ES, and the second region is configured to exist in every third region of the at least one third region including the stereoscopic video ES, thereby providing a mono image or other Information to insert and distinguish stereoscopic images can be recorded in video ES-based video sample units.

Stereoscopic video, file formats, TRAK, SVMI

Description

STEREOSCOPIC VIDEO FILE FORMAT AND COMPUTER READABLE RECORDING MEDIUM FOR RECORDING A STEREOSCOPIC VIDEO FILE THEREFORE}

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to stereoscopic video, and more particularly, to a stereoscopic video file format capable of recording a mono image or other stereoscopic image and distinguishing the same, in a video ES-based video sample unit, and a computer recording a stereoscopic video file. The present invention relates to a recording medium which can be read.

With the development of image technology and digital technology, a technology related to stereoscopic video has been proposed to give viewers a sense of realism by giving more vividness to images.

In particular, 'JTC 1 / SC 29 / WG 11', an image-related standardization group organized by ISO / IEC, is currently discussing how to propose and efficiently optimize stereoscopic video file formats for the storage and playback of stereoscopic video.

The conventionally proposed stereoscopic video file format relates to an image of a binocular view, and includes various information for representing a stereoscopic image such as an arrangement form of a left image and a right image, recommended display information, and camera parameter information. It also includes information to support the inclusion of mono images, such as interstitial ads.

In addition, the conventional stereoscopic video file format includes an item location box (iloc box) to support a mono image (or another stereoscopic image) and displays its boundary and size in bytes. This allowed access in bytes with the video original resulting from the video decoding in mind. However, in the stereoscopic video media information box (smimi box) that stores the stereoscopic stream arrangement information, whether the stereo / mono conversion of the stereo / mono image fragment is stereo / mono video sample, that is, the encoded video element stream It is shown as the basis of (Element Stream: ES). As a result, there is a problem that information inconsistency occurs due to stereo fragments and mono / mono divisions expressed in byte units of image fragments and video ES samples.

1 is a structural diagram showing a stereoscopic video stream structure including a conventional mono image.

As shown in FIG. 1, in order to insert and distinguish a mono image (or another stereoscopic image), it is divided by byte in an item position box and an item ID (Item_ID) is added thereto. However, since the stereo mono change information in the stereoscopic image media information box is expressed in video sample units, information inconsistency occurs. Because of this, in analyzing the stereoscopic video file format, it is fundamentally impossible to distinguish whether a particular video sample of a specific video ES is stereo or mono, and then whether it is a video fragment and, if it is a video fragment, what the Item_ID is. Do.

This also results in a stereoscopic camera and display information box (scdi box) or item information box (iinf) that stores other information associated with Item_ID, such as camera parameters and recommended display information. Linking to svmi box information is fundamentally impossible.

Because of this, in analyzing the stereoscopic video file format, it is necessary to find and analyze the item location box again to process information designated by Item_ID such as scdi box. In other words, the existence of non-essential information such as item location box cannot be analyzed by analyzing the mandatory svmi box, and it is inefficient and complicated to analyze the information because the entire stereoscopic video file format is not known. And, there is a problem that the analysis time becomes longer.

Therefore, the present invention was devised to solve the above problems, and an object of the present invention is to insert a mono video or other stereoscopic video and to record information for distinguishing the stereoscopic video that can record video ES-based video sample units. The present invention provides a computer-readable recording medium recording a file format and a stereoscopic video file accordingly.

Another object of the present invention is to record a stereoscopic video file format and a stereoscopic video file that can be used to identify and utilize the information to insert a mono image or other stereoscopic image and distinguish it as Item_ID and other information connected thereto before video decoding. A computer readable recording medium is provided.

It is still another object of the present invention to input information for inserting and distinguishing a mono image or other stereoscopic image into essential information such as a stereoscopic image media information box, to specify the existence of Item_ID, and to predetermine the existence of information linked thereto. It is to provide a computer-readable recording medium recording a three-dimensional video file format that can be determined according to the three-dimensional video file accordingly.

In order to achieve the above object, a stereoscopic video file format according to an embodiment of the present invention, the first region for storing different element streams (ES stream); An essential information area may include a second area storing stereoscopic video stream arrangement information of the stereoscopic video ES in the first area and identification information supporting sample unit identification of the fragment for the stereoscopic video ES. Preferably, the first region may include at least one third region for storing the ES, and the second region may exist in every third region including the stereoscopic video ES of the at least one third region. .

In another embodiment, the present invention provides a method including: a first region for storing different element streams (ES); An essential information area, the second area storing stereoscopic video stream arrangement information of the stereoscopic video ES in the first region and identification information supporting sample unit identification of the fragment for the stereoscopic video ES; The region includes at least one third region each storing an ES, and the second region is present in every third region of the at least one third region including the stereoscopic video ES. A computer readable recording medium having recorded thereon is provided.

The stereoscopic video file format and the computer-readable recording medium recording the stereoscopic video file according to the present invention do not coincide with the syntax of dividing stereo / mono by sample by dividing the stereoscopic image fragment by byte unit. Therefore, by improving the difficulty in interpreting and processing stereoscopic video files, it provides a method of classifying stereoscopic image fragments in units of samples so that stereo / mono classification can be clarified when stereoscopic video files are analyzed. Can improve the effectiveness of the information connection.

In addition, the presence or absence of Item_ID can be known in advance, so that the presence and processing of information associated with the Item_ID can be determined in advance, thereby improving the analysis and processing efficiency of the stereoscopic video file.

In addition, the present invention can contribute to standardization in the art by suggesting a clear and efficient structure of a stereoscopic video file.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. It should be noted that the same elements in the figures are represented by the same numerals wherever possible. In addition, detailed descriptions of well-known functions and configurations that may unnecessarily obscure the subject matter of the present invention will be omitted.

2 is a structural diagram showing a structure of a stereoscopic video file format according to an embodiment of the present invention.

As shown in FIG. 2, a stereoscopic video file format according to an embodiment of the present invention includes: a movie box (movie (moov) box) 210 for storing different element streams (ES); It may include a stereoscopic video media information box (svmi) box 220 for storing stereoscopic video stream arrangement information of the number of stereoscopic video ES in the movie box 210.

The movie box 210 may include at least one track box 212 for storing an ES. The track box 212 may be a basic unit for storing each ES.

The ES stored in the track box 212 may be a stereoscopic video ES, a mono video ES, or a fragment ES multiplexed with different ESs. The stereoscopic video ES may be a 1 ES type in which a left image and a right image are mixed, or a 2 ES type in which a left image and a right image are separated. The fragment ES may be multiplexed with different stereoscopic video ESs or multiplexed stereoscopic video ESs and mono video ESs.

The svmi box 220 exists in each track box including the stereoscopic video ES, and may identify fragment information, particularly fragments, for the stereoscopic video ES to which the corresponding track box 212 refers to, in units of samples. May include identification information.

The svmi box 220 may be configured in the form of syntax of the following [Table 1]. The bit size allocated to each field is only one example, and it is easily understood by those skilled in the art that various modifications may be made as necessary.

<Syntax of svmi box> aligned (8) class StereoscopicVideoMediaInformationBox extends FullBox ('svmi', version = 0, 0) {// stereoscopic visual type information unsigned int (8) stereoscopic_composition_type; unsigned int (1) is_left_first; unsigned int (1) is_Item_ID_defined; unsigned int (6) reserved; // stereoscopic fragment information unsigned int (32) item_count; for (i = 0; i <item_count; i ++) {if (is_item_ID_defined) unsigned int (16) item_ID; unsigned int (32) sample_count; unsigned int (1) stereo_flag; unsigned int (7) reserved; }}}

In Table 1, "stereoscopic_composition_type" represents an ES (Element Stream) structure of each track box 212, and "is_left_first" represents discrimination information of an initial image fragment, that is, whether a left image is first. . "is_item_ID_defined" indicates whether item_ID is defined. For example, when this value is 0, it may indicate that information based on item_ID does not exist.

"item_count" is discrimination information of a fragment replacing the conventional "stereo_mono_change" and represents the total number of fragments in the ES. "item_ID" represents the ID of each fragment, "sample_count" represents the number of a series of samples, and "stereo_flag" is information for distinguishing whether the current sample is a stereo sample or a mono sample.

Accordingly, when a mono ES or another stereo ES is inserted (or multiplexed) into the stereo ES, each fragment can be distinguished in units of samples in the svmi box, which is a mandatory area as shown in [Table 1]. Information; By including the identification information of each fragment, it is possible to clarify the stereo / mono distinction when analyzing the stereoscopic video file and to facilitate the connection of information according to the stereoscopic image fragment ID.

The stereoscopic video file according to the stereoscopic video file format of the present invention as described above may be stored on a recording medium (eg, CD-ROM, RAM, floppy disk, hard disk, magneto-optical disk, flash memory, etc.) in a computer-readable form. Can be.

In the above, specific preferred embodiments of the present invention have been illustrated and described. However, the present invention is not limited to the above-described embodiments, and various modifications can be made by any person having ordinary skill in the art without departing from the gist of the present invention attached to the claims. .

1 is a structural diagram showing a stereoscopic video stream structure including a conventional mono image.

2 is a structural diagram showing a structure of a stereoscopic video file format according to an embodiment of the present invention;

Claims (13)

A first region for storing different element streams (ES); An essential information area, and including a second area storing stereoscopic video stream arrangement information of the stereoscopic video ES in the first area and identification information supporting sample unit identification of the fragment for the stereoscopic video ES; The first area includes at least one third area for storing the ES, respectively. And said second area is present in every third area of said at least one third area including stereoscopic video ES. The method of claim 1, wherein the third region is A computer-readable recording medium recording a stereoscopic video file format, characterized in that it is a basic unit for storing each ES. The method of claim 2, wherein each ES is A computer-readable recording medium recording a stereoscopic video file format, wherein the stereoscopic video ES, the mono video ES, and the different ES are one of multiplexed fragment ES. 4. The stereoscopic video ES of claim 3, wherein A computer-readable recording medium recording a stereoscopic video file format, which is one of a type 1 ES in which a left image and a right image are mixed, and a type 2ES in which a left image and a right image are separated. The method of claim 3, wherein the fragment ES is A computer-readable recording medium recording a stereoscopic video file format, wherein the stereoscopic video ES is one of multiplexed ESs and the stereoscopic video ES and mono video ES are multiplexed into one. The stereoscopic video stream arrangement information of claim 1, wherein And a number indicating the number of the third regions, an element stream (ES) structure of each of the third regions, and information indicating whether the identification information is defined. The method of claim 1, wherein the identification information Stereoscopic video comprising information indicating the total number of fragments in the ES, information indicating the ID of each fragment, serial number of samples, information identifying whether the current sample is a stereo sample or a mono sample A computer-readable recording medium that records file formats. The method of claim 1, wherein the first area is A computer-readable recording medium recording a stereoscopic video file format characterized by being a movie (moov) box. The method of claim 1, wherein the second region is A computer-readable recording medium recording a stereoscopic video file format, characterized in that it is a stereoscopic video media information (svmi) box. The method of claim 1, wherein the third region is A computer-readable recording medium recording a stereoscopic video file format characterized in that it is a track box. delete delete delete

Images