CN101650959B - A Design Method of Hierarchical Structure of Multimedia Synchronous Play Control Relationship - Google Patents

Abstract

The invention discloses a method for designing a hierarchical structure of a multimedia synchronous broadcast control relationship. In the method, the multimedia synchronous broadcast control relationship is modeled using a hierarchical structure and a relational database is used to realize the hierarchical structure. The steps are: synchronizing the multimedia The broadcast control relationship is mapped to a task, and the task is divided into 1-L subtasks on the time axis according to the layout of the video screen; the relative play time of the subtask is specified in the task, and the subtask is in the Serial playback in the task; in the subtasks, the split-screen template and the split-screen area are used to control the display position of the parallel playback of the multimedia content. Each split-screen template is composed of 1 to N split-screen areas, and each split-screen area can be Bind 1 to M pieces of multimedia content, and use play items to control the relative playing time of the multimedia content; the subtasks can be reused between the tasks, and the split-screen template can be reused between the subtasks use.

Description

A Design Method of Hierarchical Structure of Multimedia Synchronous Play Control Relationship

technical field

The present invention relates to the technical field of multimedia synchronous broadcast control, in particular to a design method of a hierarchical structure of multimedia synchronous broadcast control relationship.

Background technique

With the continuous improvement of the processing capability of playback terminals, it becomes a reality to play multiple multimedia contents simultaneously on one playback terminal. For example, with the help of the "picture-in-picture" technology display mode, one multimedia content can be played in one display area, and other multimedia content can be played in another display area. This way of split-screen playback can get better information. Spread effect, and successfully applied to the field of multimedia advertising. The multimedia synchronous broadcast control technology is the key to split-screen playback, and it is also a research hotspot now.

The current version of SMIL (Synchronized Multimedia Integration Language) 2.0 is called "Synchronized Multimedia Integration Language", which is a language proposed by W3C to describe the relationship between multimedia synchronous broadcasting and control. SMIL is a language based on Xml grammar, which defines time tags, layout tags, media embedded tags, etc. Using SMIL language can easily describe the time and space arrangement relationship between various media. Chinese patent No. 031537413 discloses a method to solve the split-screen problem through Html language. In a large Html, it contains multiple Frame domains. Each Frame domain can play different content at the same time. An Html interpreter is embedded in the player. , that is, the browser, so that the browser displays the content in multiple Frame fields according to the layout of Html.

In the existing multimedia synchronous broadcast control technology, such as SMIL authoring tools LimSee2 and ADSmiler, the multimedia synchronous broadcast control relationship is mostly directly stored in the form of a specific broadcast control file, that is, the multimedia content is described through special text tags or binary codes The playback duration, display position, playback sequence, etc.

Due to the lack of a unified hierarchical structure to describe the multimedia synchronous playback control relationship, the existing technology cannot realize the separation of the multimedia synchronous playback control relationship and the playback control file. This has led to the inability to reuse the elements of the multimedia synchronous playback and control relationship in the prior art; at the same time, facing playback terminals that support different playback control files, the prior art does not have the function of "make once, play anywhere".

Contents of the invention

The technical problem to be solved by the present invention is to provide a simple yet flexible design method for a hierarchical structure of multimedia synchronous broadcast control relationship. Based on this hierarchical structure, the multimedia synchronous playback control relationship elements can be separated from the playback control files, and flexible reuse can be realized. Moreover, the multimedia synchronous playback control relationship of this hierarchical structure has nothing to do with the specific playback control language, and can be supported by the playback terminal. language type, generate the corresponding playback control file.

In order to solve the above-mentioned technical problems, the present invention discloses a design method of a hierarchical structure of multimedia synchronous broadcast control relationship. In this method, the multimedia synchronous broadcast control relationship is modeled using a hierarchical structure and a relational database is used to realize the hierarchical structure. The multimedia synchronous play control relationship is mapped to a task to describe the set of play control instructions for all multimedia content, and the task is divided into subtasks on the time axis according to the layout of the video screen division. The relative play time of the subtask is specified in the task of the hierarchical framework of the multimedia synchronous play control relationship, the subtask is played serially in the task, and the play duration of the task is equal to the play of each subtask sum of durations. The hierarchical structure of the multimedia synchronous play control relationship The subtasks can be reused among the tasks, that is, one subtask can be included by multiple tasks.

The present invention also utilizes "split-screen templates" to control the display position of multimedia parallel playback. Each split-screen template is composed of 1-N "split-screen regions", and each split-screen region of the split-screen template can be bound to 1-M multimedia content, thus generating "subtasks". A multimedia synchronous playback is called a "task", which consists of 1-L subtasks and their relative playback time. The "subtask" is used to describe a set of play control instructions that use all multimedia content in the same split-screen template within a continuous play time. Each subtask includes a split-screen template and "play items" contained in all split-screen areas in the split-screen template. In this subtask, the specific multimedia content to be played is bound through the play item and the relative playing time of the multimedia to be played is specified, and the playing position of each multimedia content is described through the split-screen area. In a task, switching of subtasks means switching of split-screen templates. The split screen template is used to describe the video screen division information, each split screen template corresponds to a video screen division layout, the split screen template can include one or more split screen areas, each split screen area corresponds to the display area of the video screen, and simultaneously a virtual The invisible hidden area is used to accommodate audio content that does not need to be displayed. The play item corresponds to a multimedia content, and its relative play start time and play duration are specified. The split-screen template can be reused among the subtasks, that is, one split-screen template can be used by multiple subtasks, and one subtask can also be included by multiple tasks.

The advantage of the present invention is that the design method of the hierarchical framework of the multimedia synchronous broadcast control relationship can realize the multiplexing of the multimedia synchronous broadcast control relationship at the two levels of split-screen template and subtask, and realize the multimedia synchronous broadcast control relationship and the broadcast control file. separation, and can generate corresponding playback control files according to the language types supported by the playback terminal.

Description of drawings

Fig. 1 is a multimedia synchronous broadcast control relationship diagram of the present invention;

Fig. 2 is a database design diagram of the present invention;

Fig. 3 is the physical structure diagram of the present invention;

Fig. 4 is a flow chart of SMIL file generation in the present invention.

Detailed ways

The present invention will be described in further detail below in conjunction with the accompanying drawings and specific embodiments.

The present invention establishes a design method for a set of hierarchical framework describing the relationship of multimedia synchronous broadcasting and control, and the framework uses a relational database to store the relationship of multimedia synchronous broadcasting and control, so as to realize the multiplexing of elements in the relationship of multimedia synchronous broadcasting and control. Based on the hierarchical architecture of multimedia synchronous playback and control relationships, the generation of SMIL files is taken as an example to illustrate the process of generating playback control files.

Fig. 1 is the multimedia synchronous broadcast control relationship diagram of the present invention, and a multimedia synchronous broadcast control relationship corresponds to a task; a task is made up of 1～L " subtasks ", and the play relative time of each subtask is described in the task and multimedia synchronous broadcast The control relationship is mapped as a task, and the task is divided into subtasks on the time axis according to the video division layout. This task is composed of 1-L "subtasks", and the relative playing time of each subtask is described in this task. The subtasks are played serially in the task, and the playing duration of the task is equal to the sum of the playing durations of each subtask. The hierarchical structure of the multimedia synchronous play control relationship The subtasks can be reused among the tasks, that is, one subtask can be included by multiple tasks. A subtask includes a split-screen template and play items contained in all split-screen areas of the split-screen template.

Fig. 2 is the multimedia synchronous play control relational database design diagram of the present invention, and this database mainly relates to 7 core database tables, and the function of each table is:

TEMPLATE table 201: stores the name, width, height, background color and other information of the split-screen template.

AREA table 202: store information such as the name, width, height, upper left vertex coordinates, and background color of the split-screen area. Since the split-screen area and the split-screen template are in a many-to-one relationship, there is a foreign key to the TEMPLATE table in the AREA table.

SUBTASK table 203: storing information such as the name and duration of the subtask. Since both the subtask and the split-screen template have a many-to-one relationship, there is a foreign key to the TEMPLATE table in the SUBTASK table.

MEDIAFILE table 204: stores information such as the file type and file name of the multimedia content.

ITEM table 205: store information such as the name of the play item, the duration, and the serial number of the play item in the split-screen area to which it belongs. Since the play item and subtask, play item and split screen area, play item and multimedia content all have many-to-one relationships, there are foreign keys to SUBTASK, REGION, and MEDIAFILE tables in the ITEM table.

TASK table 206: store task name, duration and other information.

SUBTASKINSTANCE table 207: an association table between the SUBTASK table and the TASK table, which stores information such as the serial number of the subtask in the corresponding task, and this table contains foreign keys to the SUBTASK table and the TASK table.

Fig. 3 is an entity structure diagram of a multimedia synchronous broadcast control relationship, and the present invention adopts the following basic steps to map the multimedia synchronous broadcast control relationship to the hierarchical structure:

Step 301) Map a multimedia synchronous broadcast control relationship to a task entity, and insert a corresponding record in the TASK table.

Step 302) Divide a task on the time axis according to the layout of its video screen division, map each segment to a subtask entity, and insert corresponding records one by one in the SUBTASK table and SUBTASKINSTANCE table.

Step 303) Map the video screen division layout adopted by a subtask into a split-screen template entity, insert a record in the Template table; map each display area on the video screen into a split-screen area entity, and enter the sub-tasks one by one in the Area table Insert the corresponding record.

Step 304) Map each piece of play content in each split-screen area to a play item entity, and insert a corresponding record in the ITEM table.

With reference to Fig. 4, the detailed flow process that generates SMIL format broadcast control file according to described hierarchical structure among the present invention is as follows:

Step 401) For a task, an entity structure as shown in FIG. 3 is established according to the content stored in the relational database.

Step 402) Use layout and region keywords to mark each split-screen region entity shown in FIG. 3 in the header of the SMIL format broadcast control file.

Step 403) Use the seq keyword to mark the task entity shown in FIG. 3 , and set the repeatCount attribute of seq to 1.

Step 404) In the task seq structure marked in step 403), each subtask entity shown in FIG. 3 is marked with the keyword par, and its dur attribute is set to the duration of the corresponding subtask.

Step 405) In the par structure of each subtask marked in step 404), each split-screen area entity shown in FIG. 3 is marked with the keyword seq, and the repeatCount attribute of seq is set to indefinite.

Step 406) In the seq structure of each split-screen region entity marked in step 405), the SMIL media embedding tag is used to mark the media content corresponding to each play item entity shown in Figure 3, and its dur attribute is set to the play item The duration of the item, its region attribute is set to the region defined in step 402) of the split-screen area where the play item is located.

The invention discloses a method for designing a hierarchical framework of multimedia synchronous broadcast control relations. The entire framework is irrelevant to specific programming language types, broadcast control file types and file formats, and is universal. For those skilled in the art, without departing from the principle of the invention, making changes to the present invention, for example, adjusting the programming language, broadcast control file format, etc. in the examples, is also regarded as the scope of protection of the present invention.

Claims (4)

1. the method for designing of the layering framework of a multimedia synchronous broadcast and control relationship; This method adopts hierarchical structure to carry out modeling multimedia synchronous broadcast and control relationship and adopts relational database to realize this hierarchical structure, and the method for designing concrete steps of described hierarchical structure comprise:

(A) multimedia synchronous broadcast and control relationship is mapped as a task, and this task is divided into the subtask on time shaft according to looking screen division layout;

(B) the relative reproduction time of the said subtask of appointment in said task, subtask serial in said task is play, and the playing duration of said task equals the playing duration sum of each subtasks;

(C) in said subtask, adopt the parallel display position of playing of split screen template and split screen Region control content of multimedia, adopt playitem to control the relative reproduction time of said content of multimedia;

(D) corresponding content of multimedia of a said playitem, an and split screen zone of the split screen template of corresponding its affiliated subtask use is controlled the relative reproduction time of said content of multimedia in said split screen zone simultaneously;

(E) playitem in all the split screen zones in the split screen template that adopts of said subtask adopts parallel mode to play, and all playitem in each split screen zone adopt serial modes to play.

2. the method for designing of the layering framework of multimedia synchronous broadcast and control relationship according to claim 1, it is characterized in that: said subtask is multiplexing between said task, and promptly a subtasks can be comprised by a plurality of tasks.

3. the method for designing of the layering framework of multimedia synchronous broadcast and control relationship according to claim 2; It is characterized in that: corresponding a kind of screen of looking of a said split screen template is divided layout; Said split screen template comprises a plurality of split screens zone; Each split screen zone correspondence is looked the viewing area, a place on the screen, and hiding split screen zone, a place is set to hold the audio content that need not show.

4. the method for designing of the layering framework of multimedia synchronous broadcast and control relationship according to claim 2 is characterized in that; Said split screen template is multiplexing between said subtask, and promptly a split screen masterplate is used by a plurality of subtasks.

Images