CN119211209A

CN119211209A - A method, device and equipment for playing and processing layout documents

Info

Publication number: CN119211209A
Application number: CN202411707522.5A
Authority: CN
Inventors: 刘丹; 王少康; 蔡钧
Original assignee: Hubei Shuke Network Maintenance Technology Co ltd; Jiangsu Shuke Network Maintenance Technology Co ltd; Beijing Shuke Wangwei Technology Co ltd
Current assignee: Hubei Shuke Network Maintenance Technology Co ltd; Jiangsu Shuke Network Maintenance Technology Co ltd; Beijing Shuke Wangwei Technology Co ltd
Priority date: 2024-11-27
Filing date: 2024-11-27
Publication date: 2024-12-27
Anticipated expiration: 2044-11-27
Also published as: CN119211209B

Abstract

The invention provides a playing processing method, device and equipment of format documents, belongs to the technical field of computer information processing, and solves the problem that the format documents are difficult to support mass concurrent reading. The method comprises the steps of obtaining a format document, converting the format document to obtain a plurality of series flow data, carrying out statistical processing on the series flow data to obtain list data, and sending the list data to a client side so that the client side plays according to the list data. According to the scheme, the format document is packaged and transmitted by using the streaming media playing format, so that the format document can support massive concurrent reading, and the application scene of the format document is expanded.

Description

Method, device and equipment for playing layout document

Technical Field

The present invention relates to the field of computer information processing technologies, and in particular, to a method, an apparatus, and a device for playing a layout document.

Background

The format Document format is an electronic Document format with a Fixed layout presentation effect, and a portable file format (Portable Document Format, PDF) and an Open Format Document (OFD) are commonly used. The layout file is presented independently of the device, and the presentation results of the layout are consistent when the layout file is read, printed or printed on various devices. The format document is mainly applied to the release, propagation and archiving of the file after the text is formed, and is characterized in that the layout is fixed, the presentation effect cannot be changed due to the change of software and hardware environment and operation, and the format, layout, font size and the like are completely consistent with those of the paper file.

The traditional format documents are opened and read based on a file mode and also have readers based on a Web mode, but the application is aimed at a single customer use scene, because the format documents exist based on the file mode, massive access for reading is difficult to support, the unified reading progress of a user is difficult to control, and the format documents are difficult to apply in education, demonstration and other scenes.

Disclosure of Invention

The invention provides a playing processing method, device and equipment of a format document, which solve the problem that the format document is difficult to support mass concurrent reading.

In order to solve the technical problems, the technical scheme of the invention is as follows:

The embodiment of the invention provides a playing processing method of a format document, which is applied to a server and comprises the following steps:

Obtaining a format document;

Converting the format document to obtain a plurality of series flow data;

Performing statistical processing on the plurality of streaming data to obtain list data;

And sending the list data to a client so that the client plays according to the list data.

Optionally, converting the layout document to obtain a plurality of streaming data includes:

analyzing and processing the format document to obtain a plurality of page data;

and carrying out format conversion processing on the plurality of page data according to preset codes to obtain a plurality of streaming data.

Optionally, performing format conversion processing on the plurality of page data according to a preset code to obtain a plurality of streaming data, including:

acquiring a plurality of caption data;

Matching and combining the plurality of page data with the plurality of caption data to obtain combined data;

And carrying out format conversion processing on the combined data according to preset codes to obtain a plurality of streaming data.

Optionally, performing statistical processing on the plurality of streaming data to obtain list data, including:

acquiring a plurality of address data of the plurality of streaming data, wherein each streaming data corresponds to one address data;

and combining the plurality of address data according to the playing sequence of the plurality of streaming data to obtain list data.

Optionally, the list data further includes preset encoding data.

The embodiment of the invention also provides a playing processing method of the format document, which is applied to the client, and comprises the following steps:

Receiving list data sent by a server;

analyzing the list data to obtain preset coding data and a plurality of address data;

Obtaining a plurality of series flow data according to the plurality of address data;

and analyzing the plurality of streaming data according to the preset coding data to obtain playing data and playing the playing data.

The embodiment of the invention also provides a playing processing device of the format document, which is applied to the server and comprises the following steps:

The acquisition module is used for acquiring the format document;

The first processing module is used for converting the format document to obtain a plurality of series flow data, and carrying out statistical processing on the series flow data to obtain list data;

And the sending module is used for sending the list data to the client so that the client plays according to the list data.

The embodiment of the invention also provides a playing processing device of the format document, which is applied to the client and comprises the following steps:

the receiving module is used for receiving the list data sent by the server;

The second processing module is used for analyzing the list data to obtain preset coding data and a plurality of address data;

the receiving module is further used for obtaining a plurality of streaming data according to the plurality of address data;

The second processing module is further configured to parse the plurality of stream data according to the preset encoded data, obtain playing data, and play the playing data.

The embodiment of the invention also provides a computing device which comprises a processor and a memory storing a computer program, wherein the computer program is used for executing the method when being run by the processor.

The embodiment of the invention also provides a computer readable storage medium, which stores instructions that, when executed on a computer, cause the computer to perform the method described above.

The technical scheme of the invention at least comprises the following effects:

The scheme of the invention obtains the format document, carries out conversion processing on the format document to obtain a plurality of series flow data, carries out statistical processing on the series flow data to obtain list data, and sends the list data to a client so that the client plays according to the list data, and can carry out format conversion on the format document by taking page numbers as units in combination with a play list mode of network streaming media play and form a play list conforming to a preset format specification in the format of streaming media, thereby carrying out massive propagation and distribution by using a network and realizing live broadcast or other value-added application of the format document.

Drawings

FIG. 1 is a flowchart of a method for processing playing of a layout document according to an embodiment of the present invention;

FIG. 2 is a flowchart of a method for processing playing of a layout document according to an embodiment of the present invention;

FIG. 3 is a block diagram of a playback processing apparatus for a layout document of a server according to an embodiment of the present invention;

FIG. 4 is a block diagram of a playback processing device for a layout document of a client according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a computing device provided by an embodiment of the invention.

Detailed Description

Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present invention are shown in the drawings, it should be understood that the present invention may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.

As shown in fig. 1, an embodiment of the present invention provides a method for processing playing of a layout document, which is applied to a server, and the method includes:

step 11, obtaining a format document;

step 12, converting the format document to obtain a plurality of series flow data;

step 13, performing statistical processing on the plurality of streaming data to obtain list data;

and step 14, the list data is sent to a client, so that the client plays according to the list data.

In this embodiment, the format Document refers to a Document with a Fixed layout, such as a file with a portable file format (Portable Document Format, PDF), an Open Format Document (OFD), etc., where the positions of the text, picture, table, etc. elements in the Document on the page are Fixed and not changed by different software or devices;

For example, a PDF analysis library can be used for extracting text and image information for a PDF document, after conversion processing, the original format document is decomposed into a plurality of independent streaming data, and each streaming data is stored in a server in the form of an independent streaming file;

summarizing, classifying, sorting and the like the plurality of streaming files to generate list data with specific structures and formats, wherein the list data records the downloading addresses, the playing sequence and decoding information of the plurality of streaming files;

After receiving the list data, the client can download each series flow file to the local for caching according to the download addresses of a plurality of series flow files, and decode and play the series flow files in turn at the local according to the play sequence and decoding information recorded in the list data.

According to the embodiment of the invention, the format document is packaged and transmitted by using the streaming media playing format, so that the format document can support massive concurrent reading, and the application scene of the format document is expanded.

In an alternative embodiment of the present invention, step 12 may include:

Step 121, analyzing and processing the format document to obtain a plurality of page data;

In step 122, format conversion processing is performed on the plurality of page data according to a preset code, so as to obtain a plurality of streaming data.

In the embodiment, a format document is analyzed and processed, the structure of the format document is read, pages in the document are identified to obtain a plurality of page data, the extracted page content is subjected to format conversion processing according to preset codes, such as a high-level compressed digital video codec standard (H.264 code) and an advanced audio code (Advanced Audio Coding, AAC), so as to obtain a plurality of streaming data, each streaming data is stored in a server in a form of an independent streaming file, information such as a comment, a caption and the like can be added in the process to adapt to various application scenes, specifically, a plurality of comment caption data are firstly obtained, the page data and the comment data are matched and combined to obtain combined data, and the combined data is subjected to format conversion processing according to the preset codes to obtain the streaming data.

In an alternative embodiment of the present invention, step 13 may include:

step 131, obtaining a plurality of address data of the plurality of stream data, wherein each stream data corresponds to one address data;

and 132, merging the plurality of address data according to the playing sequence of the plurality of streaming data to obtain list data.

In this embodiment, after the streaming data is stored in the server in the form of an independent streaming file, each streaming data corresponds to a unique network address, and according to the network address, the streaming data can be accessed and downloaded; and acquiring a plurality of address data of the plurality of streaming data, and combining the plurality of address data according to the playing sequence of the plurality of streaming data to obtain list data, wherein the list data comprises downloading addresses, playing sequence, decoding information and the like of a plurality of streaming files.

As shown in fig. 2, a specific embodiment of a method for playing a layout document according to an embodiment of the present invention is as follows:

step 1, obtaining a format document;

the layout document is obtained in a number of ways, such as by reading from a local file system, downloading from a web server, extracting from a database, etc.

Step 2, converting the format document to obtain a plurality of series flow data;

In particular, when the format document is converted into a video format supported by a playlist, that is, in order to enable the format document to be played by using a traditional video player, the format document needs to be transcoded into the video format by taking a page as a unit, that is, the image is transcoded into the video format, and a Transport Stream (TS) format is adopted as the encapsulation format.

Here, the playlist is a multimedia playlist file format, mainly used for online video playback. The playlist includes an index file, and video network addresses placed on the server are acquired through parsing the index file, so that online playing is realized, including but not limited to an M3U8 playlist.

In the conversion process, besides converting the video format of the document by taking the page as a unit and adding the presentation time length parameter, information such as a caption, a subtitle and the like can be added in the process so as to adapt to various application scenes. The method has the advantages that the common streaming media player can be used for playing and presenting, and can be suitable for various equipment terminals and operating system platforms, and the program part codes of the conversion process are as follows:

#EXTM3U

#EXT-X-VERSION:3

#EXT-X-TARGETDURATION:10

#EXT-X-MEDIA-SEQUENCE:0

.........

#EXTINF:10,

http://media.example.com/page1.ts

#EXTINF:10,

http://media.example.com/page2.ts

#EXTINF:10,

http://media.example.com/page3.ts

.........

#EXT-X-ENDLIST

The code shows that a layout document is subjected to video conversion in units of pages, and each page of the layout document generates a video file with ts as a suffix.

Step 3, carrying out statistical processing on the plurality of streaming data to obtain list data;

in the step, a plurality of streaming data are subjected to statistical processing according to a play list to obtain list data, and a list file is formed, namely a play list of a format document is formed;

The list generation process can be one-time generation or dynamic generation of one page;

Because the video files with ts as the suffix are not files in standard video format, the client can not play the video files with ts as the suffix by using a traditional streaming media player, but must use a specific player for supporting format file analysis, and the program part code of the statistical processing procedure is as follows:

#EXT-X-VERSION:3

#EXT-X-TARGETDURATION:10

#EXT-X-MEDIA-SEQUENCE:0

.........

#EXTINF:10,

http://media.example.com/page1.ofd

#EXTINF:10,

http://media.example.com/page2.ofd

#EXTINF:10,

http://media.example.com/page3.ofd

.........

#EXT-X-ENDLIST

And step 4, sending the list data to a client so that the client plays according to the list data.

In the step, a server supporting HTTP(s) protocol can be used for data transmission and distribution, for example, an Nginx server is used for supporting various common Internet distribution strategies and technologies such as load balancing;

After the list data is sent to the client, the implementation of downloading and playing presentation of the client specifically includes:

(1) Acquiring a subplay list, wherein the client downloads the selected subplay list, and the subplay list comprises download addresses (URLs) of media slices;

(2) Downloading slices, namely downloading media slices by the client through HTTP requests according to the sequence in the sub-play list;

(3) Buffering playing, namely, the client buffers and continuously plays the slice while downloading so as to realize the effect of streaming media playing;

(4) The method comprises the steps of dynamically updating a sub-play list possibly along with live broadcasting, periodically re-downloading the sub-play list by a client to obtain new slice information, and calling a parser of a corresponding format document for the format document to parse and then display.

According to the embodiment of the invention, the format document is transcoded into the video format by taking the page as a unit, for example, the image is transcoded into the video format, the packaging format adopts the Transport Stream (TS) format, and under the condition that the format document file format needs to be reserved, the transcoding is not needed to be the video format, the segmentation of the format document of a single page is directly carried out by taking the page as a unit, and the original edition type document can generate a corresponding number of format files according to the number of page numbers. The index list file generation of the playlist is consistent regardless of whether the pages of the layout document are video transcoded, and the fields in the index file format of the standard playlist include:

EXT-X-TARGETDURATION, which specifies a maximum value of the duration (duration) of the media files in the playlist of media files, the duration defined in the EXTINF tag must be less than or equal to the duration specified by the tag;

The uniform resource identifier (Uniform Resource Identifier, URI) of each MEDIA file (TS) in the playlist file has a fixed unique serial number in the playlist file. The SEQUENCE number of the URI is equal to the SEQUENCE number of the URI preceding it plus 1, i.e. the SEQUENCE number between neighbors plus 1, which is used to switch code rates for alignment at master boot record (MBR, master Boot Record), EXT-X-MEDIA-SEQUENCE indicates the SEQUENCE number of the first URI present in the playlist file;

EXTINF, the duration of the slice play in seconds;

URL links, which are relative or absolute link addresses for each segment;

The embodiment of the invention can realize the realization of the multi-version real-time switching function of the format document by utilizing the characteristic of the play list format on the multi-code stream, besides supporting the multi-code stream, the source format document is not necessarily prepared in advance, and the real-time transcoding and the updating of the index of the play list can be realized by utilizing the format document stream generated in real time by utilizing the overprinting or large model technology, thereby realizing the live broadcast of the format document, and being very useful for the education field. The format document and the video can be combined, for example, a section of format document page is played, and a section of video is played, so that the mode of presenting the graphics context and the video is formed, and the application scene is richer.

When the client plays and presents the format document, if the format document is subjected to video transcoding, the conventional player can be used for playing, and the player has corresponding software on various hardware platforms and various operating systems, so that the player is very easy to obtain and use.

If the original format document is not transcoded, a small format file is formed according to paging, the traditional player cannot analyze and present the original format file, and a special decoder plug-in needs to be developed to complete analysis and playing. When applied as a live broadcast, the new content is continuously generated in real time, so that the characteristic of incremental update of a play list mechanism can be utilized to realize the streaming play of the format document.

After format documents are converted into index files of the play list, all small files are stored on an HTTP server, so that the link addresses in the play list are all accessible links, and a CDN mechanism can be used for carrying out load balancing on a distribution network so as to cope with massive users and concurrent requests. The multi-code stream characteristic of the play list can be utilized to select a desired play code rate according to the user demands of different terminals.

According to the embodiment of the invention, the format conversion is carried out on the format document by taking the page number as a unit in combination with the play list mode of network streaming media play, and the play list conforming to the play list format specification is formed by the format of streaming media, so that the streaming media distribution technology can be utilized, mass propagation and distribution can be carried out by utilizing a CDN network, and live broadcast or other value-added application of the format document can be realized.

step 21, receiving list data sent by a server;

step 22, analyzing the list data to obtain preset coding data and a plurality of address data;

Step 23, obtaining a plurality of streaming data according to the plurality of address data;

and step 24, analyzing the plurality of streaming data according to the preset coding data to obtain playing data and playing the playing data.

In this embodiment, a client receives list data from a server through a network connection, parses the list data, identifies and separates preset encoded data and a plurality of address data, wherein the preset encoded data is a specific encoding scheme or key for decoding the stream data later, the address data points to a server or resource location where the stream data is stored or transmitted, the system obtains actual stream data by using the address data parsed from the list data, the process of obtaining the actual stream data comprises establishing the network connection, sending a request, receiving response data and processing any possible error or retry logic, finally, the client parses the obtained plurality of stream data so as to be capable of playing, decodes the stream data by using the preset encoded data, converts the decoded data into a format suitable for playing, once the stream data is successfully decoded and converted into playing data, the client can send the playing data to a display and a loudspeaker for playing, if the playing is a format document after video transcoding, the playing can be played by using a conventional player, the player can play by using a corresponding hardware platform, various operation systems, can be easily converted into a new format by using a media plug-in, and can not be easily played by playing a media plug-in device in a real-time format when the media is not required to be played by playing a real-time, and a special media is not being played by a media playing device is not developed by a real-time, and a special media is not being played by a media is played a specific a media is played, the feature of playlist mechanism incremental update may be utilized here to enable streaming play of the layout document.

As shown in fig. 3, the embodiment of the present invention further provides a playing processing device 30 of a layout document, which is applied to a server and includes:

An obtaining module 31, configured to obtain a layout document;

the first processing module 32 is configured to perform conversion processing on the layout document to obtain a plurality of streaming data;

and the sending module 33 is configured to send the list data to a client, so that the client plays according to the list data.

Optionally, the first processing module 32 is specifically configured to:

acquiring a plurality of caption data;

Optionally, the first processing module 32 is further specifically configured to:

Optionally, the list data further includes preset encoding data.

It should be noted that, the device is a device corresponding to the above-mentioned playing processing method for the format document of the server, and all implementation manners in the above-mentioned method embodiment are applicable to this embodiment, so that the same technical effects can be achieved.

As shown in fig. 4, the embodiment of the present invention further provides a playing processing device 40 of a layout document, which is applied to a client, and includes:

a receiving module 41, configured to receive list data sent by a server;

a second processing module 42, configured to perform parsing processing on the list data to obtain preset encoded data and a plurality of address data;

The receiving module 41 is further configured to obtain a plurality of streaming data according to the plurality of address data;

the second processing module 42 is further configured to parse the plurality of stream data according to the preset encoded data to obtain playing data and play the playing data.

It should be noted that, the device is a device corresponding to the above-mentioned playing processing method for the format document of the client, and all implementation manners in the above-mentioned method embodiment are applicable to the embodiment, so that the same technical effects can be achieved.

As shown in fig. 5, the embodiment of the present invention further provides a computing device 50, which includes a processor 51, a memory 52, and a program or an instruction stored in the memory 52 and capable of running on the processor 51, where the program or the instruction implements each process of the above embodiment of the playing processing method of the layout document when executed by the processor 51, and the same technical effects can be achieved, so that repetition is avoided, and no further description is given here. It should be noted that, the computing device in the embodiment of the present invention includes the mobile electronic device and the non-mobile electronic device described above.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.

In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of elements is merely a logical functional division, and there may be additional divisions of actual implementation, e.g., multiple elements or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method of the embodiments of the present invention. The storage medium includes various media capable of storing program codes such as a U disk, a mobile hard disk, a ROM, a RAM, a magnetic disk or an optical disk.

Furthermore, it should be noted that in the apparatus and method of the present invention, it is apparent that the components or steps may be disassembled and/or assembled. Such decomposition and/or recombination should be considered as equivalent aspects of the present invention. Also, the steps of performing the series of processes described above may naturally be performed in chronological order in the order of description, but are not necessarily performed in chronological order, and some steps may be performed in parallel or independently of each other. It will be appreciated by those of ordinary skill in the art that all or any of the steps or components of the methods and apparatus of the present invention may be implemented in hardware, firmware, software, or a combination thereof in any computing device (including processors, storage media, etc.) or network of computing devices, as would be apparent to one of ordinary skill in the art after reading this description of the invention.

The object of the invention can thus also be achieved by running a program or a set of programs on any computing device. The computing device may be a well-known general purpose device. The object of the invention can thus also be achieved by merely providing a program product containing program code for implementing the method or the apparatus. That is, such a program product also constitutes the present invention, and a storage medium storing such a program product also constitutes the present invention. Obviously, the storage medium may be any known storage medium or any storage medium developed in the future. It should also be noted that in the apparatus and method of the present invention, it is apparent that the components or steps may be disassembled and/or assembled. Such decomposition and/or recombination should be considered as equivalent aspects of the present invention. The steps of executing the series of processes may naturally be executed in chronological order in the order described, but are not necessarily executed in chronological order. Some steps may be performed in parallel or independently of each other.

The foregoing is a preferred embodiment of the present invention and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present invention and are intended to be comprehended within the scope of the present invention.

Claims

1. A method for playing and processing a layout document, characterized in that it is applied to a server, and the method comprises:

Get the layout document;

Converting the format document to obtain multiple stream data;

Performing statistical processing on the plurality of stream data to obtain list data;

The list data is sent to the client, so that the client plays according to the list data.

2. The method for playing a layout document according to claim 1, wherein the layout document is converted to obtain a plurality of stream data, including:

Analyzing and processing the layout document to obtain a plurality of page data;

The plurality of page data are format-converted according to a preset encoding to obtain a plurality of stream data.

3. The method for playing and processing layout documents according to claim 2, wherein the plurality of page data are format converted according to a preset encoding to obtain a plurality of stream data, including:

Get multiple subtitle data;

Matching and merging the plurality of page data with the plurality of commentary subtitle data to obtain merged data;

The combined data is format-converted according to a preset encoding to obtain a plurality of stream data.

4. The method for playing and processing layout documents according to claim 1, wherein the plurality of stream data are statistically processed to obtain list data, comprising:

Acquire multiple address data of the multiple stream data, wherein each stream data corresponds to one address data;

The plurality of address data are merged and processed according to the playback order of the plurality of stream data to obtain list data.

5. The playback processing method of layout documents according to claim 4 is characterized in that the list data also includes preset encoding data.

6. A method for playing and processing a layout document, characterized in that it is applied to a client and comprises:

Receive list data sent by the server;

Parsing the list data to obtain preset coding data and multiple address data;

Obtaining a plurality of stream data according to the plurality of address data;

The plurality of stream data are parsed and processed according to the preset encoding data to obtain playback data and the playback data is played.

7. A layout document playback processing device, characterized in that it is applied to a server and comprises:

Acquisition module, used to obtain layout documents;

The first processing module is used to convert the format document to obtain a plurality of stream data; perform statistical processing on the plurality of stream data to obtain list data;

The sending module is used to send the list data to the client so that the client plays according to the list data.

8. A playback processing device for layout documents, characterized in that it is applied to a client and comprises:

A receiving module, used for receiving list data sent by the server;

A second processing module is used to parse the list data to obtain preset coding data and multiple address data;

The receiving module is further used to obtain a plurality of stream data according to the plurality of address data;

The second processing module is further used to parse and process the plurality of stream data according to the preset encoding data to obtain playback data and play the playback data.

9. A computing device, comprising: a processor and a memory storing a computer program, wherein when the computer program is executed by the processor, the method according to any one of claims 1 to 5 or the method according to claim 6 is executed.

10. A computer-readable storage medium, characterized in that instructions are stored therein, and when the instructions are executed on a computer, the computer executes the method according to any one of claims 1 to 5 or the method according to claim 6.