CN113762018B - Content synchronization method, device, electronic device and storage medium - Google Patents
Content synchronization method, device, electronic device and storage medium Download PDFInfo
- Publication number
- CN113762018B CN113762018B CN202110043687.7A CN202110043687A CN113762018B CN 113762018 B CN113762018 B CN 113762018B CN 202110043687 A CN202110043687 A CN 202110043687A CN 113762018 B CN113762018 B CN 113762018B
- Authority
- CN
- China
- Prior art keywords
- target
- content
- reading
- page number
- page
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/332—Query formulation
- G06F16/3322—Query formulation using system suggestions
- G06F16/3323—Query formulation using system suggestions using document space presentation or visualization, e.g. category, hierarchy or range presentation and selection
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/103—Formatting, i.e. changing of presentation of documents
- G06F40/109—Font handling; Temporal or kinetic typography
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Mathematical Physics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention discloses a content synchronization method, a device, electronic equipment and a storage medium, wherein the method comprises the steps of obtaining a target image and extracting target reading content in the target image; the target reading content is the content of the current reading of the user on the paper book, the target reading page number of the target reading content in the target electronic book is determined by matching the target reading content with the book content of the target electronic book corresponding to the paper book, and the target electronic book is jumped from the current reading page to the target reading page corresponding to the target reading page number. According to the technical scheme, the picture corresponding to the reading content of the paper book by the user is obtained and matched with the content of the electronic book, so that the target page number of the content in the image in the electronic book is automatically and rapidly positioned, the content corresponding to the target page number is displayed, and the technical effect of content synchronization is achieved.
Description
Technical Field
The embodiment of the invention relates to the technical field of computers, in particular to a content synchronization method, a content synchronization device, electronic equipment and a storage medium.
Background
With the popularity of mobile devices and electronic books, more and more users may utilize the shard time to read books on mobile devices. To improve the user reading experience, paper books are read at other times. When a user reads the same book on both the mobile device and the paper book, there is a problem that the user cannot synchronize to the same position of the electronic book directly according to the content read on the paper book, that is, the user cannot continue to read the previous content.
In order to solve the problem of asynchronous reading content, the method is adopted at present, wherein a user turns pages in a book displayed on a mobile device in sequence according to the content currently read in a paper book and views specific content in the page until the searched content is the same as the content currently read.
The inventors found that when implementing the present technical solution based on the above-described mode, the following problems exist:
When a specific page of the currently read content in the electronic book is determined manually, the technical problems of low searching efficiency, complex operation and long time consumption exist.
Disclosure of Invention
The invention provides a content synchronization method, a device, electronic equipment and a storage medium, which are used for conveniently and efficiently determining the specific page number of the current reading content of a user on a paper book in the electronic book and displaying the page number content, so that the technical effect of reading progress synchronization is achieved.
In a first aspect, an embodiment of the present invention provides a content synchronization method, including:
Acquiring a target image and extracting target reading content in the target image, wherein the target reading content is the content read by a user on a paper book at present;
Determining target reading page numbers of the target reading contents in the target electronic books by matching the target reading contents with the book contents of the target electronic books corresponding to the paper books, wherein the matching processing comprises matching processing based on catalogue information and/or matching processing based on content similarity;
And jumping the target electronic book from the current reading page to a target reading page corresponding to the target reading page number.
In a second aspect, an embodiment of the present invention further provides a content synchronization apparatus, where the apparatus includes:
the reading content extraction module is used for acquiring a target image and extracting target reading content in the target image, wherein the target reading content is the content read currently by a user on a paper book;
the reading page number determining module is used for determining a target reading page number of the target reading content in the target electronic book by carrying out matching processing on the target reading content and the book content of the target electronic book corresponding to the paper book, wherein the matching processing comprises matching processing based on catalog information and/or matching processing based on content similarity;
And the reading page jumping module is used for jumping the target electronic book from the current reading page to the target reading page corresponding to the target reading page number.
In a third aspect, an embodiment of the present invention further provides an electronic device, including:
One or more processors;
Storage means for storing one or more programs,
The one or more programs, when executed by the one or more processors, cause the one or more processors to implement the content synchronization method as described in any of the embodiments of the present invention.
In a fourth aspect, embodiments of the present invention also provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform a content synchronization method according to any of the embodiments of the present invention.
According to the technical scheme, the target reading page number of the target reading content in the electronic book is determined by carrying out matching processing on the target image comprising the target reading content and the book content of the electronic book, and the target reading page number is jumped to continue the continuous reading of the paper book content, so that the technical effect of synchronizing the paper book reading content and the electronic book reading content is achieved.
Drawings
In order to more clearly illustrate the technical solution of the exemplary embodiments of the present invention, a brief description is given below of the drawings required for describing the embodiments. It is obvious that the drawings presented are only drawings of some of the embodiments of the invention to be described, and not all the drawings, and that other drawings can be made according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a flowchart of a content synchronization method according to a first embodiment of the present invention;
Fig. 2 is a flow chart of acquiring basic information of electronic books and paper books according to a second embodiment of the invention;
Fig. 3 is a schematic diagram of another process for obtaining basic information of electronic books and paper books according to a second embodiment of the present invention;
fig. 4 is a flow chart of a content synchronization method according to a third embodiment of the present invention;
fig. 5 is a schematic flow chart of a content synchronization method according to a fourth embodiment of the present invention;
Fig. 6 is another flow chart of a content synchronization method according to a fifth embodiment of the present invention;
Fig. 7 is a schematic structural diagram of a content synchronization device according to a sixth embodiment of the present invention;
Fig. 8 is a schematic structural diagram of an electronic device according to a seventh embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings.
Example 1
Fig. 1 is a schematic flow chart of a content synchronization method according to an embodiment of the present invention, where the embodiment is applicable to a situation that a specific page number of a read content in an electronic book is determined and is jumped to a corresponding page number according to the read content of a user in the electronic book, so as to realize synchronization of the read content.
Before the technical scheme is introduced, a specific application scene can be illustrated. With the popularization of electronic books, users can read not only paper books but also electronic books. Typically, the reading software may be installed on an electronic device, such as a mobile terminal. There are a large number of electronic books in the reading software, and the user can trigger the corresponding electronic books to read. In the actual reading process, the user can adjust the font size in the electronic book according to the actual requirement. Therefore, the same content differs between the electronic book and the page number corresponding to the paper book. The embodiment may be a scheme of determining a reading content corresponding to a certain page number of a paper book, and displaying a target reading content of the target reading page number in the electronic book.
As shown in fig. 1, the method of this embodiment includes:
S110, acquiring a target image, and extracting target reading content in the target image.
When the user needs to determine that the current reading content is in a specific page number of the electronic book, an image including the current reading content can be shot based on the camera device, and the image can be taken as a target image. Accordingly, since the target image includes the content that the user currently reads on the paper book, the target reading content is the content that the user currently reads on the paper book.
For example, when a user needs to read the book on the electronic device, in order to continue reading the content of the paper book on the electronic device, the user may acquire the content currently read on the paper book, for example, shoot the content currently read by the user on the paper book, and obtain the target image. Furthermore, text information of the target image can be extracted, and the text information is used as target reading content.
In the embodiment, the method for extracting the target reading content in the target image comprises the steps of determining line areas containing text information in the target image, identifying the text information in the line areas, and generating the target reading content based on the text information in each line area.
In the practical application process, there may be a case that the characters of the same text line in the target image are not on the same horizontal line, and at this time, there may be a problem that specific character content cannot be identified. To avoid this problem, the target image may be preprocessed. The preprocessing may be to perform tilt correction on the target image so that the content of the same text line is located on the same horizontal line, thereby facilitating subsequent text extraction. After the correction is completed, a line area containing characters can be identified through a character detection algorithm such as MSER or CTPN, and then specific contents in the character line are extracted through a character identification algorithm such as CRNN or Seq2Seq, so that target reading contents are obtained.
S120, determining target reading page numbers of target reading contents in the target electronic books by matching the target reading contents with the book contents of the target electronic books corresponding to the paper books.
It should be noted that, the number of words displayed in each line of the paper book is generally fixed, and the user can adjust the font size on the electronic book, so that the number of words displayed in each line is different from the number of words displayed in each line of the paper book. That is, the page numbers corresponding to the same content in the electronic book and the paper book are different, and furthermore, the user can adjust the font size of the displayed electronic book, so that when the same content selects fonts with different sizes, the page numbers corresponding to the same content in the electronic book are also different.
After determining the display word size of the electronic book, determining a specific page number of the target reading content in the electronic book as a target reading page number.
Specifically, after the target reading content in the target image is extracted, matching processing can be performed based on the target reading content and the content in the electronic book corresponding to the paper book, and a specific page number of the target reading content in the electronic book, namely, a target reading page number, can be determined according to a matching processing result.
In the present embodiment, the matching processing includes matching processing based on directory information and/or matching processing based on content similarity. The matching processing based on the catalog information can be to determine whether the target reading content comprises the catalog or not, if yes, the reading position of the target reading content in the electronic book can be determined according to the catalog information, and then the target reading page number can be determined, and the content similarity processing can be to determine the similarity between the target reading content and the content displayed by each page number of the electronic book to determine the target reading page number. Or, whether the target reading content includes a catalog or not may be determined first, if yes, the corresponding reading page number to be selected may be determined, and if the user marks the corresponding content, the content corresponding to the reading page number to be selected may be started from the marked position, and the similarity between the target reading content and the content of each page number may be determined, so as to determine the target reading page number.
S130, jumping the target electronic book from the current reading page to a target reading page corresponding to the target reading page number.
It should be noted that, if the user previously reads the electronic book using the mobile device, the user may jump to the page number when reading the electronic book on the same terminal device.
Wherein, the page remained in the electronic book after the user finishes the previous reading is used as the current reading page. The target reading page number is a specific page number of the target reading content in the electronic book.
Specifically, the user can trigger the control of the content synchronization function on the electronic book, and when the triggering of the key is detected, the user can jump from the current reading page number to the target reading page number, so that the technical effect of reading content synchronization is realized.
According to the technical scheme, the target reading page number of the target reading content in the electronic book is determined by carrying out matching processing on the target image comprising the target reading content and the book content of the electronic book, and the target reading page number is jumped to continue the continuous reading of the paper book content, so that the technical effect of automatic synchronization of the paper book reading content and the electronic book reading content is realized.
Example two
Fig. 2 is a flowchart of acquiring basic information of an electronic book and a paper book according to a second embodiment of the present invention. On the basis of the foregoing embodiments, the basic information of the paper book and the electronic book corresponding to the paper book may be acquired before determining the target page number of the target reading content in the target image in the electronic book. Wherein, the technical terms identical to or corresponding to the above embodiments are not repeated herein.
As shown in fig. 2, the method includes:
S210, calling the book content of the target electronic book, and acquiring catalogue information from the book content.
The book content comprises catalogue information of the electronic books, specific content corresponding to each catalogue in the catalogue information and page numbers of each catalogue in the electronic books.
Specifically, after detecting that a user triggers reading software installed on the mobile terminal, the user can enter a home page corresponding to the reading software, wherein the home page can comprise a plurality of types of books. The user can search for a corresponding electronic book according to the name of the paper book. After the electronic book is determined, the book content of the electronic book may be acquired, and catalogue information of the electronic book may be read from the book content. At the same time, the page number corresponding to the directory information in the electronic book is determined.
Illustratively, the paper book that the user reads is named a. If the user reads the book on the terminal for the first time, the user can input the book name A in the search control after triggering the reading software on the mobile terminal, and the electronic book corresponding to the book name A is called from the electronic book library, and if the user has read the book with the book name A on the electronic device, the electronic book can be obtained from the history reading record. After the electronic book corresponding to the paper book name is acquired, book contents of the electronic book, such as catalog information, specific text information opposite to the catalog information, and page numbers corresponding to the catalog information, may be acquired.
S220, generating a catalog expression set corresponding to the catalog information according to the catalog information, so that when the catalog expression exists in the target reading content, the target reading page number of the target reading content in the target electronic book is determined according to the target catalog corresponding to the target expression.
In general, a catalog of books is written according to a certain rule, and the catalog formation of the books can be determined by processing the acquired catalog information. The constituent form of the directory may be referred to as a directory expression.
The directory information includes a main directory and sub-directories, and expressions corresponding to different directory levels may be the same or different, so that the determined directory expression may be one or more. Accordingly, there may be multiple elements in the set of directory expressions, one for each element.
Specifically, a main directory and a sub-directory in the directory information can be obtained, and the formation forms of the main directory and the sub-directory are extracted respectively to obtain at least one directory expression corresponding to the electronic book, wherein common directory expressions comprise chapter X X.X, chapter 1 and chapter 1.1. After determining the directory expression, it may be determined whether the directory expression is included in the target reading content, and further, a target reading page number of the target reading content in the electronic book is determined based on the directory expression.
S230, based on an imaging device on the terminal equipment to which the target electronic book belongs, shooting the current read content of the user in the paper book to obtain a target image.
The camera device may be a camera on the terminal device. The content currently read by the user on the paper book can be used as the content currently read by the user, for example, if the user reads the 45 th page on the paper book, the content presented on the 45 th page on the paper book can be used as the content currently read by the user. The content of the 45 th page of the paper book can be shot based on the image shooting device, and the shot image is taken as a target image.
Specifically, after the user triggers the electronic book, a content synchronization control may be triggered. After the user triggering the content synchronization control is detected, a camera on the terminal equipment can be opened, and target reading content of the user on the paper book is shot based on the camera, so that a target image comprising the target reading content is obtained.
S240, acquiring a target image, and extracting target reading content in the target image, wherein the target reading content is the content read by a user on the paper book.
S250, determining target reading page numbers of target reading contents in the target electronic books by matching the target reading contents with the book contents of the target electronic books corresponding to the paper books.
S260, jumping the target electronic book from the current reading page to a target reading page corresponding to the target reading page number.
According to the technical scheme, the target reading content in the image can be extracted by acquiring the book information of the electronic book and the image comprising the content read by the user on the paper book in advance, and the specific reading page number of the target reading content in the electronic book is determined, so that the technical effect of synchronizing the reading content of the electronic book and the paper data is achieved.
As an alternative embodiment of the foregoing embodiment, fig. 3 is another flow chart of acquiring basic information of an electronic book and a paper book according to the second embodiment of the present invention. As shown in fig. 3, the reading software on the terminal device is triggered, and the electronic book identical to the paper book is found and opened from the reading software, i.e. the corresponding electronic book is opened. After the electronic book is opened, triggering a content synchronization control on the display page to start a camera to shoot the content which needs to be synchronized by the electronic book in the paper book, namely shooting the content which is read by the user on the paper book at present, and obtaining a target image. While capturing the target image, book information of the electronic book may be acquired, optionally including text content information and catalog information. Based on the book information and the target image, basic information of the paper book and the electronic book is obtained.
Example III
Fig. 4 is a flowchart of a content synchronization method according to a third embodiment of the present invention. Based on the foregoing embodiment, the foregoing step of "determining the target reading page number of the target reading content in the target electronic book by performing matching processing on the target reading content and the book content of the target electronic book corresponding to the paper book" may be optimized, and a specific implementation manner may be referred to the technical solution of this embodiment. Wherein, the technical terms identical to or corresponding to the above embodiments are not repeated herein.
As shown in fig. 4, the method includes:
S410, calling the book content of the target electronic book, and acquiring catalogue information from the book content.
For example, when it is detected that the user triggers the reading software installed on the mobile device, optionally the mobile device is a mobile phone, the reading software may be opened. A large number of electronic books can be displayed in the reading software, and a user can input the names of the paper books in the search control and trigger the search button to call the electronic books identical to the paper books. Of course, if the user has read the target electronic book in the reading software, the target electronic book may be obtained from the history reading record. After the electronic book is acquired, the book content of the electronic book can be called, and the catalogue information of the electronic book can be read from the book content.
S420, generating a catalog expression set corresponding to catalog information according to the catalog information, so as to determine a target reading page number of target reading content in the target electronic book according to the target catalog corresponding to the target expression when the catalog expression exists in the target reading content.
Specifically, the directory information includes a main directory and a sub-directory, and content extraction can be performed on specific forms of the main directory and the sub-directory respectively to obtain directory expressions of the main directory and the sub-directory. All directory expressions may be considered as one element in the set of directory expressions.
S430, shooting the current read content of the user in the paper book based on the camera device on the terminal equipment to which the target electronic book belongs, and obtaining a target image.
Specifically, while determining the set of target expressions, the user may trigger a synchronization control on the reading software. When the user is detected to trigger the reading synchronization control, the software can call the camera device, such as a camera on the terminal equipment, to shoot the content currently read by the user in the paper book, and the image shot by the camera device can be used as a target image.
It should be noted that the target image includes the content that the user currently reads on the paper book.
S440, acquiring a target image, and extracting target reading content in the target image, wherein the target reading content is the content read by a user on the paper book.
Specifically, after the shooting device acquires the target image, the target image can be acquired, and the target reading content in the target image is extracted by adopting a character recognition algorithm.
S450, when the target reading content is determined to comprise at least one catalog expression based on the catalog expression set, determining target catalogues of each catalog expression in the target reading content respectively.
It should be noted that, in the actual reading process, each reading page may include at least one directory line, or may not include a directory line.
Wherein when a plurality of directory lines are included in the read content, a plurality of directory expressions can be matched. The target directory is specific content corresponding to the directory line, and the specific content can be used as the target directory.
Specifically, based on each directory expression in the directory expression set, whether the target reading content includes the directory expression in the directory expression set can be confirmed line by line, if yes, the target reading content includes the directory row, and if not, the target reading content is indicated to not include the directory row. After determining the catalog line, the contents of the catalog line may be acquired and taken as the target catalog.
S460, determining target reading page numbers of target catalogs in the electronic books from the catalogs information.
Wherein, the content corresponding to the catalog line can be used as the target catalog.
Specifically, if it is determined that the target reading content includes the catalog line, the line content of the catalog line, that is, the target catalog, may be acquired. And determining a target reading page number corresponding to the target directory according to the target directory and the directory information. In this embodiment, if the target reading content includes a plurality of target directories, the target reading page number corresponding to each target directory may be determined respectively.
S470, jumping the target electronic book from the current reading page to a target reading page corresponding to the target reading page number.
If the electronic book is read for the first time, the current reading page can be the first page, and if the electronic book is not read for the first time, the current reading page can be the page corresponding to the previous reading of the electronic book. And taking the page corresponding to the target reading page number as a target reading page.
Specifically, if the target reading content includes a target directory, the number of target reading page numbers is also one. After the target reading page number is determined, the electronic book can be automatically jumped from the current reading page to the target reading page corresponding to the target reading page number. If the target reading content includes a plurality of target directory lines, the number of the determined target reading page numbers may be a plurality of target reading page numbers. The electronic book can be automatically jumped from the current reading page to the target reading page number corresponding to the first target catalog in the target reading content.
Optionally, the target electronic book is jumped from the current reading page to the target reading page corresponding to the first target catalog and the target reading page corresponding to the target reading page is presented, when the trigger page jump control is detected, the target reading page corresponding to the current target catalog is taken as the current reading page and is jumped from the current reading page to the target reading page corresponding to the next target catalog.
It can be understood that if the target reading page includes a plurality of target directories, after determining the target reading page number of each target directory, the target electronic book can be jumped from the current reading page to the target reading page number corresponding to the first target directory, and at this time, the target reading page corresponding to the target reading page number can be presented on the display interface of the mobile terminal. And the user can determine whether the displayed content is the target reading content by browsing the content on the target reading page, and if not, the user can trigger a control for jumping to the page number corresponding to the next target directory on the display interface so as to jump from the target reading page to the target reading page corresponding to the next target directory. For example, when the user triggering the page skip control is detected, the target reading page corresponding to the current target directory is used as the current reading page, and the target reading page corresponding to the next target directory is skipped from the current reading page.
According to the technical scheme, when the target reading content comprises the target catalogue through the pre-extracted catalogue expression set, the target reading page of the target catalogue in the electronic book can be determined according to the catalogue information, and then the electronic book is jumped from the current reading page number to the target reading page number, so that the synchronization of the paper book content and the electronic book content is realized, and the technical effect that the paper book content is continuously read is continued.
Example IV
Fig. 5 is a flowchart of a content synchronization method according to a fourth embodiment of the present invention. Based on the foregoing embodiment, the foregoing step of "determining the target reading page number of the target reading content in the target electronic book by performing matching processing on the target reading content and the book content of the target electronic book corresponding to the paper book" may be optimized, and a specific implementation manner may be referred to the technical solution of this embodiment. Wherein, the technical terms identical to or corresponding to the above embodiments are not repeated herein.
As shown in fig. 5, the method includes:
S510, calling the book content of the target electronic book, and acquiring catalogue information from the book content.
S520, generating a catalog expression set corresponding to the catalog information according to the catalog information, so as to determine a target reading page number of the target reading content in the target electronic book according to the target catalog corresponding to the target expression when the catalog expression exists in the target reading content.
S530, based on the camera device on the terminal equipment to which the target electronic book belongs, shooting the current read content of the user in the paper book, and obtaining the target image.
S540, acquiring a target image, and extracting target reading content in the target image, wherein the target reading content is the content read by a user on the paper book.
S550, if the target reading content is determined to not include the directory expression based on the target directory expression set, determining the current page number of the current reading page of the electronic book.
It can be understood that if the target reading content does not include the catalog line, the current page number corresponding to the current reading page of the electronic book can be obtained.
S560, obtaining the current page content corresponding to the current page number, and carrying out matching processing on the current page content and the target reading content according to the line to obtain a matching degree value of the current page number and the target reading content.
In general, a user continues to read the book from the current page, so the current page content corresponding to the current page number of the electronic book can be used as the starting point for determining the specific page number of the target reading content in the electronic book.
The matching degree value is used for representing the coincidence degree between the current page content and the target reading content, and the higher the matching degree value is, the higher the coincidence degree value is.
Specifically, the current page content corresponding to the current page number is extracted, the current page content is matched with the target reading content according to the line, and the matching degree value between the current page content and the target reading content is determined.
In this embodiment, the obtaining the current page content corresponding to the current page number and performing matching processing on the current page content and the target reading content according to the line to obtain a matching degree value of the current page number and the target reading content includes determining a total text line number in the current page content and obtaining text content of each text line, performing matching processing on the text content of each text line and the target reading content to determine a matched target text line number, and determining a matching degree value of the current page number and the target reading content according to the target text line number and the total text line number.
In general, the size of a display screen of a mobile terminal is smaller than that of a paper book, and the number of words displayed by each line of the electronic book is also smaller than that of the paper book, so that the content of the electronic book can be obtained line by line to be matched with target reading content, and whether the current page number is the target reading page number can be determined according to the matching result.
The current page content is page content corresponding to the current page number in the electronic book. The number of lines displayed per page of the display screen may be taken as the total number of lines of text. The target text line number is how many text lines of the current page content match the target read content. And determining the matching degree value of the current page content of the current page number and the target reading content by calculating the ratio of the number of the target text lines to the total text lines.
For example, the total text line number of the current page content is 20 lines, each line of content is sequentially acquired to be matched with the target reading content, when the content is consistent, the text line can be used as the target text line, alternatively, if the target text line number is 15, the ratio of the target text line number to the total text line number can be calculated, and the matching degree between the current page number and the target reading content is determined to be seventy-five percent.
S570, determining the target reading page number according to the matching degree value.
In this embodiment, determining the target reading page according to the matching degree value includes obtaining a next page of the current page and determining a matching degree value between a current page content of the current page and the target reading content by using the next page as the current page if the matching degree value is smaller than a preset matching degree threshold, and using the current page as the target reading page if the matching degree value is greater than or equal to the preset matching degree threshold.
The preset matching degree value is preset, and optionally, the preset matching degree threshold value is set to be 90%.
Specifically, if 75% of the matching degree value corresponding to the current page number is smaller than the preset matching degree threshold value 90%, it is indicated that the current page may not be the target reading page number. At this time, the next page number of the current page number can be acquired, the next page number is taken as the current page number, and the matching degree value of the current page content of the current page number and the target reading content is determined. When the matching degree of the current page number is detected to be greater than or equal to the page number of the preset matching degree threshold value, the current page number is used as a target reading page number.
In the practical application process, after all the pages are traversed, the situation that the matching degree value between the page content corresponding to each page and the target reading content is smaller than the preset matching degree threshold value can be determined, if the page content corresponding to all the pages is traversed, the page corresponding to each page is determined to be smaller than the preset matching degree threshold value, the page corresponding to the largest matching degree value is determined, and the page is taken as the target reading page.
Specifically, after determining the matching degree value between the page content of each page number and the target reading content, if the matching degree value is smaller than the preset matching degree threshold value, the matching degree value corresponding to the page number may be recorded. After traversing the matching degree of all the page numbers, acquiring the page number corresponding to the maximum matching degree value, and taking the page number as a target reading page number.
S580, the target electronic book is jumped from the current reading page to the target reading page corresponding to the target reading page number.
According to the technical scheme, the target reading page number of the target reading content in the electronic book is determined by carrying out matching processing on the target image comprising the target reading content and the book content of the electronic book, and the target reading page number is jumped to continue the continuous reading of the paper book content, so that the technical effect of synchronizing the paper book reading content and the electronic book reading content is achieved.
Example five
As an alternative embodiment of the foregoing embodiment, fig. 6 is another flow chart of a content synchronization method provided in the fifth embodiment of the present invention. Wherein, the technical terms identical to or corresponding to the above embodiments are not repeated herein.
As shown in fig. 6, the method includes:
S601, acquiring a target image and providing text line content of each text line in the target image.
Specifically, the reading software is triggered and the same electronic book as the paper book is called. And when the control triggering the reading content synchronization is detected, the camera is called to shoot the content read by the user on the paper book, so as to obtain a target image.
After the target image is obtained, text line content of each text line in the target image can be extracted so as to determine whether the text line is a header line, namely a directory expression, and meanwhile, a matching degree value of page content of each page number in the electronic book and content in the target image is determined based on the text line content.
S602, judging whether the text line is a title line or not based on the text line content, if so, executing S603, and if not, executing S604.
Specifically, whether the text line content is a title line or not can be determined according to the text line content and a pre-established directory expression set, if so, the target reading page number corresponding to the target image can be determined based on the title line, and if not, the text line can be integrated into the target reading content.
S603, determining a target reading page number corresponding to the title line according to the electronic book catalog information.
Specifically, the content of the title line may be acquired, and the target reading page number corresponding to the title line may be determined according to the directory information of the electronic book.
S604, integrating text lines to obtain target reading content.
Specifically, text line content can be integrated to obtain target reading content.
S605, acquiring the current reading page number of the electronic book, and acquiring the current reading content corresponding to the current reading page number.
Specifically, the current reading page number of the electronic book is obtained, and the current reading content corresponding to the current reading page number is extracted.
S606, matching the current reading content with the target reading content, and obtaining a matching degree value.
Specifically, the target text line number including the target reading content in the current reading content can be determined through the matching processing of the text line of the current reading content and the target reading content. And determining the matching degree value between the current reading content and the target reading content according to the target text line number and the total text line number of the current reading content.
S607, judging whether the matching degree value is larger than a preset matching degree threshold value, if so, executing S608, and if not, executing S609.
Specifically, if the matching degree value of the current page number is greater than or equal to the preset matching degree threshold value, the current page number is used as the target reading page number. Otherwise, the next page number of the current page number is continuously acquired, and a matching degree value between page content of the next page number and target reading content is determined.
S608, acquiring current reading content corresponding to the current reading page number and displaying the current reading content on a display interface.
Specifically, if the matching degree value between the content corresponding to the current reading page number and the target reading content is greater than or equal to the preset matching degree threshold, the current reading content corresponding to the current reading page number can be presented on the display interface.
S609, recording the current page number and the matching degree value, judging whether the current page number is the last page, if so, executing S610, and if not, executing S611.
Specifically, the matching degree value corresponding to the current page number is recorded, whether the current page number is the last page number is judged, if yes, the page number corresponding to the highest matching degree is obtained according to the matching degree value corresponding to each page number to serve as the target reading page number, otherwise, the next page number of the current page number is obtained, and the matching degree value between the page content corresponding to the next page number and the target reading content is determined.
S610, acquiring a page number corresponding to the highest matching degree value, and taking the page number as a target reading page number.
Specifically, the page number corresponding to the highest matching degree value is determined and used as the target reading page number.
S611, reading content of the next page number of the current page number is obtained as the current reading content, and S606 is executed in a return mode.
Specifically, the next page number of the current page number is obtained, the reading content corresponding to the next page number is obtained and used as the target reading content, and the execution is returned to S606, namely, the matching degree value between the current reading content and the target reading content is determined.
S612, jumping to the target reading page number.
Specifically, the electronic book is jumped to the target reading page number, so that the contents of the electronic book are synchronized to the reading contents of the user on the paper book.
According to the technical scheme, the target reading page number of the target reading content in the electronic book is determined by carrying out matching processing on the target image comprising the target reading content and the book content of the electronic book, and the target reading page number is jumped to continue the continuous reading of the paper book content, so that the technical effect of synchronizing the paper book reading content and the electronic book reading content is achieved.
Example six
Fig. 7 is a schematic structural diagram of a content synchronization device according to a sixth embodiment of the present invention, where the device includes a read content extraction module 710, a read page number determination module 720, and a read page skip module 730.
The reading content extraction module 710 is configured to obtain a target image and extract target reading content in the target image, where the target reading content is currently read by a user on a paper book, the reading page number determination module 720 is configured to determine a target reading page number of the target reading content in the target electronic book by performing matching processing on the target reading content and the book content of the target electronic book corresponding to the paper book, and the reading page skip module 730 is configured to skip the target electronic book from a current reading page to a target reading page corresponding to the target reading page number.
On the basis of the technical scheme, the reading content extraction module is used for calling book content of the target electronic book and obtaining catalog information from the book content before being used for obtaining a target image and extracting target reading content in the target image, generates a catalog expression set corresponding to the catalog information according to the catalog information so as to determine target reading page numbers of the target reading content in the target electronic book according to target catalogues corresponding to the target expressions when the catalog expressions exist in the target reading content, wherein the catalog expression set comprises at least one catalog expression, and shoots content currently read by a user in a paper book based on an imaging device on a terminal device to which the target electronic book belongs to obtain the target image.
On the basis of the technical schemes, the reading content extraction module is further used for determining the line areas containing text information in the target image, identifying the text information in the line areas and generating the target reading content based on the text information in each line area.
On the basis of the above technical solutions, the reading page number determining module is further configured to:
When the target reading content is determined to comprise at least one directory expression based on the directory expression set, determining target directories of each directory expression in the target reading content respectively, and determining target reading page numbers of the target directories in the electronic book from the directory information.
Based on the above technical solutions, the number of the target reading page numbers includes at least two, and the reading page determining module is further configured to skip the target electronic book from a current reading page to a target reading page corresponding to a first target directory, and present the target reading page corresponding to the target reading page number, and when the trigger page number skip control is detected, skip the target reading page corresponding to the current target directory as the current reading page, and skip from the current reading page to a target reading page corresponding to a next target directory.
Based on the above technical solutions, reading page numbers further includes:
The electronic book reading device comprises a target reading content acquisition unit, a target reading page number determination unit and a matching degree value determination unit, wherein the target reading page number acquisition unit is used for acquiring a target page number corresponding to a current page number, performing matching processing on the target reading content according to a row of the current page number to obtain a matching degree value of the target reading content and the current page number, and determining the target reading page number according to the matching degree value.
On the basis of the above technical solutions, the target reading page number determining unit is further configured to:
If the matching degree value is smaller than a preset matching degree threshold value, acquiring the next page number of the current page number, taking the next page number as the current page number, determining the matching degree value between the current page content of the current page number and the target reading content, and taking the current page number as the target reading page number when the matching degree value is larger than or equal to the preset matching degree threshold value.
On the basis of the technical scheme, the device further comprises a target reading page number determining module, wherein the target reading page number determining module is further used for determining the page number corresponding to the largest matching degree value if the page content corresponding to all the page numbers is traversed, and determining that the matching degree value corresponding to each page number is smaller than the preset matching degree threshold value, and taking the page number as the target reading page number.
On the basis of the technical schemes, the device further comprises:
The system comprises a line text content determining module, a text line number determining module and a second matching degree value determining unit, wherein the line text content determining module is also used for determining the total text line number in the current page content and obtaining the text content of each text line, the text line number determining module is also used for carrying out matching processing on the text content of each text line and the target reading content to determine the matched target text line number, and the second matching degree value determining unit is used for determining the matching degree value of the current page number and the target reading content according to the target text line number and the total text line number.
According to the technical scheme, the target reading page number of the target reading content in the electronic book is determined by carrying out matching processing on the target image comprising the target reading content and the book content of the electronic book, and the target reading page number is jumped to continue the continuous reading of the paper book content, so that the technical effect of synchronizing the paper book reading content and the electronic book reading content is achieved.
The content synchronization device provided by the embodiment of the invention can execute the content synchronization method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
It should be noted that the above system includes units and modules that are only divided according to the functional logic, but not limited to the above division, as long as the corresponding functions can be implemented, and specific names of the functional units are only used for distinguishing from each other, and are not used for limiting the protection scope of the embodiments of the present invention.
Example seven
Fig. 8 is a schematic structural diagram of an electronic device according to a seventh embodiment of the present invention. Fig. 8 shows a block diagram of an exemplary electronic device 80 suitable for use in implementing the embodiments of the present invention. The electronic device 80 shown in fig. 8 is merely an example and should not be construed as limiting the functionality and scope of use of embodiments of the present invention.
As shown in FIG. 8, the electronic device 80 is in the form of a general purpose computing device. Components of electronic device 80 may include, but are not limited to, one or more processors or processing units 801, a system memory 802, and a bus 803 that connects the various system components, including system memory 802 and processing units 801.
Bus 903 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, micro channel architecture (MAC) bus, enhanced ISA bus, video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.
Electronic device 80 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by electronic device 80 and includes both volatile and non-volatile media, removable and non-removable media.
The system memory 802 may include computer-system-readable media in the form of volatile memory, such as Random Access Memory (RAM) 804 and/or cache memory 805. The electronic device 80 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 806 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 8, commonly referred to as a "hard disk drive"). Although not shown in fig. 8, a magnetic disk drive for reading from and writing to a removable non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In such cases, each drive may be coupled to bus 803 via one or more data medium interfaces. Memory 802 may include at least one program product having a set (e.g., at least one) of program modules configured to carry out the functions of embodiments of the invention.
A program/utility 808 having a set (at least one) of program modules 807 may be stored in, for example, memory 802, such program modules 807 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment. Program modules 807 typically carry out the functions and/or methods of the described embodiments of the invention.
The electronic device 80 may also communicate with one or more external electronic devices 809 (e.g., keyboard, pointing device, display 810, etc.), one or more devices that enable a user to interact with the electronic device 80, and/or any devices (e.g., network card, modem, etc.) that enable the electronic device 80 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 811. Also, the electronic device 80 may communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN) and/or a public network, such as the Internet, through a network adapter 812. As shown, network adapter 812 communicates with other modules of electronic device 80 over bus 803. It should be appreciated that although not shown in FIG. 8, other hardware and/or software modules may be used in connection with electronic device 80, including, but not limited to, microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
The processing unit 801 executes various functional applications and data processing by running programs stored in the system memory 802, for example, implementing the content synchronization method provided by the embodiment of the present invention.
Example eight
An eighth embodiment of the present invention also provides a storage medium containing computer-executable instructions for performing a content synchronization method when executed by a computer processor.
The method comprises the following steps:
Acquiring a target image and extracting target reading content in the target image, wherein the target reading content is the content read by a user on a paper book at present;
Determining a target reading page number of the target reading content in the target electronic book by carrying out matching processing on the target reading content and the book content of the target electronic book corresponding to the paper book;
And jumping the target electronic book from the current reading page to a target reading page corresponding to the target reading page number.
The computer storage media of embodiments of the invention may take the form of any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium include an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for embodiments of the present invention may be written in one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.
Claims (11)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110043687.7A CN113762018B (en) | 2021-01-13 | 2021-01-13 | Content synchronization method, device, electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110043687.7A CN113762018B (en) | 2021-01-13 | 2021-01-13 | Content synchronization method, device, electronic device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113762018A CN113762018A (en) | 2021-12-07 |
| CN113762018B true CN113762018B (en) | 2025-01-17 |
Family
ID=78786393
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110043687.7A Active CN113762018B (en) | 2021-01-13 | 2021-01-13 | Content synchronization method, device, electronic device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113762018B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115223176A (en) * | 2022-06-21 | 2022-10-21 | 科大讯飞股份有限公司 | Text positioning method and device, electronic equipment, scanning pen and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105512095A (en) * | 2014-09-25 | 2016-04-20 | 北大方正集团有限公司 | Generation method for EPUB e-book |
| CN106991392A (en) * | 2017-03-30 | 2017-07-28 | 掌阅科技股份有限公司 | E-book page positioning method, device and terminal device |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101765840B (en) * | 2006-09-15 | 2013-01-23 | 谷歌公司 | Capture and display of annotations in paper and electronic documents |
| CN105306584A (en) * | 2015-11-12 | 2016-02-03 | 天津大学 | System and method for synchronizing reading progresses of paper-made book and electronic book |
| KR20170087424A (en) * | 2016-01-20 | 2017-07-28 | (주)라이앤캐처스 | Method of building book database using image of book, method of recommendation using the same, and system of the same |
| CN111090371B (en) * | 2019-04-19 | 2021-10-01 | 广东小天才科技有限公司 | A switching method and electronic device for reading pages |
| CN110399953A (en) * | 2019-07-29 | 2019-11-01 | 爱布客（武汉）科技有限公司 | A kind of method of paper book and e-book synchronous read |
| CN110414745A (en) * | 2019-08-07 | 2019-11-05 | 江苏畅想之星信息技术有限公司 | Library's big data analysis and Decision Support Platform based on cloud computing |
| CN111209418A (en) * | 2020-01-03 | 2020-05-29 | 北京字节跳动网络技术有限公司 | Data entry method and device, electronic equipment and readable storage medium |
-
2021
- 2021-01-13 CN CN202110043687.7A patent/CN113762018B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105512095A (en) * | 2014-09-25 | 2016-04-20 | 北大方正集团有限公司 | Generation method for EPUB e-book |
| CN106991392A (en) * | 2017-03-30 | 2017-07-28 | 掌阅科技股份有限公司 | E-book page positioning method, device and terminal device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113762018A (en) | 2021-12-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9317531B2 (en) | Autocaptioning of images | |
| CN110321470A (en) | Document processing method, device, computer equipment and storage medium | |
| CN103004228A (en) | Obtaining keywords for searching | |
| JP2010514023A (en) | How to automatically prefetch words while entering multimedia message text | |
| JP2008192055A (en) | Content search method and content search device | |
| CN107330040B (en) | Learning question searching method and system | |
| EP2806336A1 (en) | Text prediction in a text input associated with an image | |
| CN110795918B (en) | Method, device and equipment for determining reading position | |
| WO2023116785A1 (en) | Information display method and apparatus, computer device, and storage medium | |
| CN115174506A (en) | Session information processing method, device, readable storage medium and computer equipment | |
| KR102286015B1 (en) | Method and device for text-based image retrieval | |
| US20150010288A1 (en) | Media information server, apparatus and method for searching for media information related to media content, and computer-readable recording medium | |
| CN113762018B (en) | Content synchronization method, device, electronic device and storage medium | |
| US7451090B2 (en) | Information processing device and information processing method | |
| CN112235632A (en) | Video processing method and device and server | |
| CN113495874A (en) | Information processing apparatus and computer readable medium | |
| CN113177055B (en) | Information updating method, device and computer storage medium | |
| CN111542817A (en) | Information processing device, video search method, generation method, and program | |
| WO2025036376A1 (en) | Video preview method, video preview apparatus, and electronic device | |
| JP2007328713A (en) | Related term display device, searching device, method thereof, and program thereof | |
| CN108681549A (en) | Method and device for acquiring multimedia resources | |
| JP7288491B2 (en) | Information processing device and control method | |
| CN113626637B (en) | Video data screening method, device, computer equipment and storage medium | |
| CN107807765B (en) | Method and device for realizing page interaction | |
| CN115499610B (en) | Video generation method, video generation device, electronic device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |