[go: up one dir, main page]

CN107679485A - Aid reading method and device based on virtual reality - Google Patents

Aid reading method and device based on virtual reality Download PDF

Info

Publication number
CN107679485A
CN107679485A CN201710899390.4A CN201710899390A CN107679485A CN 107679485 A CN107679485 A CN 107679485A CN 201710899390 A CN201710899390 A CN 201710899390A CN 107679485 A CN107679485 A CN 107679485A
Authority
CN
China
Prior art keywords
scene
content
identification information
virtual reality
current reading
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710899390.4A
Other languages
Chinese (zh)
Inventor
林形省
冯智勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN201710899390.4A priority Critical patent/CN107679485A/en
Publication of CN107679485A publication Critical patent/CN107679485A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/20Scenes; Scene-specific elements in augmented reality scenes
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B17/00Teaching reading
    • G09B17/003Teaching reading electrically operated apparatus or devices

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本公开是关于一种基于虚拟现实的辅助阅读方法及装置。该方法包括:当前显示场景下,获取当前阅读内容的标识信息;根据所述标识信息,获取对应的场景信息;将所述场景信息对应的虚拟现实场景切换至所述当前显示场景。本公开通过在当前显示场景下,获取当前阅读内容的标识信息,根据该标识信息,获取对应的场景信息,并将该场景信息对应的虚拟现实场景切换至当前显示场景,由此能够根据当前阅读内容的标识信息灵活地、适应性地切换虚拟现实场景,使虚拟现实场景与当前阅读的内容相符合,为用户提供沉浸式的阅读环境。

The present disclosure relates to a virtual reality-based auxiliary reading method and device. The method includes: obtaining identification information of the currently read content in the current display scene; obtaining corresponding scene information according to the identification information; switching the virtual reality scene corresponding to the scene information to the current display scene. The present disclosure obtains the identification information of the current reading content in the current display scene, obtains the corresponding scene information according to the identification information, and switches the virtual reality scene corresponding to the scene information to the current display scene, thereby being able to read content according to the current reading. The identification information of the content flexibly and adaptively switches the virtual reality scene, so that the virtual reality scene matches the current reading content, and provides users with an immersive reading environment.

Description

基于虚拟现实的辅助阅读方法及装置Assisted reading method and device based on virtual reality

技术领域technical field

本公开涉及虚拟现实技术领域,尤其涉及基于虚拟现实的辅助阅读方法及装置。The present disclosure relates to the technical field of virtual reality, in particular to a virtual reality-based auxiliary reading method and device.

背景技术Background technique

虚拟现实(Virtual Reality,VR)技术是一种可以创建和体验虚拟世界的计算机仿真系统,它利用计算机生成一种模拟环境。虚拟现实技术主要包括模拟环境、感知、自然技能和传感设备等方面。模拟环境是由计算机生成的、实时动态的三维立体逼真图像。感知是指理想的虚拟现实应该具有一切人所具有的感知。除计算机图形技术所生成的视觉感知外,还有听觉、触觉、力觉、运动等感知,甚至还包括嗅觉和味觉等,也称为多感知。自然技能是指人的头部转动,眼睛、手势或其他人体行为动作,由计算机来处理与参与者的动作相适应的数据,并对用户的输入作出实时响应,并分别反馈到用户的五官。传感设备是指三维交互设备。Virtual Reality (VR) technology is a computer simulation system that can create and experience a virtual world, which uses a computer to generate a simulated environment. Virtual reality technology mainly includes aspects such as simulated environment, perception, natural skills and sensing equipment. The simulated environment is a real-time dynamic three-dimensional realistic image generated by a computer. Perception means that the ideal virtual reality should have the perception that all human beings have. In addition to the visual perception generated by computer graphics technology, there are also perceptions such as hearing, touch, force, movement, and even smell and taste, also known as multi-sense. Natural skills refer to people's head rotation, eyes, gestures or other human behaviors. The computer processes the data adapted to the participants' movements, and responds to the user's input in real time, and feeds back to the user's facial features respectively. Sensing devices refer to 3D interactive devices.

相关技术中,基于虚拟现实的阅读技术只能为用户播放书籍中的文字和配图,灵活性较低。In related technologies, the reading technology based on virtual reality can only play the text and pictures in the book for the user, and has low flexibility.

发明内容Contents of the invention

为克服相关技术中存在的问题,本公开提供一种基于虚拟现实的辅助阅读方法及装置。In order to overcome the problems existing in related technologies, the present disclosure provides a virtual reality-based auxiliary reading method and device.

根据本公开实施例的第一方面,提供一种基于虚拟现实的辅助阅读方法,包括:According to the first aspect of the embodiments of the present disclosure, a virtual reality-based assisted reading method is provided, including:

当前显示场景下,获取当前阅读内容的标识信息;In the current display scene, obtain the identification information of the current reading content;

根据所述标识信息,获取对应的场景信息;Obtain corresponding scene information according to the identification information;

将所述场景信息对应的虚拟现实场景切换至所述当前显示场景。Switching the virtual reality scene corresponding to the scene information to the currently displayed scene.

在一种可能的实现方式中,所述当前阅读内容的标识信息包括:所述当前阅读内容所属的文档标识信息和所述当前阅读内容的文字内容或语音内容;In a possible implementation manner, the identification information of the current reading content includes: identification information of the document to which the current reading content belongs and text content or voice content of the current reading content;

根据所述标识信息,获取对应的场景信息,包括:Obtain corresponding scene information according to the identification information, including:

根据所述当前阅读内容的标识信息包括的文档标识信息,获取所述文档标识信息对应的场景集合信息;Acquiring scene set information corresponding to the document identification information according to the document identification information included in the identification information of the currently read content;

根据所述当前阅读内容的标识信息包括的文字内容或语音内容,从所述场景集合信息中确定所述当前阅读内容对应的虚拟现实场景。According to the text content or voice content included in the identification information of the current reading content, the virtual reality scene corresponding to the current reading content is determined from the scene set information.

在一种可能的实现方式中,所述当前阅读内容的标识信息包括:所述当前阅读内容所属的文档标识信息和所述当前阅读内容所在的页码信息;In a possible implementation manner, the identification information of the current reading content includes: identification information of a document to which the current reading content belongs and page number information of the current reading content;

根据所述标识信息,获取对应的场景信息,包括:Obtain corresponding scene information according to the identification information, including:

根据所述当前阅读内容的标识信息包括的文档标识信息,获取所述文档标识信息对应的场景集合信息;Acquiring scene set information corresponding to the document identification information according to the document identification information included in the identification information of the currently read content;

根据所述当前阅读内容的标识信息包括的页码信息,从所述场景集合信息中确定当前阅读内容对应的虚拟现实场景。According to the page number information included in the identification information of the current reading content, the virtual reality scene corresponding to the current reading content is determined from the scene set information.

在一种可能的实现方式中,所述当前阅读内容的标识信息包括文字内容;In a possible implementation manner, the identification information of the currently read content includes text content;

根据所述标识信息,获取对应的场景信息,包括:Obtain corresponding scene information according to the identification information, including:

将文字内容与场景模板内容进行匹配处理;Match the text content with the content of the scene template;

在所述文字内容与所述场景模板内容相匹配的情况下,获取所述场景模板内容对应的场景信息;When the text content matches the scene template content, acquire scene information corresponding to the scene template content;

从所述场景信息中确定当前阅读内容对应的虚拟现实场景。The virtual reality scene corresponding to the current reading content is determined from the scene information.

在一种可能的实现方式中,将所述场景信息对应的虚拟现实场景切换至所述当前显示场景,包括:In a possible implementation manner, switching the virtual reality scene corresponding to the scene information to the currently displayed scene includes:

获取确定的虚拟现实场景并发送到显示部件;Obtain the determined virtual reality scene and send it to the display part;

将原显示场景切换为所述虚拟现实场景,并显示。The original display scene is switched to the virtual reality scene and displayed.

根据本公开实施例的第二方面,提供一种基于虚拟现实的辅助阅读装置,包括:According to the second aspect of the embodiments of the present disclosure, there is provided a virtual reality-based auxiliary reading device, including:

第一获取模块,用于当前显示场景下,获取当前阅读内容的标识信息;The first obtaining module is used to obtain the identification information of the current reading content in the current display scene;

第二获取模块,用于根据所述标识信息,获取对应的场景信息;A second acquiring module, configured to acquire corresponding scene information according to the identification information;

场景切换模块,用于将所述场景信息对应的虚拟现实场景切换至所述当前显示场景。A scene switching module, configured to switch the virtual reality scene corresponding to the scene information to the currently displayed scene.

在一种可能的实现方式中,所述当前阅读内容的标识信息包括:所述当前阅读内容所属的文档标识信息和所述当前阅读内容的文字内容或语音内容;In a possible implementation manner, the identification information of the current reading content includes: identification information of the document to which the current reading content belongs and text content or voice content of the current reading content;

所述第二获取模块包括:The second acquisition module includes:

第一获取子模块,用于根据所述当前阅读内容的标识信息包括的文档标识信息,获取所述文档标识信息对应的场景集合信息;The first obtaining submodule is used to obtain the scene set information corresponding to the document identification information according to the document identification information included in the identification information of the current reading content;

第一确定子模块,用于根据所述当前阅读内容的标识信息包括的文字内容或语音内容,从所述场景集合信息中确定所述当前阅读内容对应的虚拟现实场景。The first determination sub-module is configured to determine the virtual reality scene corresponding to the current reading content from the scene set information according to the text content or voice content included in the identification information of the current reading content.

在一种可能的实现方式中,所述当前阅读内容的标识信息包括:所述当前阅读内容所属的文档标识信息和所述当前阅读内容所在的页码信息;In a possible implementation manner, the identification information of the current reading content includes: identification information of a document to which the current reading content belongs and page number information of the current reading content;

所述第二获取模块包括:The second acquisition module includes:

第一获取子模块,用于根据所述当前阅读内容的标识信息包括的文档标识信息,获取所述文档标识信息对应的场景集合信息;The first obtaining submodule is used to obtain the scene set information corresponding to the document identification information according to the document identification information included in the identification information of the current reading content;

第二确定子模块,用于根据所述当前阅读内容的标识信息包括的页码信息,从所述场景集合信息中确定当前阅读内容对应的虚拟现实场景。The second determining submodule is configured to determine the virtual reality scene corresponding to the current reading content from the scene set information according to the page number information included in the identification information of the current reading content.

在一种可能的实现方式中,所述当前阅读内容的标识信息包括文字内容;In a possible implementation manner, the identification information of the currently read content includes text content;

所述第二获取模块包括:The second acquisition module includes:

匹配处理子模块,用于将文字内容与场景模板内容进行匹配处理;The matching processing sub-module is used to match the text content with the content of the scene template;

第二获取子模块,用于在所述文字内容与所述场景模板内容相匹配的情况下,获取所述场景模板内容对应的场景信息;The second acquiring submodule is used to acquire the scene information corresponding to the content of the scene template when the text content matches the content of the scene template;

第三确定子模块,用于从所述场景信息中确定当前阅读内容对应的虚拟现实场景。The third determining submodule is configured to determine the virtual reality scene corresponding to the current reading content from the scene information.

在一种可能的实现方式中,所述场景切换模块包括:In a possible implementation manner, the scene switching module includes:

第三获取子模块,用于获取确定的虚拟现实场景并发送到显示部件;The third acquisition sub-module is used to acquire the determined virtual reality scene and send it to the display part;

切换与显示子模块,用于将原显示场景切换为所述虚拟现实场景,并显示。The switch and display sub-module is used to switch the original display scene to the virtual reality scene and display it.

根据本公开实施例的第三方面,提供一种基于虚拟现实的辅助阅读装置,其特征在于,包括:处理器;用于存储处理器可执行指令的存储器;其中,所述处理器被配置为执行上述方法。According to a third aspect of the embodiments of the present disclosure, there is provided a virtual reality-based auxiliary reading device, which is characterized in that it includes: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to Execute the method above.

根据本公开实施例的第四方面,提供一种非临时性计算机可读存储介质,当所述存储介质中的指令由处理器执行时,使得处理器能够执行上述方法。According to a fourth aspect of the embodiments of the present disclosure, there is provided a non-transitory computer-readable storage medium, and when instructions in the storage medium are executed by a processor, the processor can execute the above method.

本公开的实施例提供的技术方案可以包括以下有益效果:本公开的实施例通过在当前显示场景下,获取当前阅读内容的标识信息,根据该标识信息,获取对应的场景信息,并将该场景信息对应的虚拟现实场景切换至当前显示场景,由此能够根据当前阅读内容的标识信息灵活地、适应性地切换虚拟现实场景,使虚拟现实场景与当前阅读的内容相符合,为用户提供沉浸式的阅读环境。The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects: In the embodiments of the present disclosure, the identification information of the currently read content is obtained in the current display scene, and the corresponding scene information is obtained according to the identification information, and the scene The virtual reality scene corresponding to the information is switched to the current display scene, so that the virtual reality scene can be flexibly and adaptively switched according to the identification information of the current reading content, so that the virtual reality scene matches the current reading content, providing users with immersive reading environment.

应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本公开。It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

附图说明Description of drawings

此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本公开的实施例,并与说明书一起用于解释本公开的原理。The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description serve to explain the principles of the disclosure.

图1是根据一示例性实施例示出的一种基于虚拟现实的辅助阅读方法的流程图。Fig. 1 is a flow chart of a method for assisting reading based on virtual reality according to an exemplary embodiment.

图2是根据一示例性实施例示出的一种基于虚拟现实的辅助阅读方法的一示例性的流程图。Fig. 2 is an exemplary flow chart of a method for assisting reading based on virtual reality according to an exemplary embodiment.

图3是根据一示例性实施例示出的一种基于虚拟现实的辅助阅读方法的另一示例性的流程图。Fig. 3 is another exemplary flow chart of a method for assisting reading based on virtual reality according to an exemplary embodiment.

图4是根据一示例性实施例示出的一种基于虚拟现实的辅助阅读方法的另一示例性的流程图。Fig. 4 is another exemplary flow chart of a method for assisting reading based on virtual reality according to an exemplary embodiment.

图5是根据一示例性实施例示出的一种基于虚拟现实的辅助阅读装置的框图。Fig. 5 is a block diagram of a virtual reality-based auxiliary reading device according to an exemplary embodiment.

图6是根据一示例性实施例示出的一种基于虚拟现实的辅助阅读装置的一示例性的框图。Fig. 6 is an exemplary block diagram of a virtual reality-based auxiliary reading device according to an exemplary embodiment.

图7是根据一示例性实施例示出的一种用于虚拟现实的辅助阅读的装置800的框图。Fig. 7 is a block diagram of an apparatus 800 for assisting reading in virtual reality according to an exemplary embodiment.

具体实施方式detailed description

这里将详细地对示例性实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本公开相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本公开的一些方面相一致的装置和方法的例子。Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present disclosure as recited in the appended claims.

图1是根据一示例性实施例示出的一种基于虚拟现实的辅助阅读方法的流程图。该方法可以应用于虚拟现实设备中,虚拟现实设备可以是虚拟现实眼镜或者虚拟现实头显等一体式虚拟现实设备,或者可以是将手机等终端设备安装于虚拟现实镜框等支撑设备上构成的分体式虚拟现实设备。如图1所示,该方法包括步骤S11至步骤S13。Fig. 1 is a flow chart of a method for assisting reading based on virtual reality according to an exemplary embodiment. This method can be applied to virtual reality equipment, which can be integrated virtual reality equipment such as virtual reality glasses or virtual reality head-mounted displays, or can be a split device formed by installing terminal equipment such as mobile phones on supporting equipment such as virtual reality frames. Asana virtual reality device. As shown in Fig. 1, the method includes step S11 to step S13.

在步骤S11中,当前显示场景下,获取当前阅读内容的标识信息。In step S11, in the current display scene, the identification information of the currently read content is acquired.

当前阅读内容可以为文字内容或者多媒体内容(如音频内容或视频内容)。例如,书籍、文献、杂志或者网页的文字内容等。又例如,影视作品、游戏、有声读物等。The current reading content may be text content or multimedia content (such as audio content or video content). For example, the text content of books, documents, magazines or web pages, etc. Another example is film and television works, games, audio books, etc.

其中,网页的内容可以为新闻的内容或者短文的内容等,在此不作限定。Wherein, the content of the webpage may be the content of the news or the content of the short article, etc., which is not limited herein.

在本实施例中,当前阅读内容可以包括用户当前阅读的内容,例如通过用户眼球跟踪技术确定当前阅读的内容,或者通过语音识别技术确定,或者将当前显示或者播放的内容默认为用户当前阅读的内容。也可以包括虚拟现实设备当前播放的内容。In this embodiment, the currently read content may include the content currently read by the user. For example, the currently read content is determined by the user's eye tracking technology, or determined by the voice recognition technology, or the currently displayed or played content is the user's current read content by default. content. It may also include the content currently played by the virtual reality device.

例如,用户佩戴虚拟现实设备阅读书籍A时,先显示书籍A的初始场景(如默认为草原、蓝天等)作为当前显示场景。For example, when a user wears a virtual reality device to read book A, the initial scene of book A (such as grassland, blue sky, etc. by default) is displayed as the current display scene.

在一种可能的实现方式中,当前阅读内容的标识信息可以包括当前阅读内容所属的文档标识信息。例如,在当前阅读内容为书籍、杂志、文献等的情况下,该标识信息可以包括该书籍、杂志、文献等的书名信息、编号等。In a possible implementation manner, the identification information of the current reading content may include identification information of the document to which the current reading content belongs. For example, when the current reading content is a book, magazine, document, etc., the identification information may include title information, serial number, etc. of the book, magazine, document, etc.

在另一种可能的实现方式中,当前阅读内容的标识信息可以包括当前阅读内容的文字内容。例如,在当前阅读内容为书籍的页面的情况下,该页面的标识信息可以包括该页面中的文字内容。其中,该页面中的文字内容可以为该页面中某一个或多个段落的关键词、该页面中所有段落的关键词、该页面中某一个或多个段落的所有文字、该页面中的所有文字、该页面所属章节的标题或者该页面所属章节的标题中的关键词。In another possible implementation manner, the identification information of the current reading content may include text content of the current reading content. For example, in the case that the current reading content is a page of a book, the identification information of the page may include text content in the page. Wherein, the text content in the page can be the keywords of one or more paragraphs in the page, the keywords of all paragraphs in the page, all the text of one or more paragraphs in the page, all the Text, the title of the chapter to which the page belongs, or keywords in the title of the chapter to which the page belongs.

又如,在用户当前阅读内容为网页的页面的情况下,该页面的标识信息可以为该页面中的文字内容。其中,该页面中的文字内容可以为该页面中的标题、该页面中的副标题、该页面中的标题中的关键词、该页面中的副标题中的关键词、该页面中某一个或多个段落的关键词、该页面中所有段落的关键词、该页面中某一个或多个段落的所有文字或者该页面中的所有文字。For another example, when the content currently read by the user is a web page, the identification information of the page may be text content in the page. Wherein, the text content in the page can be the title in the page, the subtitle in the page, the keywords in the title in the page, the keywords in the subtitle in the page, one or more The keywords of a paragraph, the keywords of all paragraphs in this page, all the text in one or more paragraphs in this page, or all the text in this page.

在另一种可能的实现方式中,当前阅读内容的标识信息可以包括当前阅读内容的语音内容。例如,在当前阅读内容为有声书的情况下,该有声书的标识信息可以包括该有声书中的语音内容。In another possible implementation manner, the identification information of the current reading content may include the voice content of the current reading content. For example, in the case that the current reading content is an audiobook, the identification information of the audiobook may include voice content in the audiobook.

在另一种可能的实现方式中,当前阅读内容的标识信息可以包括当前阅读内容所属的文档标识信息和当前阅读内容的文字内容。In another possible implementation manner, the identification information of the current reading content may include identification information of a document to which the current reading content belongs and text content of the current reading content.

在另一种可能的实现方式中,当前阅读内容的标识信息可以包括当前阅读内容所属的文档标识信息和当前阅读内容的语音内容。In another possible implementation manner, the identification information of the current reading content may include identification information of a document to which the current reading content belongs and voice content of the current reading content.

在另一种可能的实现方式中,当前阅读内容的标识信息可以包括当前阅读内容所属的文档标识信息和当前阅读内容所在的页码信息。In another possible implementation manner, the identification information of the current reading content may include identification information of a document to which the current reading content belongs and page number information of the current reading content.

在步骤S12中,根据该标识信息,获取对应的场景信息。In step S12, according to the identification information, corresponding scene information is obtained.

在本实施例中,当前阅读内容对应的场景信息与当前阅读内容的标识信息相匹配。In this embodiment, the scene information corresponding to the current reading content matches the identification information of the current reading content.

在一种可能的实现方式中,可以先查看本地是否存在当前阅读内容对应的场景信息。在本地存在当前阅读内容对应的场景信息的情况下,可以从本地获取当前阅读内容对应的场景信息;在本地不存在当前阅读内容对应的场景信息的情况下,可以从服务器端获取当前阅读内容对应的场景信息。In a possible implementation manner, it may first be checked whether scene information corresponding to the current reading content exists locally. If there is scene information corresponding to the current reading content locally, the scene information corresponding to the current reading content can be obtained locally; if there is no scene information corresponding to the current reading content locally, the corresponding scene information of the current reading content can be obtained from the server scene information.

在步骤S13中,将该场景信息对应的虚拟现实场景切换至当前显示场景。In step S13, the virtual reality scene corresponding to the scene information is switched to the currently displayed scene.

在本实施例中,可以在获取当前阅读内容对应的场景信息后,根据当前阅读内容对应的场景信息对当前显示场景进行渲染,以将该场景信息对应的虚拟现实场景切换至当前显示场景。In this embodiment, after acquiring the scene information corresponding to the current reading content, the current display scene may be rendered according to the scene information corresponding to the current reading content, so as to switch the virtual reality scene corresponding to the scene information to the current display scene.

其中,虚拟现实场景可以为三维虚拟现实场景,也可以为全景虚拟现实场景,在此不作限定。Wherein, the virtual reality scene may be a three-dimensional virtual reality scene, or a panoramic virtual reality scene, which is not limited herein.

本实施例通过在当前显示场景下,获取当前阅读内容的标识信息,根据该标识信息,获取对应的场景信息,并将该场景信息对应的虚拟现实场景切换至当前显示场景,由此能够根据当前阅读内容的标识信息灵活地、适应性地切换虚拟现实场景,使虚拟现实场景与当前阅读的内容相符合,为用户提供沉浸式的阅读环境。In this embodiment, by obtaining the identification information of the current reading content in the current display scene, according to the identification information, the corresponding scene information is obtained, and the virtual reality scene corresponding to the scene information is switched to the current display scene, thereby being able to The identification information of the reading content flexibly and adaptively switches the virtual reality scene, so that the virtual reality scene matches the current reading content, and provides users with an immersive reading environment.

图2是根据一示例性实施例示出的一种基于虚拟现实的辅助阅读方法的一示例性的流程图。如图2所示,该方法可以包括步骤S21至步骤S24。Fig. 2 is an exemplary flow chart of a method for assisting reading based on virtual reality according to an exemplary embodiment. As shown in Fig. 2, the method may include steps S21 to S24.

在步骤S21中,当前显示场景下,获取当前阅读内容的标识信息,当前阅读内容的标识信息包括:当前阅读内容所属的文档标识信息和当前阅读内容的文字内容或语音内容。In step S21 , in the current display scene, the identification information of the current reading content is acquired, and the identification information of the current reading content includes: the identification information of the document to which the current reading content belongs and the text content or voice content of the current reading content.

例如,在当前阅读内容为文字的情况下,当前阅读内容所属的文档标识信息可以为书籍、杂志等的书名或者书籍的编号。当前阅读内容的文字内容可以为该页面中某一个或多个段落的关键词、该页面中所有段落的关键词、该页面中某一个或多个段落的所有文字、该页面中的所有文字、该页面所属章节的标题或者该页面所属章节的标题中的关键词。For example, when the current reading content is text, the document identification information to which the current reading content belongs may be the title of a book, magazine, etc. or the serial number of the book. The text content of the current reading content can be keywords of one or more paragraphs in this page, keywords of all paragraphs in this page, all texts of one or more paragraphs in this page, all texts in this page, The title of the chapter to which the page belongs or keywords in the title of the chapter to which the page belongs.

例如,在当前阅读内容为语音内容的情况下,可以通过语音识别技术确定出其内容。For example, in the case that the current reading content is voice content, its content can be determined through voice recognition technology.

在步骤S22中,根据当前阅读内容的标识信息包括的文档标识信息,获取该文档标识信息对应的场景集合信息。In step S22, according to the document identification information included in the identification information of the currently read content, the scene set information corresponding to the document identification information is acquired.

例如,当前阅读内容为书籍的页面,当前阅读内容所属的文档标识信息为书籍的书名,该页面所属的书籍的书名为《安徒生童话》,则可以根据该书籍的书名,获取该书籍对应的场景集合信息。For example, if the current reading content is a page of a book, the document identification information to which the current reading content belongs is the title of the book, and the title of the book to which the page belongs is "Andersen's Fairy Tales", then the book can be obtained according to the title of the book The corresponding scene collection information.

在该示例中,若本地存在该文档标识信息对应的场景集合信息,则可以从本地获取该文档标识信息对应的场景集合信息;若本地不存在该文档标识信息对应的场景集合信息,则可以从服务器端获取该文档标识信息对应的场景集合信息。In this example, if the scene collection information corresponding to the document identification information exists locally, the scene collection information corresponding to the document identification information can be obtained from the local; The server side acquires scene collection information corresponding to the document identification information.

其中,该文档标识信息对应的场景集合信息可以包括该文档中所有页面对应的场景信息。例如,书籍《安徒生童话》对应的场景集合信息可以包括该书籍中所有页面对应的场景信息。Wherein, the scene set information corresponding to the document identification information may include scene information corresponding to all pages in the document. For example, the scene collection information corresponding to the book "Andersen's Fairy Tales" may include scene information corresponding to all pages in the book.

在步骤S23中,根据当前阅读内容的标识信息包括的文字内容或语音内容,从该场景集合信息中确定当前阅读内容对应的虚拟现实场景。In step S23, according to the text content or voice content included in the identification information of the current reading content, the virtual reality scene corresponding to the current reading content is determined from the scene set information.

例如,当前阅读内容为书籍《安徒生童话》的页面,该页面所属的章节的标题为《卖火柴的小女孩》,则可以从场景集合信息中确定该章节对应的虚拟现实场景,并可以将该章节对应的虚拟现实场景作为该章节中所有页面对应的虚拟现实场景。例如,该章节对应的虚拟现实场景为下雪的场景。For example, if the current reading content is the page of the book "Andersen's Fairy Tales", and the title of the chapter to which the page belongs is "The Little Match Girl", then the virtual reality scene corresponding to the chapter can be determined from the scene collection information, and the The virtual reality scene corresponding to the chapter is used as the virtual reality scene corresponding to all the pages in the chapter. For example, the virtual reality scene corresponding to this chapter is a snowing scene.

在步骤S24中,将该虚拟现实场景切换至当前显示场景。In step S24, the virtual reality scene is switched to the currently displayed scene.

其中,对步骤S24参见上文对步骤S13的描述。Wherein, for step S24, refer to the description of step S13 above.

本示例通过在当前显示场景下,获取当前阅读内容所属的文档标识信息和当前阅读内容的文字内容或语音内容,根据当前阅读内容的标识信息包括的文档标识信息,获取该文档标识信息对应的场景集合信息,根据当前阅读内容的标识信息包括的文字内容或语音内容,从该场景集合信息中确定当前阅读内容对应的虚拟现实场景,并将该虚拟现实场景切换至当前显示场景,由此能够根据当前阅读内容所属的文档标识信息和当前阅读内容的文字内容或语音内容灵活地、适应性地切换虚拟现实场景,使虚拟现实场景与当前阅读的内容相符合,为用户提供沉浸式的阅读环境。This example obtains the document identification information of the current reading content and the text content or voice content of the current reading content in the current display scene, and obtains the scene corresponding to the document identification information according to the document identification information included in the identification information of the current reading content Set information, according to the text content or voice content included in the identification information of the current reading content, determine the virtual reality scene corresponding to the current reading content from the scene set information, and switch the virtual reality scene to the current display scene, so as to The document identification information to which the current reading content belongs and the text content or voice content of the current reading content flexibly and adaptively switch the virtual reality scene, so that the virtual reality scene matches the current reading content, and provides an immersive reading environment for users.

图3是根据一示例性实施例示出的一种基于虚拟现实的辅助阅读方法的另一示例性的流程图。如图3所示,该方法可以包括步骤S31至步骤S34。Fig. 3 is another exemplary flow chart of a method for assisting reading based on virtual reality according to an exemplary embodiment. As shown in Fig. 3, the method may include step S31 to step S34.

在步骤S31中,当前显示场景下,获取当前阅读内容的标识信息,当前阅读内容的标识信息包括:当前阅读内容所属的文档标识信息和当前阅读内容所在的页码信息。In step S31 , in the current display scene, the identification information of the current reading content is acquired, and the identification information of the current reading content includes: the identification information of the document to which the current reading content belongs and the page number information of the current reading content.

例如,在当前阅读内容为书籍的页面的情况下,当前阅读内容所属的文档标识信息可以为书籍的书名或者书籍的编号。For example, when the current reading content is a page of a book, the document identification information to which the current reading content belongs may be the title of the book or the number of the book.

在步骤S32中,根据当前阅读内容的标识信息包括的文档标识信息,获取该文档标识信息对应的场景集合信息。In step S32, according to the document identification information included in the identification information of the currently read content, the scene set information corresponding to the document identification information is obtained.

作为本实施例的一个示例,该文档标识信息对应的场景集合信息可以包括该文档中各个页面的页码与虚拟现实场景的对应关系,以及该文档中所有页面对应的虚拟现实场景。As an example of this embodiment, the scene set information corresponding to the document identification information may include the corresponding relationship between the page numbers of each page in the document and the virtual reality scene, and the virtual reality scenes corresponding to all the pages in the document.

在步骤S33中,根据当前阅读内容的标识信息包括的页码信息,从场景集合信息中确定当前阅读内容对应的虚拟现实场景。In step S33, according to the page number information included in the identification information of the current reading content, the virtual reality scene corresponding to the current reading content is determined from the scene set information.

在该示例中,在当前阅读内容为书籍的页面的情况下,可以根据该页面在该书籍中的页码信息,以及该书籍中各个页面的页码与虚拟现实场景的对应关系,可以确定该页面对应的虚拟现实场景。In this example, when the current reading content is a page of a book, according to the page number information of the page in the book, and the correspondence between the page numbers of each page in the book and the virtual reality scene, it can be determined that the page corresponds virtual reality scene.

在步骤S34中,将该虚拟现实场景切换至当前显示场景。In step S34, the virtual reality scene is switched to the currently displayed scene.

其中,对步骤S34参见上文对步骤S13的描述。Wherein, for step S34, refer to the description of step S13 above.

本示例通过在当前显示场景下,获取当前阅读内容所属的文档标识信息和当前阅读内容所在的页码信息,根据当前阅读内容的标识信息包括的文档标识信息,获取该文档标识信息对应的场景集合信息,根据当前阅读内容的标识信息包括的页码信息,从场景集合信息中确定当前阅读内容对应的虚拟现实场景,并将该虚拟现实场景切换至当前显示场景,由此能够根据当前阅读内容所属的文档标识信息和当前阅读内容所在的页码信息灵活地、适应性地切换虚拟现实场景,使虚拟现实场景与当前阅读的内容相符合,为用户提供沉浸式的阅读环境。This example obtains the document identification information of the current reading content and the page number information of the current reading content in the current display scene, and obtains the scene set information corresponding to the document identification information according to the document identification information included in the identification information of the current reading content , according to the page number information included in the identification information of the current reading content, determine the virtual reality scene corresponding to the current reading content from the scene collection information, and switch the virtual reality scene to the current display scene, so that according to the document to which the current reading content belongs The identification information and the page number information where the current reading content is located flexibly and adaptively switch the virtual reality scene, so that the virtual reality scene matches the current reading content, and provides an immersive reading environment for users.

图4是根据一示例性实施例示出的一种基于虚拟现实的辅助阅读方法的另一示例性的流程图。如图4所示,该方法可以包括步骤S41至步骤S45。Fig. 4 is another exemplary flow chart of a method for assisting reading based on virtual reality according to an exemplary embodiment. As shown in Fig. 4, the method may include steps S41 to S45.

在步骤S41中,当前显示场景下,获取当前阅读内容的标识信息,当前阅读内容的标识信息包括文字内容。In step S41, in the current display scene, the identification information of the current reading content is acquired, and the identification information of the current reading content includes text content.

其中,当前阅读内容中的文字内容可以为当前阅读内容中某一个或多个段落的关键词、当前阅读内容中所有段落的关键词、当前阅读内容中某一个或多个段落的所有文字、当前阅读内容中的所有文字、当前阅读内容所属章节的标题或者当前阅读内容所属章节的标题中的关键词。Among them, the text content in the current reading content can be the keywords of one or more paragraphs in the current reading content, the keywords of all paragraphs in the current reading content, all the text of one or more paragraphs in the current reading content, the current All text in the reading content, the title of the chapter to which the current reading content belongs, or keywords in the title of the chapter to which the current reading content belongs.

在步骤S42中,将文字内容与场景模板内容进行匹配处理。In step S42, the text content is matched with the scene template content.

例如,场景1为草原模板,场景1的场景模板内容包括草原、草地、草场、若尔盖草原、希拉穆仁草原、呼伦贝尔草原、伊犁草原、锡林郭勒草原、川西高寒草原、那曲高寒草原、祁连山草原、甘南草原和科尔沁草原等中的一项或多项。For example, scene 1 is a grassland template, and the scene template content of scene 1 includes grassland, grassland, grassland, Zoige grassland, Xilamuren grassland, Hulunbuir grassland, Yili grassland, Xilin Gol grassland, western Sichuan alpine grassland, Naqu alpine grassland, Qilian Mountain grassland, Gannan grassland One or more of grassland and Horqin grassland.

作为本实施例的一个示例,若当前阅读内容中的文字内容与场景模板内容中的一项或多项相匹配,则可以确定当前阅读内容中的文字内容与场景模板内容相匹配。例如,当前阅读内容中的文字内容包括“草原”,则可以确定当前阅读内容中的文字内容与场景1的场景模板内容相匹配。As an example of this embodiment, if the text content in the current reading content matches one or more items in the content of the scene template, it may be determined that the text content in the current reading content matches the content of the scene template. For example, if the text content in the current reading content includes "grassland", it can be determined that the text content in the current reading content matches the content of the scene template in scene 1.

在步骤S43中,在文字内容与场景模板内容相匹配的情况下,获取场景模板内容对应的场景信息。In step S43, if the text content matches the scene template content, the scene information corresponding to the scene template content is acquired.

例如,在当前阅读内容中的文字内容与场景1的场景模板内容相匹配的情况下,可以获取场景1的场景模板内容对应的场景信息,即下雪的场景。For example, when the text content in the current reading content matches the content of the scene template of scene 1, the scene information corresponding to the content of the scene template of scene 1, that is, the scene of snowing, may be acquired.

在步骤S44中,从该场景信息中确定当前阅读内容对应的虚拟现实场景。In step S44, the virtual reality scene corresponding to the current reading content is determined from the scene information.

例如,将场景1的场景模板内容对应的场景信息作为当前阅读内容对应的虚拟现实场景。For example, the scene information corresponding to the scene template content of scene 1 is used as the virtual reality scene corresponding to the current reading content.

在步骤S45中,将该虚拟现实场景切换至当前显示场景。In step S45, the virtual reality scene is switched to the currently displayed scene.

其中,对步骤S45参见上文对步骤S13的描述。Wherein, for step S45, refer to the above description for step S13.

本示例通过在当前显示场景下,获取当前阅读内容的文字内容,由此能够根据用户当前阅读内容,将文字内容与场景模板内容进行匹配处理,在文字内容与场景模板内容相匹配的情况下,获取场景模板内容对应的场景信息,并将该虚拟现实场景切换至当前显示场景,由此根据当前阅读内容中的文字内容灵活地、适应性地切换虚拟现实场景,使虚拟现实场景与当前阅读的内容相符合,为用户提供沉浸式的阅读环境。This example obtains the text content of the current reading content in the current display scene, so that the text content can be matched with the scene template content according to the user's current reading content. When the text content matches the scene template content, Obtain the scene information corresponding to the content of the scene template, and switch the virtual reality scene to the current display scene, thereby flexibly and adaptively switch the virtual reality scene according to the text content in the current reading content, so that the virtual reality scene is consistent with the current reading content The content is consistent and provides users with an immersive reading environment.

在一种可能的实现方式中,将该场景信息对应的虚拟现实场景切换至当前显示场景,包括:获取确定的虚拟现实场景并发送到显示部件;将原显示场景切换为所述虚拟现实场景,并显示。In a possible implementation manner, switching the virtual reality scene corresponding to the scene information to the current display scene includes: acquiring the determined virtual reality scene and sending it to the display component; switching the original display scene to the virtual reality scene, and display.

在该实现方式中,在获取确定的虚拟现实场景后,可以实时将该虚拟现实场景发送到显示部件,以使显示部件实时将原显示场景切换为该虚拟现实场景并显示,由此能够实时切换显示场景,能够根据当前阅读内容的标识信息灵活地、适应性地切换虚拟现实场景,使虚拟现实场景与当前阅读的内容相符合,为用户提供沉浸式的阅读环境。In this implementation, after the determined virtual reality scene is acquired, the virtual reality scene can be sent to the display component in real time, so that the display component can switch the original display scene to the virtual reality scene and display it in real time, thereby enabling real-time switching The display scene can flexibly and adaptively switch the virtual reality scene according to the identification information of the current reading content, so that the virtual reality scene matches the current reading content, and provides an immersive reading environment for the user.

图5是根据一示例性实施例示出的一种基于虚拟现实的辅助阅读装置的框图。参照图5,该装置包括第一获取模块51、第二获取模块52和场景切换模块53。Fig. 5 is a block diagram of a virtual reality-based auxiliary reading device according to an exemplary embodiment. Referring to FIG. 5 , the device includes a first acquisition module 51 , a second acquisition module 52 and a scene switching module 53 .

该第一获取模块51被配置为当前显示场景下,获取当前阅读内容的标识信息。The first obtaining module 51 is configured to obtain identification information of the currently read content in the current display scene.

该第二获取模块52被配置为根据该标识信息,获取对应的场景信息。The second obtaining module 52 is configured to obtain corresponding scene information according to the identification information.

该场景切换模块53被配置为将该场景信息对应的虚拟现实场景切换至当前显示场景。The scene switching module 53 is configured to switch the virtual reality scene corresponding to the scene information to the currently displayed scene.

本实施例通过在当前显示场景下,获取当前阅读内容的标识信息,根据该标识信息,获取对应的场景信息,并将该场景信息对应的虚拟现实场景切换至当前显示场景,由此能够根据当前阅读内容的标识信息灵活地、适应性地切换虚拟现实场景,使虚拟现实场景与当前阅读的内容相符合,为用户提供沉浸式的阅读环境。In this embodiment, by obtaining the identification information of the current reading content in the current display scene, according to the identification information, the corresponding scene information is obtained, and the virtual reality scene corresponding to the scene information is switched to the current display scene, thereby being able to The identification information of the reading content flexibly and adaptively switches the virtual reality scene, so that the virtual reality scene matches the current reading content, and provides users with an immersive reading environment.

图6是根据一示例性实施例示出的一种基于虚拟现实的辅助阅读装置的一示例性的框图。如图6所示:Fig. 6 is an exemplary block diagram of a virtual reality-based auxiliary reading device according to an exemplary embodiment. As shown in Figure 6:

在一种可能的实现方式中,当前阅读内容的标识信息包括:当前阅读内容所属的文档标识信息和当前阅读内容的文字内容或语音内容。第二获取模块52包括第一获取子模块521和第一确定子模块522。In a possible implementation manner, the identification information of the current reading content includes: identification information of a document to which the current reading content belongs and text content or voice content of the current reading content. The second acquiring module 52 includes a first acquiring submodule 521 and a first determining submodule 522 .

该第一获取子模块521被配置为根据当前阅读内容的标识信息包括的文档标识信息,获取文档标识信息对应的场景集合信息。The first obtaining sub-module 521 is configured to obtain scene set information corresponding to the document identification information according to the document identification information included in the identification information of the currently read content.

该第一确定子模块522被配置为根据当前阅读内容的标识信息包括的文字内容或语音内容,从场景集合信息中确定当前阅读内容对应的虚拟现实场景。The first determination sub-module 522 is configured to determine the virtual reality scene corresponding to the current reading content from the scene set information according to the text content or voice content included in the identification information of the current reading content.

该实现方式通过在当前显示场景下,获取当前阅读内容所属的文档标识信息和当前阅读内容的文字内容或语音内容,根据当前阅读内容的标识信息包括的文档标识信息,获取该文档标识信息对应的场景集合信息,根据当前阅读内容的标识信息包括的文字内容或语音内容,从该场景集合信息中确定当前阅读内容对应的虚拟现实场景,并将该虚拟现实场景切换至当前显示场景,由此能够根据当前阅读内容所属的文档标识信息和当前阅读内容的文字内容或语音内容灵活地、适应性地切换虚拟现实场景,使虚拟现实场景与当前阅读的内容相符合,为用户提供沉浸式的阅读环境。This implementation method obtains the document identification information to which the current reading content belongs and the text content or voice content of the current reading content in the current display scene, and obtains the document identification information corresponding to the document identification information according to the document identification information included in the identification information of the current reading content. The scene set information, according to the text content or voice content included in the identification information of the current reading content, determines the virtual reality scene corresponding to the current reading content from the scene set information, and switches the virtual reality scene to the current display scene, thereby being able to According to the document identification information of the current reading content and the text or voice content of the current reading content, the virtual reality scene can be switched flexibly and adaptively, so that the virtual reality scene matches the current reading content, and an immersive reading environment is provided for the user. .

在一种可能的实现方式中,当前阅读内容的标识信息包括:当前阅读内容所属的文档标识信息和当前阅读内容所在的页码信息。第二获取模块52包括第一获取子模块521和第二确定子模块523。In a possible implementation manner, the identification information of the current reading content includes: identification information of a document to which the current reading content belongs and page number information of the current reading content. The second acquiring module 52 includes a first acquiring submodule 521 and a second determining submodule 523 .

该第一获取子模块521被配置为根据当前阅读内容的标识信息包括的文档标识信息,获取文档标识信息对应的场景集合信息。The first obtaining sub-module 521 is configured to obtain scene set information corresponding to the document identification information according to the document identification information included in the identification information of the currently read content.

该第二确定子模块523被配置为根据当前阅读内容的标识信息包括的页码信息,从场景集合信息中确定当前阅读内容对应的虚拟现实场景。The second determination sub-module 523 is configured to determine the virtual reality scene corresponding to the current reading content from the scene set information according to the page number information included in the identification information of the current reading content.

该实现方式通过在当前显示场景下,获取当前阅读内容所属的文档标识信息和当前阅读内容所在的页码信息,根据当前阅读内容的标识信息包括的文档标识信息,获取该文档标识信息对应的场景集合信息,根据当前阅读内容的标识信息包括的页码信息,从场景集合信息中确定当前阅读内容对应的虚拟现实场景,并将该虚拟现实场景切换至当前显示场景,由此能够根据当前阅读内容所属的文档标识信息和当前阅读内容所在的页码信息灵活地、适应性地切换虚拟现实场景,使虚拟现实场景与当前阅读的内容相符合,为用户提供沉浸式的阅读环境。This implementation method obtains the document identification information of the current reading content and the page number information of the current reading content in the current display scene, and obtains the scene set corresponding to the document identification information according to the document identification information included in the identification information of the current reading content Information, according to the page number information included in the identification information of the current reading content, determine the virtual reality scene corresponding to the current reading content from the scene collection information, and switch the virtual reality scene to the current display scene, so that it can be based on the current reading content. The document identification information and the page number information where the current reading content is located flexibly and adaptively switch the virtual reality scene, so that the virtual reality scene matches the current reading content, providing users with an immersive reading environment.

在一种可能的实现方式中,当前阅读内容的标识信息包括文字内容。第二获取模块52包括匹配处理子模块524、第二获取子模块525和第三确定子模块526。In a possible implementation manner, the identification information of the currently read content includes text content. The second acquiring module 52 includes a matching processing submodule 524 , a second acquiring submodule 525 and a third determining submodule 526 .

该匹配处理子模块524被配置为将文字内容与场景模板内容进行匹配处理。The matching processing sub-module 524 is configured to perform matching processing on text content and scene template content.

该第二获取子模块525被配置为在文字内容与所述场景模板内容相匹配的情况下,获取场景模板内容对应的场景信息。The second obtaining sub-module 525 is configured to obtain scene information corresponding to the content of the scene template when the text content matches the content of the scene template.

该第三确定子模块526被配置为从场景信息中确定当前阅读内容对应的虚拟现实场景。The third determination sub-module 526 is configured to determine the virtual reality scene corresponding to the current reading content from the scene information.

该实现方式通过在当前显示场景下,获取当前阅读内容的文字内容,由此能够根据用户当前阅读内容,将文字内容与场景模板内容进行匹配处理,在文字内容与场景模板内容相匹配的情况下,获取场景模板内容对应的场景信息,并将该虚拟现实场景切换至当前显示场景,由此根据当前阅读内容中的文字内容灵活地、适应性地切换虚拟现实场景,使虚拟现实场景与当前阅读的内容相符合,为用户提供沉浸式的阅读环境。This implementation method obtains the text content of the current reading content in the current display scene, so that the text content can be matched with the content of the scene template according to the current reading content of the user. When the text content matches the content of the scene template , obtain the scene information corresponding to the content of the scene template, and switch the virtual reality scene to the current display scene, thereby flexibly and adaptively switch the virtual reality scene according to the text content in the current reading content, so that the virtual reality scene is consistent with the current reading Consistent with the content, provide users with an immersive reading environment.

在一种可能的实现方式中,场景切换模块53包括第三获取子模块531和切换与显示子模块532。In a possible implementation manner, the scene switching module 53 includes a third acquiring submodule 531 and a switching and displaying submodule 532 .

该第三获取子模块531被配置为获取确定的虚拟现实场景并发送到显示部件。The third obtaining sub-module 531 is configured to obtain the determined virtual reality scene and send it to the display component.

该切换与显示子模块532被配置为将原显示场景切换为该虚拟现实场景,并显示。The switch and display sub-module 532 is configured to switch the original display scene to the virtual reality scene and display it.

在该实现方式中,在获取确定的虚拟现实场景后,可以实时将该虚拟现实场景发送到显示部件,以使显示部件实时将原显示场景切换为该虚拟现实场景并显示,由此能够实时切换显示场景,能够根据当前阅读内容的标识信息灵活地、适应性地切换虚拟现实场景,使虚拟现实场景与当前阅读的内容相符合,为用户提供沉浸式的阅读环境。In this implementation, after the determined virtual reality scene is acquired, the virtual reality scene can be sent to the display component in real time, so that the display component can switch the original display scene to the virtual reality scene and display it in real time, thereby enabling real-time switching The display scene can flexibly and adaptively switch the virtual reality scene according to the identification information of the current reading content, so that the virtual reality scene matches the current reading content, and provides an immersive reading environment for the user.

关于上述实施例中的装置,其中各个模块执行操作的具体方式已经在有关该方法的实施例中进行了详细描述,此处将不做详细阐述说明。Regarding the apparatus in the foregoing embodiments, the specific manner in which each module executes operations has been described in detail in the embodiments related to the method, and will not be described in detail here.

图7是根据一示例性实施例示出的一种用于虚拟现实的辅助阅读的装置800的框图。例如,装置800可以是移动电话,计算机,数字广播终端,消息收发设备,游戏控制台,平板设备,医疗设备,健身设备,个人数字助理等。Fig. 7 is a block diagram of an apparatus 800 for assisting reading in virtual reality according to an exemplary embodiment. For example, the apparatus 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, and the like.

参照图7,装置800可以包括以下一个或多个组件:处理组件802,存储器804,电源组件806,多媒体组件808,音频组件810,输入/输出(I/O)的接口812,传感器组件814,以及通信组件816。7, device 800 may include one or more of the following components: processing component 802, memory 804, power supply component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, and communication component 816 .

处理组件802通常控制装置800的整体操作,诸如与显示,电话呼叫,数据通信,相机操作和记录操作相关联的操作。处理组件802可以包括一个或多个处理器820来执行指令,以完成上述的方法的全部或部分步骤。此外,处理组件802可以包括一个或多个模块,便于处理组件802和其他组件之间的交互。例如,处理组件802可以包括多媒体模块,以方便多媒体组件808和处理组件802之间的交互。The processing component 802 generally controls the overall operations of the device 800, such as those associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above method. Additionally, processing component 802 may include one or more modules that facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802 .

存储器804被配置为存储各种类型的数据以支持在装置800的操作。这些数据的示例包括用于在装置800上操作的任何应用程序或方法的指令,联系人数据,电话簿数据,消息,图片,视频等。存储器804可以由任何类型的易失性或非易失性存储设备或者它们的组合实现,如静态随机存取存储器(SRAM),电可擦除可编程只读存储器(EEPROM),可擦除可编程只读存储器(EPROM),可编程只读存储器(PROM),只读存储器(ROM),磁存储器,快闪存储器,磁盘或光盘。The memory 804 is configured to store various types of data to support operations at the device 800 . Examples of such data include instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, videos, and the like. The memory 804 can be implemented by any type of volatile or non-volatile storage device or their combination, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.

电源组件806为装置800的各种组件提供电力。电源组件806可以包括电源管理系统,一个或多个电源,及其他与为装置800生成、管理和分配电力相关联的组件。The power supply component 806 provides power to the various components of the device 800 . Power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for device 800 .

多媒体组件808包括在所述装置800和用户之间的提供一个输出接口的屏幕。在一些实施例中,屏幕可以包括液晶显示器(LCD)和触摸面板(TP)。如果屏幕包括触摸面板,屏幕可以被实现为触摸屏,以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。所述触摸传感器可以不仅感测触摸或滑动动作的边界,而且还检测与所述触摸或滑动操作相关的持续时间和压力。在一些实施例中,多媒体组件808包括一个前置摄像头和/或后置摄像头。当装置800处于操作模式,如拍摄模式或视频模式时,前置摄像头和/或后置摄像头可以接收外部的多媒体数据。每个前置摄像头和后置摄像头可以是一个固定的光学透镜系统或具有焦距和光学变焦能力。The multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may not only sense a boundary of a touch or swipe action, but also detect duration and pressure associated with the touch or swipe action. In some embodiments, the multimedia component 808 includes a front camera and/or a rear camera. When the device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capability.

音频组件810被配置为输出和/或输入音频信号。例如,音频组件810包括一个麦克风(MIC),当装置800处于操作模式,如呼叫模式、记录模式和语音识别模式时,麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器804或经由通信组件816发送。在一些实施例中,音频组件810还包括一个扬声器,用于输出音频信号。The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a microphone (MIC) configured to receive external audio signals when the device 800 is in operation modes, such as call mode, recording mode and voice recognition mode. Received audio signals may be further stored in memory 804 or sent via communication component 816 . In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

I/O接口812为处理组件802和外围接口模块之间提供接口,上述外围接口模块可以是键盘,点击轮,按钮等。这些按钮可包括但不限于:主页按钮、音量按钮、启动按钮和锁定按钮。The I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module, which may be a keyboard, a click wheel, a button, and the like. These buttons may include, but are not limited to: a home button, volume buttons, start button, and lock button.

传感器组件814包括一个或多个传感器,用于为装置800提供各个方面的状态评估。例如,传感器组件814可以检测到装置800的打开/关闭状态,组件的相对定位,例如所述组件为装置800的显示器和小键盘,传感器组件814还可以检测装置800或装置800一个组件的位置改变,用户与装置800接触的存在或不存在,装置800方位或加速/减速和装置800的温度变化。传感器组件814可以包括接近传感器,被配置用来在没有任何的物理接触时检测附近物体的存在。传感器组件814还可以包括光传感器,如CMOS或CCD图像传感器,用于在成像应用中使用。在一些实施例中,该传感器组件814还可以包括加速度传感器,陀螺仪传感器,磁传感器,压力传感器或温度传感器。Sensor assembly 814 includes one or more sensors for providing status assessments of various aspects of device 800 . For example, the sensor component 814 can detect the open/closed state of the device 800, the relative positioning of components, such as the display and keypad of the device 800, and the sensor component 814 can also detect a change in the position of the device 800 or a component of the device 800 , the presence or absence of user contact with the device 800 , the device 800 orientation or acceleration/deceleration and the temperature change of the device 800 . Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. Sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

通信组件816被配置为便于装置800和其他设备之间有线或无线方式的通信。装置800可以接入基于通信标准的无线网络,如WiFi,2G或3G,或它们的组合。在一个示例性实施例中,通信组件816经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中,所述通信组件816还包括近场通信(NFC)模块,以促进短程通信。例如,在NFC模块可基于射频识别(RFID)技术,红外数据协会(IrDA)技术,超宽带(UWB)技术,蓝牙(BT)技术和其他技术来实现。The communication component 816 is configured to facilitate wired or wireless communication between the apparatus 800 and other devices. The device 800 can access wireless networks based on communication standards, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wide Band (UWB) technology, Bluetooth (BT) technology and other technologies.

在示例性实施例中,装置800可以被一个或多个应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现,用于执行上述方法。In an exemplary embodiment, apparatus 800 may be programmed by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation for performing the methods described above.

在示例性实施例中,还提供了一种包括指令的非临时性计算机可读存储介质,例如包括指令的存储器804,上述指令可由装置800的处理器820执行以完成上述方法。例如,所述非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。In an exemplary embodiment, there is also provided a non-transitory computer-readable storage medium including instructions, such as the memory 804 including instructions, which can be executed by the processor 820 of the device 800 to implement the above method. For example, the non-transitory computer readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.

本领域技术人员在考虑说明书及实践这里公开的发明后,将容易想到本公开的其它实施方案。本申请旨在涵盖本公开的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本公开的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本公开的真正范围和精神由下面的权利要求指出。Other embodiments of the present disclosure will be readily apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any modification, use or adaptation of the present disclosure, and these modifications, uses or adaptations follow the general principles of the present disclosure and include common knowledge or conventional technical means in the technical field not disclosed in the present disclosure . The specification and examples are to be considered exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

应当理解的是,本公开并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围进行各种修改和改变。本公开的范围仅由所附的权利要求来限制。It should be understood that the present disclosure is not limited to the precise constructions which have been described above and shown in the drawings, and various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (12)

  1. A kind of 1. aid reading method based on virtual reality, it is characterised in that including:
    Under current display scene, the identification information of current reading content is obtained;
    According to the identification information, scene information corresponding to acquisition;
    Virtual reality scenario corresponding to the scene information is switched into the current display scene.
  2. 2. the aid reading method according to claim 1 based on virtual reality, it is characterised in that in the current reading The identification information of appearance includes:In the word of the currently document identification information belonging to reading content and the current reading content Perhaps voice content;
    According to the identification information, scene information corresponding to acquisition, including:
    The document identification information included according to the identification information of the current reading content, it is corresponding to obtain the document identification information Scene aggregate information;
    The word content or voice content included according to the identification information of the current reading content, from the scene aggregate information It is middle to determine virtual reality scenario corresponding to the current reading content.
  3. 3. the aid reading method according to claim 1 based on virtual reality, it is characterised in that in the current reading The identification information of appearance includes:The page where document identification information and the current reading content belonging to the current reading content Code information;
    According to the identification information, scene information corresponding to acquisition, including:
    The document identification information included according to the identification information of the current reading content, it is corresponding to obtain the document identification information Scene aggregate information;
    The page number information included according to the identification information of the current reading content, is determined current from the scene aggregate information Virtual reality scenario corresponding to reading content.
  4. 4. the aid reading method according to claim 1 based on virtual reality, it is characterised in that in the current reading The identification information of appearance includes word content;
    According to the identification information, scene information corresponding to acquisition, including:
    Word content and scene template content are subjected to matching treatment;
    In the case where the word content and the scene template content match, obtain corresponding to the scene template content Scene information;
    Virtual reality scenario corresponding to current reading content is determined from the scene information.
  5. 5. the aid reading method according to claim 1 based on virtual reality, it is characterised in that by the scene information Corresponding virtual reality scenario switches to the current display scene, including:
    Obtain the virtual reality scenario determined and be sent to display unit;
    Original is shown that scene switches to the virtual reality scenario, and shown.
  6. A kind of 6. auxiliary reading device based on virtual reality, it is characterised in that including:
    First acquisition module, for currently showing under scene, obtain the identification information of current reading content;
    Second acquisition module, for according to the identification information, scene information corresponding to acquisition;
    Scene handover module, for virtual reality scenario corresponding to the scene information to be switched into the current display scene.
  7. 7. the auxiliary reading device according to claim 6 based on virtual reality, it is characterised in that in the current reading The identification information of appearance includes:In the word of the currently document identification information belonging to reading content and the current reading content Perhaps voice content;
    Second acquisition module includes:
    First acquisition submodule, for the document identification information included according to the identification information of the current reading content, obtain Scene aggregate information corresponding to the document identification information;
    First determination sub-module, in the word content or voice that are included according to the identification information of the current reading content Hold, virtual reality scenario corresponding to the current reading content is determined from the scene aggregate information.
  8. 8. the auxiliary reading device according to claim 6 based on virtual reality, it is characterised in that in the current reading The identification information of appearance includes:The page where document identification information and the current reading content belonging to the current reading content Code information;
    Second acquisition module includes:
    First acquisition submodule, for the document identification information included according to the identification information of the current reading content, obtain Scene aggregate information corresponding to the document identification information;
    Second determination sub-module, for the page number information included according to the identification information of the current reading content, from the field Virtual reality scenario corresponding to current reading content is determined in scape aggregate information.
  9. 9. the auxiliary reading device according to claim 6 based on virtual reality, it is characterised in that in the current reading The identification information of appearance includes word content;
    Second acquisition module includes:
    Matching treatment submodule, for word content and scene template content to be carried out into matching treatment;
    Second acquisition submodule, in the case of matching in the word content and the scene template content, obtain institute State scene information corresponding to scene template content;
    3rd determination sub-module, for determining virtual reality scenario corresponding to current reading content from the scene information.
  10. 10. the auxiliary reading device according to claim 6 based on virtual reality, it is characterised in that the scene switching Module includes:
    3rd acquisition submodule, for obtaining the virtual reality scenario determined and being sent to display unit;
    Switching and display sub-module, for original to be shown into scene switches to the virtual reality scenario, and show.
  11. A kind of 11. auxiliary reading device based on virtual reality, it is characterised in that including:
    Processor;
    For storing the memory of processor-executable instruction;
    Wherein, the processor is configured as the method described in any one in perform claim requirement 1 to 5.
  12. 12. a kind of non-transitorycomputer readable storage medium, when the instruction in the storage medium is by computing device, make Processor is able to carry out in claim 1 to 5 method described in any one.
CN201710899390.4A 2017-09-28 2017-09-28 Aid reading method and device based on virtual reality Pending CN107679485A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710899390.4A CN107679485A (en) 2017-09-28 2017-09-28 Aid reading method and device based on virtual reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710899390.4A CN107679485A (en) 2017-09-28 2017-09-28 Aid reading method and device based on virtual reality

Publications (1)

Publication Number Publication Date
CN107679485A true CN107679485A (en) 2018-02-09

Family

ID=61138420

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710899390.4A Pending CN107679485A (en) 2017-09-28 2017-09-28 Aid reading method and device based on virtual reality

Country Status (1)

Country Link
CN (1) CN107679485A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109784222A (en) * 2018-12-28 2019-05-21 深圳市掌网科技股份有限公司 Aid reading method, apparatus, readable storage medium storing program for executing and mixed reality equipment
WO2021179499A1 (en) * 2020-03-12 2021-09-16 深圳捷径观察咨询有限公司 Vr deep reader having anti-distraction reminding function, and reading method
CN114898683A (en) * 2022-05-18 2022-08-12 咪咕数字传媒有限公司 Immersive reading implementation method and system, terminal equipment and storage medium
CN115957504A (en) * 2022-12-07 2023-04-14 北京师范大学珠海校区 A gamified reading method and system for ancient books based on VR technology

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105022487A (en) * 2015-07-20 2015-11-04 北京易讯理想科技有限公司 Reading method and apparatus based on augmented reality
KR101587625B1 (en) * 2014-11-18 2016-01-21 박남태 The method of voice control for display device, and voice control display device
CN105807917A (en) * 2016-02-29 2016-07-27 广东小天才科技有限公司 Method and device for assisting user in learning characters
CN105955452A (en) * 2016-04-15 2016-09-21 北京小鸟看看科技有限公司 Virtual reality equipment and method and device for improving reading experience employing same
CN106569614A (en) * 2016-11-11 2017-04-19 上海远鉴信息科技有限公司 Method and system for controlling scene switching in virtual reality
CN106648096A (en) * 2016-12-22 2017-05-10 宇龙计算机通信科技(深圳)有限公司 Virtual reality scene-interaction implementation method and system and visual reality device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101587625B1 (en) * 2014-11-18 2016-01-21 박남태 The method of voice control for display device, and voice control display device
CN105022487A (en) * 2015-07-20 2015-11-04 北京易讯理想科技有限公司 Reading method and apparatus based on augmented reality
CN105807917A (en) * 2016-02-29 2016-07-27 广东小天才科技有限公司 Method and device for assisting user in learning characters
CN105955452A (en) * 2016-04-15 2016-09-21 北京小鸟看看科技有限公司 Virtual reality equipment and method and device for improving reading experience employing same
CN106569614A (en) * 2016-11-11 2017-04-19 上海远鉴信息科技有限公司 Method and system for controlling scene switching in virtual reality
CN106648096A (en) * 2016-12-22 2017-05-10 宇龙计算机通信科技(深圳)有限公司 Virtual reality scene-interaction implementation method and system and visual reality device

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109784222A (en) * 2018-12-28 2019-05-21 深圳市掌网科技股份有限公司 Aid reading method, apparatus, readable storage medium storing program for executing and mixed reality equipment
WO2021179499A1 (en) * 2020-03-12 2021-09-16 深圳捷径观察咨询有限公司 Vr deep reader having anti-distraction reminding function, and reading method
CN114898683A (en) * 2022-05-18 2022-08-12 咪咕数字传媒有限公司 Immersive reading implementation method and system, terminal equipment and storage medium
CN115957504A (en) * 2022-12-07 2023-04-14 北京师范大学珠海校区 A gamified reading method and system for ancient books based on VR technology

Similar Documents

Publication Publication Date Title
CN111970533B (en) Interaction method and device for live broadcast room and electronic equipment
US11315336B2 (en) Method and device for editing virtual scene, and non-transitory computer-readable storage medium
CN106791893B (en) Video live broadcast method and device
CN107948708B (en) Bullet screen display method and device
CN109168062B (en) Video playing display method and device, terminal equipment and storage medium
CN106599251A (en) Method and device for displaying anchor rankings
CN109451341B (en) Video playing method, video playing device, electronic equipment and storage medium
WO2021232875A1 (en) Method and apparatus for driving digital person, and electronic device
CN111954063B (en) Content display control method and device for video live broadcast room
WO2019153925A1 (en) Searching method and related device
WO2021043121A1 (en) Image face changing method, apparatus, system, and device, and storage medium
CN107679485A (en) Aid reading method and device based on virtual reality
CN106534963A (en) Direct broadcast processing method, direct broadcast processing device and terminal
CN105959823A (en) Message presentation method and device for video direct broadcast application
CN107679942A (en) Product introduction method, apparatus and storage medium based on virtual reality
CN108319363A (en) Product introduction method, apparatus based on VR and electronic equipment
CN112783316A (en) Augmented reality-based control method and apparatus, electronic device, and storage medium
US11600300B2 (en) Method and device for generating dynamic image
CN106527938A (en) Method and device for operating application program
CN107566878B (en) Method and device for displaying pictures in live broadcast
CN104156151A (en) Image display method and image display device
CN106604101A (en) Live streaming interaction method and device
CN106267820A (en) Control the method for reality-virtualizing game, device and terminal
CN106598247B (en) Response control method and device based on virtual reality
CN116088976A (en) Text reading method and device, storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination