[go: up one dir, main page]

WO2018184360A1 - 一种信息获取、信息提供方法及相关装置 - Google Patents

一种信息获取、信息提供方法及相关装置 Download PDF

Info

Publication number
WO2018184360A1
WO2018184360A1 PCT/CN2017/102791 CN2017102791W WO2018184360A1 WO 2018184360 A1 WO2018184360 A1 WO 2018184360A1 CN 2017102791 W CN2017102791 W CN 2017102791W WO 2018184360 A1 WO2018184360 A1 WO 2018184360A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
screen
element information
information
display device
Prior art date
Application number
PCT/CN2017/102791
Other languages
English (en)
French (fr)
Inventor
强志强
赵君杰
Original Assignee
京东方科技集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司 filed Critical 京东方科技集团股份有限公司
Priority to US15/766,176 priority Critical patent/US20190124398A1/en
Priority to EP17854183.5A priority patent/EP3609186A4/en
Publication of WO2018184360A1 publication Critical patent/WO2018184360A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/46—Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/232—Content retrieval operation locally within server, e.g. reading video streams from disk arrays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • H04N21/8153—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics comprising still images, e.g. texture, background image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04803—Split screen, i.e. subdividing the display area or the window area into separate subareas
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/02—Recognising information on displays, dials, clocks

Definitions

  • the present application relates to the field of information technology, and in particular, to an information acquisition, an information providing method, and related devices.
  • the element information in the image is determined and provided to the user.
  • An information acquiring apparatus provided by an embodiment of the present application, where the apparatus is a mobile terminal, includes:
  • a sending unit configured to send a screen capture instruction to the screen receiving device, where the screen display device in the screen receiving device intercepts an image of the current display screen
  • An obtaining unit configured to acquire element information in the image.
  • a receiving unit configured to receive a screen capture instruction for instructing the screen display device to intercept an image of the current display screen
  • An identification unit configured to intercept an image of a current display screen of the screen display device according to the screen capture instruction, and identify an element in the image
  • a providing unit is configured to determine element information in the image and provide the information to the user.
  • FIG. 1 is a schematic flowchart diagram of an information transmission method according to an embodiment of the present application
  • FIG. 2 is a schematic flowchart diagram of another information transmission method according to an embodiment of the present disclosure.
  • FIG. 3 is a schematic flowchart diagram of still another information transmission method according to an embodiment of the present application.
  • FIG. 4 is a schematic flowchart of a method for acquiring information according to an embodiment of the present disclosure
  • FIG. 5 is a schematic flowchart of a method for providing information according to an embodiment of the present application.
  • FIG. 6 is a schematic flowchart diagram of another information providing method according to an embodiment of the present disclosure.
  • FIG. 7 is a schematic structural diagram of an information acquiring apparatus according to an embodiment of the present disclosure.
  • FIG. 8 is a schematic structural diagram of an information providing apparatus according to an embodiment of the present disclosure.
  • FIG. 9 is a schematic structural diagram of another information providing apparatus according to an embodiment of the present disclosure.
  • FIG. 10 is a schematic structural diagram of a terminal according to an embodiment of the present application.
  • An embodiment of the present application provides an information acquisition, an information providing method, and a related device, so that a user can more easily acquire element information of an image currently displayed on a screen display device.
  • the technical solution provided by the embodiment of the present application intercepts an image through a smart television, searches for element information in the image, and displays the information in a split screen manner, and finally sends the element information to the user's smart terminal, so as not to affect the television broadcast and the user.
  • relevant information such as people, objects, scenes (ie, elements) in the television screen is conveniently and quickly presented and transmitted to the user.
  • an information transmission method provided by an embodiment of the present application includes the following steps:
  • the smart terminal is, for example, a handheld smart terminal such as a mobile phone, a PAD, or a computer used by the user.
  • the smart TV not only has the function of displaying the TV screen, but also can establish a connection with the Internet and search for relevant information from the server in the Internet.
  • connection between the smart terminal and the smart TV, and between the smart TV and the server can be established by other means, and is not limited to establishing a connection through WIFI.
  • the smart terminal sends a screen capture instruction to the smart TV
  • a screen shot instruction can carry information about a target element.
  • the target element may be, for example, a face, a costume, a shoe and hat, a piece of furniture, a vehicle, or the like in a smart television display screen. That is, the user can instruct the smart TV to take a screen shot and instruct the smart TV to recognize the target element in the screen shot image.
  • the smart TV intercepts the television image, that is, intercepts the currently displayed image to obtain a screen capture image
  • the smart TV recognizes elements in the screen capture image, such as characters, objects, landscapes, etc.
  • the smart television sends an element image in the screen capture image to the server;
  • the server retrieves the information of the element in the screen capture image, that is, the element information, from the other server or the terminal according to the element image retrieval;
  • the server sends the element information of the retrieved screenshot image to the smart television
  • the intelligent terminal sends a split screen display instruction to the smart TV
  • the smart television may send a prompt information to the smart terminal, for example, including Or no option, to prompt the user whether to display the element information on the screen. If the user needs the smart TV to display the element information on the screen, the reply is (equivalent to sending the split screen display command), then the smart TV split screen display search The element information of the screen capture image to the screen image, otherwise, the smart TV set may not display the element information of the screen capture image retrieved by the split screen.
  • the smart TV split screen displays the retrieved screen image element information
  • the smart TV can also display the element information sent by the server by using the split screen display mode after receiving the element information of the retrieved screen capture image sent by the server to the smart television by default. Prompt the user whether to display the element information in split screen, and do not need to wait for the user to send a split screen display instruction.
  • the intelligent terminal sends an instruction (or a request) for acquiring the element information of the screen capture image to the smart television;
  • the smart television sends the element information of the acquired screen capture image to the smart terminal.
  • the smart TV can also display the element information of the retrieved screenshot image sent by the server to the smart TV without splitting the screen, but directly push it to the user's smart terminal, that is, the user does not need to send the screen capture through the smart terminal.
  • the instruction of the element information of the image is not limited to the image.
  • the smart television may send the element information of the acquired screen capture image to the smart terminal, and may also send relevant information for acquiring the element information of the screen capture image to the smart terminal, such as a two-dimensional code and an address link, and the user clicks through the smart terminal.
  • the QR code or address link can also obtain element information of the screen capture image.
  • the element information is not retrieved by the server, but the element information is retrieved through the smart set top box.
  • another information transmission method provided by an embodiment of the present application includes the following steps:
  • the smart TV set-top box and the smart TV can be connected through WIFI or wired.
  • the intelligent terminal sends a screen capture instruction to the smart TV set top box
  • the screen capture instruction can carry information of the target element.
  • the target element may be, for example, a face, a costume, a shoe and hat, a piece of furniture, a vehicle, or the like in a smart television display. That is, the user can instruct the smart TV to take a screen shot through the smart terminal (the screen capture instruction can be forwarded to the smart TV through the smart TV set-top box), and instruct the smart TV set-top box to identify the target element in the screen capture image.
  • the smart TV set-top box sends a screen capture instruction to the smart TV
  • the smart TV sends a screenshot image to the smart TV set-top box
  • the smart TV set-top box recognizes elements in the screen capture image, such as characters, objects, landscapes, etc.
  • the smart TV set-top box retrieves element information in the screen capture image via the Internet;
  • the smart TV set top box sends a split screen display instruction to the smart TV
  • the smart TV screen displays the retrieved screen image element information
  • the intelligent terminal sends an instruction to acquire the screen image element information to the smart TV set top box;
  • the smart TV set top box sends the information of the screen capture image element to the smart terminal;
  • the smart TV set top box may not send the split screen display instruction to the smart television, and the smart television set may display the element information of the screen capture image retrieved by the smart television set top box without dividing the screen, but the smart television set top box directly sends the obtained information to the smart terminal.
  • the element information of the screenshot image may not send the split screen display instruction to the smart television, and the smart television set may display the element information of the screen capture image retrieved by the smart television set top box without dividing the screen, but the smart television set top box directly sends the obtained information to the smart terminal.
  • the element information of the screenshot image may not send the split screen display instruction to the smart television, and the smart television set may display the element information of the screen capture image retrieved by the smart television set top box without dividing the screen, but the smart television set top box directly sends the obtained information to the smart terminal.
  • the element information of the screenshot image may not send the split screen display instruction to the smart television, and the smart television set may display the element information of the screen capture image retrieved by the smart television set top box without
  • another information transmission method includes the following steps:
  • the smart TV set-top box and the smart TV can be connected through WIFI or wired.
  • the remote control of the smart TV and the smart TV can be connected through WIFI, or The connection is established by infrared or the like.
  • the remote controller of the smart TV sends a screen capture instruction to the smart TV set top box
  • the smart TV set-top box sends a screen capture instruction to the smart TV
  • remote control of the smart TV can also directly send a screen capture instruction to the smart TV instead of forwarding the screen capture instruction to the smart TV through the smart TV set top box.
  • the screen capture instruction in this embodiment may carry information of the target element.
  • the target element may be, for example, a face, a costume, a shoe and hat, a piece of furniture, a vehicle, or the like in a smart television display. That is, the user can instruct the smart TV to take a screen shot through the remote controller, and instruct the smart TV set top box to recognize the target element in the screen capture image.
  • the smart TV sends a screenshot image to the smart TV set-top box
  • the smart TV set-top box recognizes the target elements in the screenshot image, such as characters, objects, landscapes, etc.;
  • the smart TV set top box retrieves element information of the target element in the screen capture image via the Internet;
  • the smart TV set top box sends a split screen display instruction to the smart TV
  • the smart TV screen displays the retrieved screen image element information
  • the intelligent terminal sends an instruction to acquire the screen image element information to the smart TV set top box;
  • the smart TV set top box sends the information of the screen capture image element to the smart terminal;
  • the smart TV set top box may not send the split screen display instruction to the smart television, and the smart television set may display the element information of the screen capture image retrieved by the smart television set top box without dividing the screen, but the smart television set top box directly sends the smart television set top box to the smart terminal. Get the element information of the screenshot image.
  • an information acquisition method provided by the embodiment of the present application includes:
  • S101 Send, by using a mobile terminal, a screen capture instruction to the screen receiving device, where the screen display device in the screen receiving device intercepts the image of the current display screen;
  • the picture receiving device in the embodiment of the present application may be a picture display device, or the picture receiving device may also be a digital video change box that establishes a connection with the picture display device (for example, the above-mentioned set top) box).
  • the screen display device may be, for example, a smart TV, a computer, a PAD, or the like having a screen display function.
  • step S102 Obtain element information in the image of step S101.
  • the screen capture instruction is sent to instruct the screen display device to intercept the image of the current display screen, and acquire the element information in the image, so that the user can more easily acquire the element information of the image of the current display screen.
  • the mobile terminal may be a remote controller of the mobile phone or the picture receiving device. That is, the user can send a screen capture instruction through the remote controller of the mobile phone or the screen receiving device.
  • the method before acquiring the element information in the image, the method further includes: sending, to the picture receiving device, a request for acquiring element information in the image.
  • the element information in the image of the step S101 may be sent to the screen receiving device by the mobile terminal, for example, and the element information in the image sent by the screen receiving device may be received, and the element in the image of step S101 may be acquired. information.
  • an information providing method provided by the embodiment of the present application includes:
  • S202 Capture an image of a current display screen of the screen display device according to the screen capture instruction, and identify an element in the image;
  • S203 Determine element information in the image and provide the information to the user.
  • the screen capture instruction received in the foregoing step S201 may be sent by the smart terminal such as a mobile phone directly to the smart television, or may be sent by the smart terminal to the smart television through the smart set top box, or may be a smart television.
  • the remote control is sent to the smart TV through the smart TV set-top box.
  • step S202 according to the screen capture instruction, the image of the current display screen of the screen display device is intercepted, and the image of the current screen may be intercepted by the screen display device.
  • the smart television intercepts the image of the current display screen according to the screen capture instruction.
  • step S202 according to the screen capture instruction, the current display picture of the screen display device is intercepted.
  • the elements in the image can be identified by the digital video transform box of the screen display device, that is, the screen display device transmits the screen capture image to the digital video transform box, and the digital video transform box identifies the elements in the image.
  • the screen display device can directly identify the elements in the image.
  • the elements in the recognition image may be, for example, people, objects, landscapes, and the like.
  • the step S203 determines the element information in the image, which may specifically include:
  • the element information in the image is acquired by a digital video conversion box of a server or a screen display device.
  • element information in the screen capture image may be retrieved from the other server or terminal via the element information retrieval or via the Internet.
  • the element information may be a specific name and related information of the character, related information such as a purchase link of the item, and related information such as a landscape introduction.
  • step S203 is provided to the user, and may specifically include:
  • the display element information is outputted by the screen display device in a split screen display manner.
  • the method may further include:
  • step S203 is provided to the user, and may also be directly sent to the intelligent terminal of the user by acquiring the element information in the image through the digital video conversion box of the server or the screen display device.
  • the method may further include:
  • the element information or related information for acquiring the element information is transmitted to the mobile terminal according to the request.
  • an information providing method provided by the embodiment of the present application includes:
  • S301 Determine an element in an image of a current display screen intercepted by the screen display device.
  • step S301 determines that the screen display device intercepts
  • the elements in the image of the currently displayed screen include:
  • the screen capture instruction may be sent by the mobile phone or may be sent by a remote controller of the screen display device;
  • the step S303, the providing the retrieved element information specifically includes: providing the retrieved element information to the screen display device.
  • the element information in the image is provided to the screen display device by sending a split screen display instruction, and the screen display device is instructed to display the element information in the image by means of split screen display.
  • the embodiment of the present application further provides the following device.
  • an information acquiring apparatus provided by the embodiment of the present application includes:
  • the sending unit 11 is configured to send a screen capture instruction to the screen receiving device, where the display device in the screen receiving device intercepts the image of the current display screen;
  • the obtaining unit 12 is configured to acquire element information in the image.
  • the mobile terminal may be a remote controller of the mobile phone or the screen display device.
  • the sending unit 11 is further configured to: send, to the screen receiving device, a request for acquiring element information in the image.
  • an information providing apparatus provided by the embodiment of the present application includes:
  • the receiving unit 21 is configured to receive a screen capture instruction for instructing the screen display device to intercept an image of the current display screen
  • the identifying unit 22 is configured to intercept an image of a current display screen of the screen display device according to the screen capture instruction, and identify an element in the image;
  • a providing unit 23 is configured to determine element information in the image and provide it to the user.
  • the identifying unit 22 is specifically configured to:
  • the image of the current display screen is captured by the screen display device.
  • the identifying unit 22 is specifically configured to:
  • the elements in the image are identified by a digital video transform box of the picture display device.
  • the providing unit 23 is specifically configured to:
  • the element information in the image is acquired by a digital video conversion box of a server or a screen display device.
  • the providing unit 23 is specifically configured to:
  • the display element information is outputted by the screen display device in a split screen display manner.
  • the receiving unit 21 is further configured to:
  • the providing unit 23 is further configured to:
  • the element information or related information for acquiring the element information is transmitted to the mobile terminal according to the request.
  • an information providing apparatus provided by the embodiment of the present application includes:
  • the first unit 31 is configured to determine an element in an image of a current display screen intercepted by the screen display device
  • a second unit 32 configured to retrieve element information in the image
  • the third unit 33 is configured to provide the retrieved element information.
  • the first unit 31 is specifically configured to:
  • the third unit 33 is specifically configured to: provide the retrieved element information to the screen display device.
  • the third unit 33 provides the element information in the image to the screen display device by sending a split screen display instruction, and instructs the screen display device to display the element information in the image by means of split screen display.
  • the digital video conversion box of the smart terminal, the smart television, and the smart television provided in the embodiment of the present application can be understood as a terminal (or a computing device).
  • the embodiment of the present application provides a computing device, which may be a desktop computer, a portable computer, a smart phone, a tablet computer, a personal digital assistant (PDA), a smart television (which may include a remote controller), Smart TV digital video converter box, etc.
  • the computing device may include a central processing unit (CPU), a memory, an input/output device, etc.
  • the input device may include a keyboard, a mouse, a touch screen, a remote controller, etc.
  • the output device may include a display device.
  • the memory can include read only memory (ROM) and random access memory (RAM) and provides the processor with program instructions and data stored in the memory.
  • the memory may be used to store a program based on the abnormality monitoring method of the transaction data.
  • the processor is operative to execute the steps of the various methods described above in response to the obtained program instructions by invoking program instructions stored in the memory.
  • the embodiment of the present application further provides a computer storage medium for storing computer program instructions used by the computing device, which includes a program for executing the various methods described above.
  • the computer storage medium can be any available media or data storage device accessible by the computer, including but not limited to magnetic memory (eg, floppy disk, hard disk, magnetic tape, magneto-optical disk (MO), etc.), optical storage (eg, CD, DVD, BD, HVD, etc.), and semiconductor memories (such as ROM, EPROM, EEPROM, non-volatile memory (NAND FLASH), solid-state hard disk (SSD)).
  • magnetic memory eg, floppy disk, hard disk, magnetic tape, magneto-optical disk (MO), etc.
  • optical storage eg, CD, DVD, BD, HVD, etc.
  • semiconductor memories such as ROM, EPROM, EEPROM, non-volatile memory (NAND FLASH), solid-state hard disk (SSD)).
  • a terminal provided by an embodiment of the present application includes: a bus interface, a processor 600, a transceiver 610, a memory 620, and a user interface 630;
  • the processor 600 is configured to read a program in the memory 620 and perform the following process:
  • the processor 600 transmits a screen capture instruction to the picture display device or to the digital video conversion box that establishes a connection with the picture display device through the transceiver 610.
  • the processor 600 before the processor 600 acquires the element information in the image by the transceiver 610, the processor 600 further sends the acquired image in the acquired image to the screen display device or to the digital video conversion box that establishes the connection with the screen display device through the transceiver 610. Request for element information.
  • the processor 600 is configured to read a program in the memory 620 and perform the following process:
  • the image of the current display screen of the screen display device is intercepted, and the elements in the image are identified;
  • determining element information in the image and providing the information to the user includes:
  • the element information in the image is acquired by the digital video conversion box of the server or the screen display device, and the display element information is controlled by the display by means of split screen display.
  • the element information in the image may be acquired by the digital video conversion box of the server or the screen display device, and then directly sent to the intelligent terminal of the user through the transceiver 610.
  • determining element information in the image and providing the information to the user further includes:
  • the element information or related information for acquiring the element information is transmitted to the terminal through the transceiver 610 according to the request.
  • the processor 600 is configured to read a program in the memory 620 and perform the following process:
  • the method when determining, by the processor 600, an element in an image of a current display screen captured by the screen display device, the method is specifically configured to:
  • the method is specifically configured to: provide the retrieved element information to the screen display device by using the transceiver 610.
  • the split screen display instruction is sent by the transceiver 610, and the element information in the image is provided to the screen display device, and the screen display device is instructed to display the element information in the image by means of split screen display.
  • the transceiver 610 is configured to receive and transmit data under the control of the processor 600.
  • the bus architecture can include any number of interconnected buses and bridges, specifically linked by one or more processors represented by processor 600 and various circuits of memory represented by memory 620.
  • the bus architecture can also link various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and, therefore, will not be further described herein.
  • the bus interface provides an interface.
  • Transceiver 610 can be a plurality of components, including a transmitter and a receiver, providing means for communicating with various other devices on a transmission medium.
  • the user interface 630 may also be an interface capable of externally connecting the required devices, including but not limited to a keypad, a display, a speaker, a microphone, a joystick, a remote controller, and the like.
  • the processor 600 is responsible for managing the bus architecture and general processing, and the memory 620 can store data used by the processor 600 in performing operations.
  • the processor 600 may be a CPU (Central Embedded Device), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a CPLD (Complex Programmable Logic Device). , complex programmable logic devices).
  • CPU Central Embedded Device
  • ASIC Application Specific Integrated Circuit
  • FPGA Field-Programmable Gate Array
  • CPLD Complex Programmable Logic Device
  • the invention provides a TV screen capture image processing method, device and system.
  • the smart TV receives the screen capture instruction sent by the user, intercepts the image selected by the user according to the instruction, and then retrieves the information of the person, the item or the landscape in the intercepted image through the Internet. And it is displayed by split screen mode, and finally the relevant information is sent to the user intelligent terminal, thereby realizing information about people, articles, landscapes, etc. in the television screen that the user is interested in without affecting the situation of television broadcast and user viewing process. Quickly and conveniently search and present and send to the user to enhance the user experience.
  • embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.
  • computer-usable storage media including but not limited to disk storage, CD-ROM, optical storage, etc.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in a block or blocks of a flow or a flow and/or a block diagram of a flowchart Step.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本申请公开了一种信息获取、信息提供方法及相关装置，用以使得用户可以更加便捷地获取画面显示设备当前显示画面的图像的元素信息。本申请提供的一种信息获取方法，包括：发送截屏指令，用于指示画面显示设备截取当前显示画面的图像；获取所述图像中的元素信息。

Description

一种信息获取、信息提供方法及相关装置
本申请要求在2017年4月7日提交中国专利局、申请号为201710223539.7、发明名称为“一种信息获取、提供方法及装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及信息技术领域，尤其涉及一种信息获取、信息提供方法及相关装置。
背景技术
随着智能电视机的普及，用户的观看需求也在不断增多，比如在观看电视的同时希望能参与电视节目、与同在观看的其他用户进行社交互动等，有时也希望通过电视节目主动获得更多的信息，这对智能电视机的智能操作性和用户体验度提出了更高的要求。
目前，用户在观看电视的过程中，如果发现感兴趣的人物、物品、景观等，在不知道其姓名、名称等信息的情况下，是很难及时通过互联网进行搜索的，事后通过其他途径得知又比较费事。
发明内容
本申请实施例提供的一种信息获取方法，包括：
通过移动端，向画面接收设备发送截屏指令，用于指示所述画面接收设备中的画面显示设备截取当前显示画面的图像；
获取所述图像中的元素信息。
本申请实施例提供的一种信息提供方法，包括：
接收用于指示画面显示设备截取当前显示画面的图像的截屏指令；
根据所述截屏指令，截取所述画面显示设备当前显示画面的图像，并识别所述图像中的元素；
确定所述图像中的元素信息，并提供给用户。
本申请实施例提供的一种信息获取装置，该装置为移动端，包括：
发送单元，用于向画面接收设备发送截屏指令，用于指示所述画面接收设备中的画面显示设备截取当前显示画面的图像；
获取单元，用于获取所述图像中的元素信息。
本申请实施例提供的一种信息提供装置，包括：
接收单元，用于接收用于指示画面显示设备截取当前显示画面的图像的截屏指令；
识别单元，用于根据所述截屏指令，截取所述画面显示设备当前显示画面的图像，并识别所述图像中的元素；
提供单元，用于确定所述图像中的元素信息，并提供给用户。
附图说明
为了更清楚地说明本申请实施例中的技术方案，下面将对实施例描述中所需要使用的附图作简要介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域的普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1为本申请实施例提供的一种信息传输方法的流程示意图；
图2为本申请实施例提供的另一种信息传输方法的流程示意图；
图3为本申请实施例提供的又一种信息传输方法的流程示意图；
图4为本申请实施例提供的一种信息获取方法的流程示意图；
图5为本申请实施例提供的一种信息提供方法的流程示意图；
图6为本申请实施例提供的另一种信息提供方法的流程示意图；
图7为本申请实施例提供的一种信息获取装置的结构示意图；
图8为本申请实施例提供的一种信息提供装置的结构示意图；
图9为本申请实施例提供的另一种信息提供装置的结构示意图；
图10为本申请实施例提供的一种终端的结构示意图。
具体实施方式
本申请实施例提供了一种信息获取、信息提供方法及相关装置，用以使得用户可以更加便捷地获取画面显示设备当前显示画面的图像的元素信息。
本申请实施例提供的技术方案，通过智能电视机截取图像，搜索图像中的元素信息，并以分屏方式显示出来，最后将元素信息发送到用户的智能终端，实现在不影响电视播放和用户观看进程的情况下，将电视画面中的人、物、景(即元素)等的相关信息方便、快捷地呈现和发送给用户。
参见图1，本申请实施例提供的一种信息传输方法包括以下步骤：
1)智能终端与智能电视机通过WIFI建立连接；
其中，智能终端，例如是用户使用的手机、PAD、计算机等手持智能终端。
智能电视机，不仅具有显示电视画面的功能，还可以与互联网建立连接，从互联网中的服务器搜索相关信息。
2)智能电视机与服务器通过WIFI建立连接；
其中，上述两个步骤可以同时进行。另外，智能终端与智能电视机之间，以及智能电视机与服务器之间也可以通过其他方式建立连接，不局限于通过WIFI建立连接。
3)智能终端向智能电视机发送截屏指令；
例如，截屏指令可以携带目标元素的信息。该目标元素，例如可以是智能电视机显示画面中的人脸、服装、鞋帽、家具、交通工具等等。即此处用户可以指示智能电视机进行截屏，并且指示智能电视机对截屏图像中的目标元素进行识别。
4)智能电视机截取电视图像，即截取当前显示的图像，得到截屏图像；
5)智能电视机识别截屏图像中的元素，比如人物、物品、景观等；
6)智能电视机向服务器发送截屏图像中的元素图像；
7)服务器收到上述元素图像后，按照该元素图像检索或通过互联网从其他服务器或终端检索截屏图像中的元素的信息，即元素信息；
8)服务器向智能电视机发送检索到的截屏图像的元素信息；
9)智能终端向智能电视机发送分屏显示指令；
需要说明的是，在服务器向智能电视机发送检索到的截屏图像的元素信息之后，智能终端向智能电视机发送分屏显示指令之前，智能电视机可以向智能终端发送一提示信息，例如包括是或否的选项，用于提示用户是否需要分屏显示元素信息，若用户需要智能电视机分屏显示元素信息，则回复是(相当于发送分屏显示指令)，则智能电视机分屏显示检索到的截屏图像的元素信息，否则，智能电视机也可以不进行分屏显示检索到的截屏图像的元素信息。
10)智能电视机分屏显示检索到的截屏图像元素信息；
需要说明的是，智能电视机也可以默认在收到服务器向智能电视机发送的检索到的截屏图像的元素信息后，直接通过分屏显示的方式，分屏显示服务器发的元素信息，而无需提示用户是否需要分屏显示该元素信息，也无需等待用户发送分屏显示指令。
11)智能终端向智能电视机发送获取截屏图像的元素信息的指令(或者称为请求)；
12)智能电视机向智能终端发送获取到的截屏图像的元素信息。
需要说明的是，智能电视机也可以不分屏显示服务器向智能电视机发送的检索到的截屏图像的元素信息，而是直接推送给用户的智能终端，即也无需用户通过智能终端发送获取截屏图像的元素信息的指令。
另外，智能电视机可以向智能终端发送获取到的截屏图像的元素信息，也可以向智能终端发送用于获取截屏图像的元素信息的相关信息，例如二维码、地址链接，用户通过智能终端点击该二维码或地址链接，也可以获取截屏图像的元素信息。
上述各个步骤的解释说明以及扩展方案，同样适用于下述类似步骤。
本申请提供的另一实施例中不通过服务器检索元素信息，而是通过智能电视机顶盒检索元素信息。参见图2，本申请实施例提供的另一种信息传输方法包括以下步骤：
1)智能终端与智能电视机顶盒通过WIFI建立连接；
智能电视机顶盒与智能电视机之间可以通过WIFI建立连接，也可以进行有线连接。
2)智能终端向智能电视机顶盒发送截屏指令；
具体地，截屏指令可以携带目标元素的信息。目标元素，例如可以是智能电视机显示画面中的人脸、服装、鞋帽、家具、交通工具等等。即此处用户可以通过智能终端指示智能电视机进行截屏(截屏指令可以通过智能电视机顶盒转发给智能电视机)，并且指示智能电视机顶盒对截屏图像中的目标元素进行识别。
3)智能电视机顶盒向智能电视机发送截屏指令；
4)智能电视机截取电视图像；
5)智能电视机向智能电视机顶盒发送截屏图像；
6)智能电视机顶盒识别截屏图像中的元素，比如人物、物品、景观等；
7)智能电视机顶盒通过互联网检索截屏图像中的元素信息；
8)智能电视机顶盒向智能电视机发送分屏显示指令；
9)智能电视机分屏显示检索到的截屏图像元素信息；
10)智能终端向智能电视机顶盒发送获取截屏图像元素信息指令；
11)智能电视机顶盒向智能终端发送获取截屏图像元素信息；
具体地，智能电视机顶盒可以不向智能电视机发送分屏显示指令，智能电视机可以不分屏显示智能电视机顶盒检索到的截屏图像的元素信息，而是，智能电视机顶盒直接向智能终端发送获取的截屏图像的元素信息。
可选地，用户还可以通过智能电视机的遥控器来发送截屏指令。参见图3，本申请实施例提供的又一种信息传输方法包括以下步骤：
1)智能终端与智能电视机顶盒通过WIFI建立连接；
智能电视机顶盒与智能电视机之间可以通过WIFI建立连接，也可以进行有线连接。
智能电视机的遥控器与智能电视机之间可以通过WIFI建立连接，也可以 通过红外等方式建立连接。
2)智能电视机的遥控器向智能电视机顶盒发送截屏指令；
3)智能电视机顶盒向智能电视机发送截屏指令；
需要说明的是，智能电视机的遥控器也可以直接向智能电视机发送截屏指令，而不是通过智能电视机顶盒向智能电视机转发截屏指令。
具体地，本实施例中的截屏指令可以携带目标元素的信息。目标元素，例如可以是智能电视机显示画面中的人脸、服装、鞋帽、家具、交通工具等等。即此处用户可以通过遥控器指示智能电视机进行截屏，并且指示智能电视机顶盒对截屏图像中的目标元素进行识别。
4)智能电视机截取电视图像；
5)智能电视机向智能电视机顶盒发送截屏图像；
6)智能电视机顶盒识别截屏图像中的目标元素，比如人物、物品、景观等；
7)智能电视机顶盒通过互联网检索截屏图像中的目标元素的元素信息；
8)智能电视机顶盒向智能电视机发送分屏显示指令；
9)智能电视机分屏显示检索到的截屏图像元素信息；
10)智能终端向智能电视机顶盒发送获取截屏图像元素信息指令；
11)智能电视机顶盒向智能终端发送获取截屏图像元素信息；
可选地，智能电视机顶盒可以不向智能电视机发送分屏显示指令，智能电视机可以不分屏显示智能电视机顶盒检索到的截屏图像的元素信息，而是，智能电视机顶盒直接向智能终端发送获取的截屏图像的元素信息。
综上，参见图4，在移动端(例如上述的智能终端或遥控器)侧，本申请实施例提供的一种信息获取方法，包括：
S101、通过移动端，向画面接收设备发送截屏指令，用于指示画面接收设备中的画面显示设备截取当前显示画面的图像；
本申请实施例中的画面接收设备可以是画面显示设备，或者画面接收设备也可以是与画面显示设备建立连接的数字视频变化盒(例如上述的机顶 盒)。画面显示设备例如可以是智能电视机、电脑、PAD等等具有画面显示功能的设备。
S102、获取步骤S101的图像中的元素信息。
通过该方法，发送截屏指令，用于指示画面显示设备截取当前显示画面的图像，并获取图像中的元素信息，从而使得用户可以更加便捷地获取当前显示画面的图像的元素信息。
可选地，移动端可以为手机或画面接收设备的遥控器。即用户可以通过手机或画面接收设备的遥控器，发送截屏指令。
可选地，获取图像中的元素信息之前，该方法还包括：向画面接收设备发送获取图像中的元素信息的请求。
可选地，可以通过例如手机的移动端，向画面接收设备发送获取步骤S101的图像中的元素信息，并接收画面接收设备发送的图像中的元素信息的方式，获取步骤S101的图像中的元素信息。
相应地，在画面接收设备(例如上述的智能电视机、智能电视机顶盒和服务器)侧，参见图5，本申请实施例提供的一种信息提供方法，包括：
S201、接收用于指示画面显示设备截取当前显示画面的图像的截屏指令；
S202、根据截屏指令，截取画面显示设备当前显示画面的图像，并识别图像中的元素；
S203、确定图像中的元素信息，并提供给用户。
可选地，上述步骤S201中接收的截屏指令可以是诸如手机的智能终端直接向智能电视机发送的，也可以是智能终端通过智能电视机顶盒向智能电视机发送的，还可以是智能电视机的遥控器通过智能电视机顶盒向智能电视机发送的。
可选地，上述步骤S202中根据截屏指令，截取画面显示设备当前显示画面的图像，可以是通过画面显示设备截取当前画面的图像。具体地，智能电视机在接收到截屏指令后，根据截屏指令，截取当前显示画面的图像。
可选地，上述步骤S202中根据截屏指令，截取画面显示设备当前显示画 面的图像之后，可以通过画面显示设备的数字视频变换盒识别图像中的元素，即画面显示设备将截屏图像发送至数字视频变换盒，数字视频变换盒识别图像中的元素。或者，上述步骤S202中根据截屏指令，截取画面显示设备当前显示画面的图像之后，画面显示设备可直接识别图像中的元素。
具体地，识别图像中的元素可以是，比如人物、物品、景观等。
可选地，上述步骤S203确定图像中的元素信息，可以具体包括：
通过服务器或画面显示设备的数字视频变换盒获取图像中的元素信息。具体地，可以按照该元素信息检索或通过互联网从其他服务器或终端检索截屏图像中的元素信息。具体地，元素信息可以是人物具体名字和相关信息，物品的购买链接等相关信息，景观介绍等相关信息等。
可选地，上述步骤S203提供给用户，可以具体包括：
通过画面显示设备分屏显示的方式输出显示元素信息。
可选地，在通过画面显示设备分屏显示的方式输出显示元素信息之前，还可以包括：
接收移动端发送的分屏显示指令。以使画面显示设备在接收到分屏显示指令之后，通过分屏显示的方式输出显示元素信息。
当然，上述步骤S203提供给用户，也可以通过服务器或画面显示设备的数字视频变换盒获取图像中的元素信息后直接发送给用户的智能终端。
可选地，在确定图像中的元素信息，并提供给用户之后，还可以包括：
接收移动端发送的获取图像中的元素信息的请求；
根据请求，将元素信息或用于获取元素信息的相关信息发送给移动端。
相应地，在画面显示设备的数字视频变换盒(例如上述的智能电视机顶盒)或服务器侧，参见图6，本申请实施例提供的一种信息提供方法，包括：
S301、确定画面显示设备截取的当前显示画面的图像中的元素；
S302、检索图像中的元素信息；
S303、提供检索到的元素信息。
可选地，在数字视频变换盒侧：上述步骤S301确定画面显示设备截取的 当前显示画面的图像中的元素，具体包括：
接收用于指示画面显示设备截取当前显示画面的图像的截屏指令；具体地，截屏指令可以是手机发送的，也可以是画面显示设备的遥控器发送的；
将截屏指令发送给画面显示设备；
接收画面显示设备发送的画面显示设备截取的当前显示画面的图像；
识别图像中的元素。
可选地，上述步骤S303提供检索到的元素信息具体包括：提供检索到的元素信息给画面显示设备。
可选地，通过发送分屏显示指令，将图像中的元素信息提供给画面显示设备，并指示画面显示设备通过分屏显示的方式显示图像中的元素信息。
与上述方法相对应地，本申请实施例还提供如下装置。
参见图7，在移动端(例如上述的智能终端或遥控器)侧，本申请实施例提供的一种信息获取装置，包括：
发送单元11，用于向画面接收设备发送截屏指令，用于指示画面接收设备中的显示设备截取当前显示画面的图像；
获取单元12，用于获取图像中的元素信息。
可选地，移动端可以为手机或画面显示设备的遥控器。
可选地，发送单元11在获取单元12获取图像中的元素信息之前，还用于：向画面接收设备发送获取图像中的元素信息的请求。
参见图8，在画面接收设备(例如上述的智能电视机、智能电视机顶盒和服务器)侧，本申请实施例提供的一种信息提供装置，包括：
接收单元21，用于接收用于指示画面显示设备截取当前显示画面的图像的截屏指令；
识别单元22，用于根据截屏指令，截取画面显示设备当前显示画面的图像，并识别图像中的元素；
提供单元23，用于确定图像中的元素信息，并提供给用户。
可选地，识别单元22具体用于：
通过画面显示设备截取当前显示画面的图像。
可选地，识别单元22具体用于：
通过画面显示设备的数字视频变换盒识别所述图像中的元素。
可选地，提供单元23具体用于：
通过服务器或画面显示设备的数字视频变换盒获取图像中的元素信息。
可选地，提供单元23具体用于：
通过画面显示设备分屏显示的方式输出显示元素信息。
可选地，接收单元21在提供单元23通过画面显示设备分屏显示的方式输出显示元素信息之前，还用于：
接收移动端发送的分屏显示指令。
可选地，提供单元23还用于：
接收移动端发送的获取图像中的元素信息的请求；
根据请求，将元素信息或用于获取元素信息的相关信息发送给移动端。
参见图9，在画面显示设备的数字视频变换盒(例如上述的机顶盒)或服务器侧，本申请实施例提供的一种信息提供装置，包括：
第一单元31，用于确定画面显示设备截取的当前显示画面的图像中的元素；
第二单元32，用于检索图像中的元素信息；
第三单元33，用于提供检索到的元素信息。
可选地，在数字视频变换盒侧：
第一单元31具体用于：
接收用于指示画面显示设备截取当前显示画面的图像的截屏指令；
将截屏指令发送给画面显示设备；
接收画面显示设备发送的画面显示设备截取的当前显示画面的图像；
识别图像中的元素。
可选地，第三单元33，具体用于：提供检索到的元素信息给画面显示设备。
可选地，第三单元33通过发送分屏显示指令，将图像中的元素信息提供给画面显示设备，并指示画面显示设备通过分屏显示的方式显示图像中的元素信息。
需要说明的是，本申请实施例中提供的上述智能终端、智能电视机、智能电视机的数字视频变换盒，都可以理解为一种终端(或称为计算设备)。本申请实施例提供了一种计算设备，该计算设备具体可以为桌面计算机、便携式计算机、智能手机、平板电脑、个人数字助理(Personal Digital Assistant，PDA)、智能电视机(可以包括遥控器)、智能电视数字视频变换盒等。如图10所示，该计算设备可以包括中央处理器(Center Processing Unit，CPU)、存储器、输入/输出设备等，输入设备可以包括键盘、鼠标、触摸屏、遥控器等，输出设备可以包括显示设备，如液晶显示器(Liquid Crystal Display，LCD)、阴极射线管(Cathode Ray Tube，CRT)等。
存储器可以包括只读存储器(ROM)和随机存取存储器(RAM)，并向处理器提供存储器中存储的程序指令和数据。在本申请实施例中，存储器可以用于存储基于交易数据的异常监测方法的程序。处理器通过调用存储器存储的程序指令，处理器用于按照获得的程序指令执行上述各个方法中的步骤。
本申请实施例还提供了一种计算机存储介质，用于储存为上述计算设备所用的计算机程序指令，其包含用于执行上述各种方法的程序。
计算机存储介质可以是计算机能够存取的任何可用介质或数据存储设备，包括但不限于磁性存储器(例如软盘、硬盘、磁带、磁光盘(MO)等)、光学存储器(例如CD、DVD、BD、HVD等)、以及半导体存储器(例如ROM、EPROM、EEPROM、非易失性存储器(NAND FLASH)、固态硬盘(SSD))等。
参见图10，本申请实施例提供的终端，包括：总线接口、处理器600、收发机610、存储器620和用户接口630；
处理器600，用于读取存储器620中的程序，执行下列过程：
通过收发机610发送截屏指令，用于指示画面显示设备截取当前显示画 面的图像，并通过收发机610获取该图像中的元素信息。
可选地，处理器600通过收发机610，向画面显示设备或者向与画面显示设备建立连接的数字视频变换盒发送截屏指令。
可选地，处理器600通过收发机610获取图像中的元素信息之前，处理器600还通过收发机610，向画面显示设备或者向与画面显示设备建立连接的数字视频变换盒发送获取图像中的元素信息的请求。
或者，处理器600，用于读取存储器620中的程序，执行下列过程：
通过收发机610接收用于指示画面显示设备截取当前显示画面的图像的截屏指令；
根据截屏指令，截取画面显示设备当前显示画面的图像，并识别图像中的元素；
确定图像中的元素信息，并提供给用户。
可选地，确定图像中的元素信息，并提供给用户，具体包括：
通过服务器或画面显示设备的数字视频变换盒获取图像中的元素信息，并通过分屏显示的方式控制显示器输出显示元素信息。
当然，也可以通过服务器或画面显示设备的数字视频变换盒获取图像中的元素信息后通过收发机610直接发送给用户的智能终端。
可选地，确定图像中的元素信息，并提供给用户，还包括：
通过收发机610接收终端发送的获取图像中的元素信息的请求；
根据请求，将元素信息或用于获取元素信息的相关信息通过收发机610发送给终端。
或者，处理器600，用于读取存储器620中的程序，执行下列过程：
确定画面显示设备截取的当前显示画面的图像中的元素；
检索图像中的元素信息；
提供检索到的元素信息。
可选地，处理器600确定画面显示设备截取的当前显示画面的图像中的元素时，具体用于：
通过收发机610接收用于指示画面显示设备截取当前显示画面的图像的截屏指令；
通过收发机610将截屏指令发送给画面显示设备；
通过收发机610接收画面显示设备发送的画面显示设备截取的当前显示画面的图像；
识别图像中的元素。
可选地，处理器600提供检索到的元素信息时，具体用于：通过收发机610提供检索到的元素信息给画面显示设备。
可选地，通过收发机610发送分屏显示指令，将图像中的元素信息提供给画面显示设备，并指示画面显示设备通过分屏显示的方式显示图像中的元素信息。
收发机610，用于在处理器600的控制下接收和发送数据。
其中，在图10中，总线架构可以包括任意数量的互联的总线和桥，具体由处理器600代表的一个或多个处理器和存储器620代表的存储器的各种电路链接在一起。总线架构还可以将诸如外围设备、稳压器和功率管理电路等之类的各种其他电路链接在一起，这些都是本领域所公知的，因此，本文不再对其进行进一步描述。总线接口提供接口。收发机610可以是多个元件，即包括发送机和接收机，提供用于在传输介质上与各种其他装置通信的单元。针对不同的用户设备，用户接口630还可以是能够外接内接需要设备的接口，连接的设备包括但不限于小键盘、显示器、扬声器、麦克风、操纵杆、遥控器等。
处理器600负责管理总线架构和通常的处理，存储器620可以存储处理器600在执行操作时所使用的数据。
可选的，处理器600可以是CPU(中央处埋器)、ASIC(Application Specific Integrated Circuit，专用集成电路)、FPGA(Field－Programmable Gate Array，现场可编程门阵列)或CPLD(Complex Programmable Logic Device，复杂可编程逻辑器件)。
本发明提供一种电视截屏图像处理方法、装置和系统，智能电视机接收用户发送的截屏指令，按照指令截取用户选中的图像，然后通过互联网检索截取到的图像中人物、物品或景观的信息，并通过分屏方式显示出来，最后将相关信息发送到用户智能终端，从而实现在不影响电视播放和用户观看进程的情况，将用户感兴趣的电视画面中的人物、物品、景观等的相关信息，快速、便捷的搜索出来并呈现和发送方给用户，提升用户体验。
本领域内的技术人员应明白，本发明的实施例可提供为方法、系统、或计算机程序产品。因此，本发明可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且，本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步 骤。
尽管已描述了本发明的优选实施例，但本领域内的技术人员一旦得知了基本创造性概念，则可对这些实施例作出另外的变更和修改。所以，所附权利要求意欲解释为包括优选实施例以及落入本发明范围的所有变更和修改。
显然，本领域的技术人员可以对本发明实施例进行各种改动和变型而不脱离本发明实施例的精神和范围。这样，倘若本发明实施例的这些修改和变型属于本发明权利要求及其等同技术的范围之内，则本发明也意图包含这些改动和变型在内。

Claims (20)

  1. 一种信息获取方法，其特征在于，该方法包括：
    通过移动端，向画面接收设备发送截屏指令，用于指示所述画面接收设备中的画面显示设备截取当前显示画面的图像；
    获取所述图像中的元素信息。
  2. 根据权利要求1所述的方法，其特征在于，所述移动端为手机或所述画面接收设备的遥控器。
  3. 根据权利要求1所述的方法，其特征在于，获取所述图像中的元素信息之前，该方法还包括：向所述画面接收设备发送获取所述图像中的元素信息的请求。
  4. 一种信息提供方法，其特征在于，包括：
    接收用于指示画面显示设备截取当前显示画面的图像的截屏指令；
    根据所述截屏指令，截取所述画面显示设备当前显示画面的图像，并识别所述图像中的元素；
    确定所述图像中的元素信息，并提供给用户。
  5. 根据权利要求4所述的方法，其特征在于，所述截取所述画面显示设备当前显示画面的图像，具体包括：通过所述画面显示设备截取当前显示画面的图像。
  6. 根据权利要求4所述的方法，其特征在于，所述识别所述图像中的元素，具体包括：通过画面显示设备的数字视频变换盒识别所述图像中的元素。
  7. 根据权利要求4所述的方法，其特征在于，所述确定所述图像中的元素信息，具体包括：
    通过服务器或画面显示设备的数字视频变换盒获取所述图像中的元素信息。
  8. 根据权利要求4-7任一项所述的方法，其特征在于，所述提供给用户，具体包括：
    通过所述画面显示设备分屏显示的方式输出显示所述元素信息。
  9. 根据权利要求8所述的方法，其特征在于，所述通过所述画面显示设备分屏显示的方式输出显示元素信息之前，还包括：
    接收移动端发送的分屏显示指令。
  10. 根据权利要求4-7任一项所述的方法，其特征在于，所述确定所述图像中的元素信息，并提供给用户之后，还包括：
    接收移动端发送的获取所述图像中的元素信息的请求；
    根据所述请求，将所述元素信息或用于获取所述元素信息的相关信息发送给所述移动端。
  11. 一种信息获取装置，其特征在于，该装置为移动端，包括：
    发送单元，用于向画面接收设备发送截屏指令，用于指示所述画面接收设备中的画面显示设备截取当前显示画面的图像；
    获取单元，用于获取所述图像中的元素信息。
  12. 根据权利要求11所述的装置，其特征在于，所述移动端为手机或所述画面显示设备的遥控器。
  13. 根据权利要求11所述的装置，其特征在于，所述发送单元在所述获取单元获取所述图像中的元素信息之前，还用于：向所述画面接收设备发送获取所述图像中的元素信息的请求。
  14. 一种信息提供装置，其特征在于，包括：
    接收单元，用于接收用于指示画面显示设备截取当前显示画面的图像的截屏指令；
    识别单元，用于根据所述截屏指令，截取所述画面显示设备当前显示画面的图像，并识别所述图像中的元素；
    提供单元，用于确定所述图像中的元素信息，并提供给用户。
  15. 根据权利要求14所述的装置，其特征在于，所述识别单元具体用于：通过所述画面显示设备截取当前显示画面的图像。
  16. 根据权利要求14所述的装置，其特征在于，所述识别单元具体用于： 通过画面显示设备的数字视频变换盒识别所述图像中的元素。
  17. 根据权利要求14所述的装置，其特征在于，所述提供单元具体用于：
    通过服务器或画面显示设备的数字视频变换盒获取所述图像中的元素信息。
  18. 根据权利要求14-17任一项所述的装置，其特征在于，所述提供单元具体用于：
    通过所述画面显示设备分屏显示的方式输出显示所述元素信息。
  19. 根据权利要求18所述的装置，其特征在于，所述接收单元在所述提供单元通过所述画面显示设备分屏显示的方式输出显示元素信息之前，还用于：
    接收移动端发送的分屏显示指令。
  20. 根据权利要求14-17任一项所述的装置，其特征在于，所述提供单元还用于：
    接收移动端发送的获取所述图像中的元素信息的请求；
    根据所述请求，将所述元素信息或用于获取所述元素信息的相关信息发送给所述移动端。
PCT/CN2017/102791 2017-04-07 2017-09-21 一种信息获取、信息提供方法及相关装置 WO2018184360A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US15/766,176 US20190124398A1 (en) 2017-04-07 2017-09-21 Methods and apparatuses for obtaining and providing information
EP17854183.5A EP3609186A4 (en) 2017-04-07 2017-09-21 PROCESS FOR ACQUISITION AND PROVISION OF INFORMATION AND ASSOCIATED DEVICE

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710223539.7 2017-04-07
CN201710223539.7A CN108696760A (zh) 2017-04-07 2017-04-07 一种信息获取、提供方法及装置

Publications (1)

Publication Number Publication Date
WO2018184360A1 true WO2018184360A1 (zh) 2018-10-11

Family

ID=63712855

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/102791 WO2018184360A1 (zh) 2017-04-07 2017-09-21 一种信息获取、信息提供方法及相关装置

Country Status (4)

Country Link
US (1) US20190124398A1 (zh)
EP (1) EP3609186A4 (zh)
CN (1) CN108696760A (zh)
WO (1) WO2018184360A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107241644B (zh) * 2017-05-31 2018-09-07 腾讯科技（深圳）有限公司 一种视频直播过程中的图像处理方法和装置
CN114125020B (zh) * 2020-09-11 2023-08-29 京东方科技集团股份有限公司 实时数据通信的方法、电子设备和系统
CN112308864B (zh) * 2020-10-27 2025-01-03 北京达佳互联信息技术有限公司 一种图像处理方法、装置、电子设备及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030204849A1 (en) * 2002-04-24 2003-10-30 Mikio Watanabe Image server and image display system
CN101938653A (zh) * 2010-08-17 2011-01-05 深圳市同洲电子股份有限公司 实时获取电视画面并传送至移动终端的方法、装置及系统
CN102012919A (zh) * 2010-11-26 2011-04-13 深圳市同洲电子股份有限公司 电视截屏图像关联搜索方法、装置及数字电视终端
CN103338405A (zh) * 2013-06-03 2013-10-02 四川长虹电器股份有限公司 一种截屏应用的方法、设备及系统
CN104699800A (zh) * 2015-03-19 2015-06-10 深圳市米家互动网络有限公司 画面信息搜索方法和系统、遥控器和显示终端

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090091629A1 (en) * 2007-10-03 2009-04-09 Casey Robert J TV/Movie actor identifcation device
US8266665B2 (en) * 2008-03-25 2012-09-11 Verizon Patent And Licensing Inc. TV screen capture
US20140177964A1 (en) * 2008-08-27 2014-06-26 Unicorn Media, Inc. Video image search
US20100095326A1 (en) * 2008-10-15 2010-04-15 Robertson Iii Edward L Program content tagging system
US8705933B2 (en) * 2009-09-25 2014-04-22 Sony Corporation Video bookmarking
KR20120063886A (ko) * 2010-12-08 2012-06-18 삼성전자주식회사 영상처리장치, 사용자 단말장치 및 그 영상처리방법, 제어방법
KR102180473B1 (ko) * 2013-11-05 2020-11-19 삼성전자주식회사 디스플레이 장치 및 그 디스플레이 장치의 제어 방법
US10002191B2 (en) * 2013-12-31 2018-06-19 Google Llc Methods, systems, and media for generating search results based on contextual information

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030204849A1 (en) * 2002-04-24 2003-10-30 Mikio Watanabe Image server and image display system
CN101938653A (zh) * 2010-08-17 2011-01-05 深圳市同洲电子股份有限公司 实时获取电视画面并传送至移动终端的方法、装置及系统
CN102012919A (zh) * 2010-11-26 2011-04-13 深圳市同洲电子股份有限公司 电视截屏图像关联搜索方法、装置及数字电视终端
CN103338405A (zh) * 2013-06-03 2013-10-02 四川长虹电器股份有限公司 一种截屏应用的方法、设备及系统
CN104699800A (zh) * 2015-03-19 2015-06-10 深圳市米家互动网络有限公司 画面信息搜索方法和系统、遥控器和显示终端

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3609186A4 *

Also Published As

Publication number Publication date
EP3609186A4 (en) 2020-09-09
EP3609186A1 (en) 2020-02-12
US20190124398A1 (en) 2019-04-25
CN108696760A (zh) 2018-10-23

Similar Documents

Publication Publication Date Title
US10254936B2 (en) Devices and methods to receive input at a first device and present output in response on a second device different from the first device
US9282167B2 (en) Display device and control method thereof
JP2019092147A (ja) 情報交換方法、装置、オーディオ端末及びコンピュータ可読記憶媒体
US11075976B2 (en) Remoting application user interfaces
US20180020252A1 (en) Information display method, channel management platform, and terminal
US10789033B2 (en) System and method for providing widget
JP2023503438A (ja) オンラインドキュメントのコメントに基づくフィードバック方法、装置、機器および記憶媒体
US20140324623A1 (en) Display apparatus for providing recommendation information and method thereof
US20160248838A1 (en) Remoting An Application User Interface From A User Device to Another Display
CN117009691A (zh) 信息展示方法、装置、电子设备及存储介质
WO2022156606A1 (zh) 信息处理方法、装置及电子设备
WO2018184360A1 (zh) 一种信息获取、信息提供方法及相关装置
WO2023134756A1 (zh) 对象推荐方法、装置和电子设备
WO2017113855A1 (zh) 应用程序交互的方法和终端
CN116893792A (zh) 投屏控制方法、装置及电子设备
US20190052745A1 (en) Method For Presenting An Interface Of A Remote Controller In A Mobile Device
JP6445050B2 (ja) クラウドストリーミングサービス提供方法、そのための装置及びシステム、並びにそのためのクラウドストリーミング用スクリプトコードを記録したコンピュータ読み取り可能な記録媒体
WO2019119643A1 (zh) 移动直播的互动终端、方法及计算机可读存储介质
CN107798714A (zh) 一种图像数据显示方法和相关装置以及计算机存储介质
JP2015162040A (ja) 電子機器
WO2025086965A1 (zh) 直播方法、直播装置、电子设备和计算机可读介质
US20190132398A1 (en) Networked User Interface Back Channel Discovery Via Wired Video Connection
WO2016095449A1 (zh) 一种虚拟桌面的显示方法、终端和存储介质
US11855838B1 (en) Multi-device interface application
US11537824B2 (en) Categorization of photographs

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17854183

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2017854183

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2017854183

Country of ref document: EP

Effective date: 20191107