CN103369049B - Mobile terminal and server exchange method and system thereof - Google Patents
Mobile terminal and server exchange method and system thereof Download PDFInfo
- Publication number
- CN103369049B CN103369049B CN201310307727.XA CN201310307727A CN103369049B CN 103369049 B CN103369049 B CN 103369049B CN 201310307727 A CN201310307727 A CN 201310307727A CN 103369049 B CN103369049 B CN 103369049B
- Authority
- CN
- China
- Prior art keywords
- mobile terminal
- server
- image
- retrieval
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 230000004044 response Effects 0.000 claims abstract description 14
- 238000004891 communication Methods 0.000 claims description 22
- 230000003993 interaction Effects 0.000 claims description 9
- 230000003068 static effect Effects 0.000 claims description 6
- 230000002452 interceptive effect Effects 0.000 abstract description 10
- 238000005516 engineering process Methods 0.000 description 13
- 239000000284 extract Substances 0.000 description 8
- 230000006870 function Effects 0.000 description 8
- 239000003054 catalyst Substances 0.000 description 6
- 230000007547 defect Effects 0.000 description 6
- 230000008901 benefit Effects 0.000 description 4
- 238000011161 development Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 235000013399 edible fruits Nutrition 0.000 description 3
- 244000097202 Rathbunia alamosensis Species 0.000 description 2
- 235000009776 Rathbunia alamosensis Nutrition 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000007429 general method Methods 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
Landscapes
- Information Transfer Between Computers (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a kind of mobile terminal and server exchange method, comprise: step 100, acquisition for mobile terminal still image; Step 200, mobile terminal carries out pretreatment to still image, obtains preprocessed data; Step 300, preprocessed data is sent to server by mobile terminal; Step 400, server is resolved preprocessed data, obtains resolution data; Step 500, server is retrieved relative result for retrieval in database according to resolution data; Step 600, server is to mobile terminal feedback searching result; Step 700 shows result for retrieval on mobile terminal; Step 800, in the time that user confirms and selects result for retrieval on mobile terminal, mobile terminal sends request information to server, and described information comprises the identifying information corresponding with the result for retrieval of selecting; Step 900, server response request message, sends further information to mobile terminal. The present invention also provides the mobile terminal and the server interactive system that realize said method.
Description
Technical field
The present invention relates to the communications field, particularly there is the mutual side between mobile terminal and the server of shoot functionMethod and system.
Background technology
Along with the development of computer and the communication technology, there is terminal more and more universal of shoot function. By endThe shoot function of end, people can realize with real world and more interacting. Such as application number 03112831.9 public affairsTerminal and server interaction are provided in the number of opening CN1482567A " Taxi camera shooting insurance method and system thereof "Method and system. Wherein, allow taxi driver utilize camera function by suspect's image taking and be uploaded toServer, the taxi case taking place frequently with convenient detection. But the defect of this scheme is to be applied in taxiOn shooting safety system, can not be applied in such as the mobile terminal such as mobile phone, panel computer. In addition, it can only be figurePicture take after upload onto the server, can not intervene real world, therefore for object very limited, a pinTo suspect, user (taxi driver) cannot realize more mutual by this function with real world.
Along with the development of mobile terminal technology, the technology of utilizing mobile terminal to carry out identification world continues to bring out. Such asApplication number 200310121279.0 publication number CN1630302A " can automatic input word, the mobile phone of image andTyping and processing method ". It discloses a kind of method: user can take business card by mobile phone and realize extraction typing nameThe work of sheet information, for user has saved the time cost of manual typing card information. Application number for another example200420097921.6 publication number CN2745280Y " can do the camera mobile phone of character translation " discloses a kind of method:It allows user by mobile phone photographic images, then extracts the Word message in the middle of image by identification module, then passes throughUser is translated and be shown to the translation module of embedded in mobile phone to the Word message extracting. But these two kinds of methods have oneIndividual common deficiency: because not and server generation reciprocation, mobile phone can only extract to be taken in the middle of gained imageWord message through existing or be pre-stored in the information of mobile phone this locality, therefore feedack is very limited, the reality of informationEffect property is also poor.
Along with the development of internet, this class defect is progressively resolved. Increasing technology allows mobileTerminal is sent to server the picture of gained of taking pictures and analyzes coupling, then by server feedback to a large amount of letter of userBreath. Such as " the network audio VOD system and obtaining of application number 200910237452.0 publication number CN102055758AGet the method for network audio " a kind of method disclosed: user can identify by wireless program request pen that to be printed on books and periodicals assortedCoding in will, to obtain the network information identification code wherein comprising, is then sent to the webserver identification code,By server, obtained result is sent to user again. This just can cannot provide for reader provides books itselfInformation---music. But the inconvenience of this technology is also very obvious, the first, it needs publisher to print in advanceThe corresponding coding of brush, the second, need to be the hardware device of the independent configure dedicated of user--wireless program request pen.
And the mobile terminal (especially intelligent mobile terminal) that has a shoot function due to mobile phone, panel computer etc. is by wideGeneral use, increasing people starts to develop corresponding technology on mobile phone, like this without for user but join configure dedicatedHardware device.
Such as application number 200810033287.2 publication number CN101226591A " based on mobile phone camera in conjunction with peopleThe personal identification method of face recognition technology " a kind of method is disclosed: it allows mobile phone camera to gather the figure of human face photoPicture information, then this information is sent to server carries out identification, and then information the highest matching degree is sent to mobile phoneThe user of end. Speed and the accuracy of identification are so just greatly improved. Just, this application only limits to faceIdentification, does not have purposes very widely.
Such as application number 200510028959.7 publication number CN1916932A " one utilize image analysis technology knowThe device and method of other product " a kind of method of identifying product is disclosed: with mobile phone photograph, then will take the photograph of gainedSheet is issued server with the form of " multimedia message ", then sends corresponding data to mobile phone by server. This inventionAdvantage is that camera terminal has been locked on mobile phone, and shortcoming is to send on server with the form of " multimedia message ",And " multimedia message " write and send the operation that needs user extra, reduced user's experience.
The problem that user experiences is along with the development of wireless Internet is progressively resolved. Now, Wireless Data TransmissionCost more and more lower, transmission speed is more and more faster. Therefore, increasing technology is all based upon Wireless Data TransmissionBasis on. Strengthen by thering is shoot function that reality is known to method for distinguishing is also more and more, such as bar code,Quick Response Code, digital watermarking, embedded mark etc. By these modes, mobile terminal can be identified picture, andTo carry out secondary mutual with user.
At present, be to utilize mobile scanning terminal bar code and Quick Response Code for the most general method of recognition value. Such as Shen" mobile terminal and server exchange method and system thereof " that please number 200510033918.7 publication number CN1841425A," realize information based on mobile terminal capable of taking pictures such as application number 200610157181.4 publication number CN1988703AThe method of interactive operation ", such as " passing through of application number 200810009436.1 publication number CN101241557AThe mobile information acquisition of wireless network ". These inventions are all by scanning Quick Response Code or bar code, obtain in advance and depositThe information of storage in the middle of coding. But their defect is also very obvious: Quick Response Code and bar code are on imageOccur, destroyed the globality of original image. Meanwhile, the appearance of Quick Response Code and bar code, also existence is printed in advanceProblem.
In order to keep the globality of original image, digital watermark technology is a huge improvement. Unlike bar code and twoDimension code, it is almost transparent, thereby does not disturb the content of file and picture. Therefore, application number 201010591230.1Publication number CN102110235A " embedded media marker character and generation and use its system and method " disclosesAnother method: by the document piece that has EMM to indicate is taken pictures, thereby realize mobile terminal to documentIdentification. Although but this method has ensured the integrality of image, its defect is also very obvious: its requirementThe picture producer and printer carry out pretreatment to picture, need to print in advance digital watermarking.
So, there are now a lot of technology of image being carried out to Direct Recognition. Such as application number 201010151399.5Publication No. CN102238466A " a kind of cell phone system of mobile augmented reality " discloses a kind of method: this system permitsAfter mobile phone photographic images is passed through at family allowable, then the image of taking gained is sent to together with user's geographical coordinateOn server. Server is by the search of user coordinates is mated to corresponding picture, then feeds back corresponding information. ThisThe advantage of the system of kind is not need image itself carry out pretreatment or print in advance, but shortcoming is also clearly: becauseMain is quantitatively geographical coordinate, and therefore, the captured picture of user is irremovable in a short time, so only limit to guideboardThe fields such as advertisement. For transportable image (such as books, magazine) or the image downloaded from network, noThere is recognition capability.
Also someone discloses different image search engine technology. Such as application number 200810025589.5 publication numbers" based on the image search engine of picture material " of CN101329677A discloses a kind of method of picture search: usePicture and Word message can be inputted in family on computer or mobile phone, are then committed to server, server feedback knotAfter fruit, then carry out postsearch screening, this process is until obtain final satisfied result repeatedly. The advantage of this methodBe user's searching image anywhere, shortcoming is that it obtains pictorial information by shape and color, Bu NengzhenImage is identified. Require user to submit the word relevant with picture to simultaneously, but also need category filter repeatedly.
In sum, at least there is following defect in the interaction technique between terminal of the prior art and server:
1. pending image need to pass through after-treatment, for example, need to print additional in advance Quick Response Code, bar code or other spiesThe code of delimiting the organizational structure, or need to increase digital watermarking.
2. in some cases, image must be positioned at specific geographical position, and user is photographic images whenever and wherever possible.
3. in some cases,, after user has taken image, still need to use terminal to submit to server semantic and crucialWord is analyzed, and needs the additional information outside image.
4. image acquisition mode is loaded down with trivial details, and the step such as often need to take pictures, focus on, upload.
Summary of the invention
In view of this, the main object of the present invention is to provide a kind of mobile terminal and server exchange method and system thereof,To overcome above-mentioned defect of the prior art. The invention provides a kind of mobile terminal and server exchange method, compriseFollowing steps:
Step 100, described acquisition for mobile terminal still image;
Step 200, described mobile terminal carries out pretreatment to the still image obtaining, and obtains preprocessed data;
Step 300, preprocessed data is sent to server by described mobile terminal;
Step 400, described server is resolved preprocessed data, obtains resolution data;
Step 500, described server is retrieved the retrieval relevant to described still image in database according to resolution dataResult;
Step 600, described server feeds back described result for retrieval to mobile terminal;
Step 700 shows described result for retrieval on described mobile terminal;
Step 800, in the time that user confirms and selects one or more result for retrieval on described mobile terminal, described in moveMoving terminal to server sends request information, and described request information comprises the identification letter corresponding with the result for retrieval of selectingBreath;
Step 900, described server response described request information, sends further information to described mobile terminal.
The present invention also provides the mobile terminal and the server interactive system that realize said method.
The system and the method thereof that the invention provides a kind of new mobile terminal and server interaction have the following advantages:
1. image does not need through after-treatment, does not need to print additional Quick Response Code, bar code, does not need digital watermarking.
2. user's photographic images whenever and wherever possible.
3., after user has taken image, server can feed back to the information comprising in the middle of this image of user immediately.Do not need user to submit to semanteme and keyword to analyze.
4. user uses cost of the present invention very low.
5. image acquisition mode is simple, and once photo taking, without focusing, is uploaded automatically.
Brief description of the drawings
Fig. 1 is the structural representation of mobile terminal and server interactive system.
Fig. 2 is the schematic flow sheet of mobile terminal and server exchange method.
Detailed description of the invention
For making the object, technical solutions and advantages of the present invention clearer, in connection with accompanying drawing, the present invention is done furtherDescribe in detail. This description is that unrestriced mode has been introduced consistent with principle of the present invention concrete by exampleEmbodiment, the description of these embodiments is enough detailed, to make those skilled in the art can put into practice thisBright, can use without departing from the scope and spirit of the present invention other embodiments and can change and/orReplace the structure of each key element. Therefore, should not understand the following detailed description from restrictive, sense.
Fig. 1 is the structural representation of mobile terminal and server interactive system. As shown in Figure 1, the movement in the present inventionTerminal and server interactive system mainly comprise mobile terminal 10, server 20. Wherein, the mobile terminal in the present invention10 include but not limited to following equipment: mobile phone (also referred to as cell phone, mobile phone etc.), especially smart mobile phone,The iPhone Series Intelligent mobile phone that iOS series operating system is installed of for example Apple, Google is installedThe smart mobile phone of Android series operating system, the intelligent hand of the Windows of Microsoft series operating system is installedMachine and smart mobile phone of other any operating systems etc. is installed; Panel computer, the iPad series of for example ApplePanel computer, be provided with the Android of Google series operating system panel computer, Microsoft is installedThe panel computer of Windows series operating system and the panel computer etc. of other any operating systems is installed; IndividualDigital assistants (being called for short PDA); And any mobile electronic device of knowing of other those skilled in the art. The present inventionIn server 20 include but not limited to following equipment: IBM server catalyst Catalyst, Dell server catalyst Catalyst, HP seriesServer, Sun server catalyst Catalyst, association series server, and any clothes of knowing of other those skilled in the artBusiness device.
In the present invention, mobile terminal 10 further comprises acquiring unit 11, image pretreatment unit 12, the first communicationUnit 13, display unit 14 and selected cell 15.
Wherein, described acquiring unit 11, for obtaining still image. Acquiring unit 11 can connect from mobile terminal 10" multimedia message " of receiving extracts still image automatically, or in " multimedia message ", specifies still image by user; Obtain listUnit's 11 document (for example video documents, the Emails that can also browse or watch from user by the mode of screenshotssDocument, electronic publication document or other any documents that may comprise image) in obtain still image; Acquiring unit 11Can also download still image from internet by wired or wireless network; Preferably, acquiring unit 11 is eventually mobileEnd 10 cameras that carry or with the interconnective camera of mobile terminal 10, by take form obtain static mapPicture, for example, obtain photo as still image to the shooting of any print medias such as magazine. When take figure by cameraAfter picture, can, by the mode of menu setecting, the image of taking be carried out pretreatment and be uploaded onto the server.
Described image pretreatment unit 12, for still image is carried out to pretreatment, obtains preprocessed data, pretreatmentData are the data with predefined data structure. Such as the communication data amount for minimizing and server, can adopt pressureThe image JPG form contracting. In order to guarantee data security, also general picture format can be transformed into some oneselfProprietary file format; Or by the mode of encrypting, after secret key encryption, then send to server. In addition,Image pretreatment unit 12 is selectable units, also can not carry out pretreatment and directly send to server still image,In this case, those skilled in the art should be understood that pretreatment is a kind of do-nothing operation.
The first communication unit 13, for communicating with server. For example, mobile terminal 10 can be logical by firstPreprocessed data is sent to server 20 by letter unit 13; Mobile terminal 10 can also pass through the first communication unit 13Solicited message is sent to server 20. For another example, mobile terminal 10 can be by the first communication unit 13 from server20 receive result for retrieval; Mobile terminal 10 can also receive further from server 20 by the first communication unit 13Information. Preferably, the communication between the first communication unit 13 and server 20 adopts the mode of wireless network, such asGPRS etc. Preferred, when WIFI or bluetooth or other local networks exist in situation, preferentially adopt local networkCommunicate.
Display unit 14, for demonstration information on described mobile terminal 10, for example, display server 20 feeds backResult for retrieval. When demonstration, display unit 14 can be with thumbnail, text box, dialog box, radio box, final electionFrame, video, the forms such as audio frequency or waterfall stream show, any demonstration that can also know with those skilled in the artMode shows.
Selected cell 15, for confirming solicited message with user orientation server 20. , user can pass through selected cell15 confirm and select one or more result for retrieval on described mobile terminal 10. After this, mobile terminal 10 is to serviceDevice sends request information, and described request information comprises the identifying information corresponding with the result for retrieval of selecting.
In the present invention, server 20 further comprises:
Second communication unit 21, for communicating with mobile terminal 10. For example, server 20 can be by secondCommunication unit 21 receives preprocessed data from mobile terminal 10; Server 20 can also pass through second communication unit 21Receive solicited message from mobile terminal 10. For another example, server 20 can be by second communication unit 21 by result for retrievalSend to mobile terminal 10; Server 20 can also send to movement by further information by second communication unit 21Terminal 10. Preferably, the communication between second communication unit 13 and mobile terminal 20 adopts the mode of wireless network,Such as GPRS etc. Preferred, when WIFI or bluetooth or other local networks exist in situation, preferentially adopt thisZone network communicates
In a preferred embodiment, the communication between server 20 and mobile terminal 10 can be thought the first communication unit13 and second communication unit 21 between communication.
Resolution unit 22, for preprocessed data is resolved, obtains resolution data. For example,, by static mapPicture or the identification of preprocessed data, obtain and the resolution data of original static image correlation, and resolution data comprises followingThe combination of one characteristics of image or arbitrary image feature: SIFT feature, color character, unity and coherence in writing feature, shape facility etc.;Resolution data can also comprise by OCR and obtains the text message in image.
Database 23, for storing the information being associated with described still image. In database 23, canned data canTo include, but are not limited to following arbitrary characteristics of image or arbitrary image Feature Combination: the memory address of original image, SIFTFeature, color character, unity and coherence in writing feature, shape facility etc. Database 23 is for example MySQL, SQLServer,ORACLE, Sybase, DB2 etc. can be also the data that those skilled in the art configure voluntarily according to prior artStorehouse can be still the structured document of plain text. The type of database can be that relationship type can be also non-relationalDatabase. In the present embodiment, database 23 is included in server 20. In another embodiment, database 23Can be independent of server 20 and exist, in this case, server 20 is connected to number by wired or wireless modeAccording to storehouse 23.
The inspection relevant to described still image retrieved in database retrieval unit 24 in database 23 according to resolution dataHitch fruit.
Can combining image feature (SIFT feature, color character, unity and coherence in writing feature, in shape facility arbitrary or any groupClose) and text feature, or merely by characteristics of image, or merely by text feature, retrieve.
Be retrieved as example with SIFT feature, can first deliver to server at server 20 handle mobile terminals 1020 still image extracts SIFT feature, then by the SIFT feature of extracting and pre-stored at database 23The SFIT Characteristic Contrast of other image, and then obtain corresponding result for retrieval. When retrieval, can come by B-treeFast finding, also can search by Hash mode.. In the time that data volume is large, can also be by distributedMode improves search efficiency.
Those skilled in the art should know, and use the mode of further feature and any combination thereof also in protection of the present inventionWithin scope. For example, due to the information (spy of still image that pre-stored still image is associated in database 23Levy), therefore still image does not need through after-treatment, for example, do not need to print additional Quick Response Code, bar code, does not need numberWord watermark.
Interaction success feedback unit 25, the solicited message that sends of response mobile terminal 10, to mobile terminal 10 send intoOne step information.
Fig. 2 is the schematic flow sheet of mobile terminal 10 of the present invention and server 20 exchange methods. As shown in Figure 2,Method of the present invention mainly comprises the following steps:
Step 100, obtains still image by mobile terminal 10. Mobile terminal 10 can be from " multimedia message " receivingAutomatically extract still image, or in " multimedia message ", specified still image by user; Mobile terminal 10 can also pass throughDocument (for example video documents, email documents, electronic publication that the mode of screenshotss is being browsed or watched from userDocument or other any documents that may comprise image) in obtain still image; Mobile terminal 10 can also be by wiredOr wireless network is downloaded still image from internet; Preferably, mobile terminal 10 use carry or interconnection mutually with itThe camera connecing, obtains still image by the form of taking, for example, the shooting of the print medias such as magazine is obtained to photoAs still image.
Step 200, mobile terminal 10 carries out pretreatment to the still image obtaining, and obtains preprocessed data. PretreatmentData are the data with predefined data structure. Such as the communication data amount for minimizing and server, can adopt pressureThe image JPG form contracting. In order to guarantee data security, also general picture format can be transformed into some oneselfProprietary file format; Or by the mode of encrypting, after secret key encryption, then send to server. In addition,Step 200 is optional steps, also can not carry out pretreatment and directly send to server, this feelings still imageUnder condition, those skilled in the art should be understood that pretreatment is a kind of do-nothing operation.
Step 300, preprocessed data is sent to server 20 by mobile terminal 10.
Preferably, in the time using camera photographic images, user only need to click the hardware button of shooting or be presented on tactileTouch the touch controlled key of screen, mobile terminal 10 completes focusing, shooting, the optional pretreatment to still image automatically,And will send to server through pretreated image.
Step 400, server 20 is resolved preprocessed data, obtains resolution data. For example,, by static stateThe identification of image or preprocessed data, obtains and the resolution data of original static image correlation, and resolution data comprises followingThe combination of arbitrary characteristics of image or arbitrary image feature: SIFT feature, color character, unity and coherence in writing feature, shape facility etc.Deng; Resolution data can also comprise by OCR and obtains the text message in image.
Step 500, server 20 is retrieved the inspection relevant to described still image in database 23 according to resolution dataHitch fruit. Wherein, database 23, for storing the information being associated with described still image, comprises depositing of original imageStorage address and arbitrary characteristics of image of following information or the combination of arbitrary image feature: SIFT feature, color character, literary compositionReason feature, shape facility etc., even also comprises the text message in image. Database 23 is for example MySQL, SQLServer, ORACLE, Sybase, DB2 etc. can be also that those skilled in the art configure voluntarily according to prior artDatabase, can also be the structured document of plain text. The type of database can be that relationship type can be also non-passIt is type database. In the present embodiment, database 23 is included in server 20. In another embodiment, dataStorehouse 23 can be independent of server 20 and exist, and in this case, server 20 connects by wired or wireless modeTo database 23.
Can combining image feature (SIFT feature, color character, unity and coherence in writing feature, in shape facility arbitrary or any groupClose) and text feature, or merely by characteristics of image, or merely by text feature, retrieve.
Be retrieved as example with SIFT feature, can first deliver to server at server 20 handle mobile terminals 1020 still image extracts SIFT feature, then by the SIFT feature of extracting and pre-stored at database 23The SFIT Characteristic Contrast of other image, and then obtain corresponding result for retrieval. When retrieval, can come by B-treeFast finding, also can search by Hash mode.. In the time that data volume is large, can also be by distributedMode improves search efficiency.
Those skilled in the art should know, and use the mode of further feature and any combination thereof also in protection of the present inventionWithin scope. For example, due to the information (spy of still image that pre-stored still image is associated in database 23Levy), therefore still image does not need through after-treatment, for example, do not need to print additional Quick Response Code, bar code, does not need numberWord watermark.
Step 600, server 20 feeds back described result for retrieval to mobile terminal 10.
Step 700 shows described result for retrieval on mobile terminal 10. When demonstration, can be with thumbnail, literary compositionThis frame, dialog box, radio box, check box, video, the forms such as audio frequency or waterfall stream show, can also be with thisAny display mode that those skilled in the art know shows.
Step 800, in the time that user confirms and selects one or more result for retrieval on mobile terminal 10, described movementTerminal 10 sends request information to server 20, and described request information comprises the knowledge corresponding with the result for retrieval of selectingOther information.
Step 900, server 20 responds described request information, sends further information to described mobile terminal 10.Described further information generally includes the content information with result for retrieval height correlation. Further information can also comprise pointEnjoy, buy, video, the relevant information such as voice, like, collection. To share as example, when user selects to share button,Where mobile terminal 10 can inquiry users be wanted to share, such as Sina's microblogging, Tengxun's microblogging, everybody, in the school, happilyEtc.. After user further selects, such as Sina's microblogging is shared, mobile terminal 10 can allow subscriber authorisation and passing throughUser's microblogging account number sends an information, simultaneously notice (such as) he good friend he using corresponding application.
Multiple environment or field can be applied or be combined in to mobile terminal of the present invention and server interactive system and method thereofIn.
In a preferred embodiment of the invention, mobile terminal of the present invention and server interactive system and method thereof canTo be applied in the environment of retrieving and buy commodity.
In this environment, user can, by the camera of mobile terminal, take the image that contains the interested commodity of user,For example image is coloured picture or the advertisement figure of some magazine, or all exist any image on print media. For example,Take the front cover coloured picture of certain magazine, on this coloured picture, comprise a BMW and a cap. Subsequently, mobile terminalSelectable the image photographing is carried out to pretreatment, and pretreated data are sent to server. Server pairPreprocessed data is resolved, and pre-stored characteristics of image in server database contrasts, thus retrievalGo out user and upload the merchandise news comprising in image as result for retrieval. For example, two kinds of BMWs that front cover coloured picture comprisesThese two kinds of commodity of automobile and cap.
Mode and the method for retrieval can be also multiple. Taking SIFT signature search as example, can be first every magazineOne page is stored in the database of server and extracts the SIFT feature of every one page, then extracts eventually mobile at serverEnd is delivered to the SIFT of the image of server. Afterwards by the SIFT feature of extracting and pre-stored server end notThe SFIT feature of image contrast. The result of retrieval is to find out which of which which magazine this pictures is phaseOne page, returns to that one page magazine or advertiser or Information Provider according to the requirement of magazine afterwards and wishes to carry to userThe corresponding merchandise news of confession.
Described merchandise news includes but not limited in the price, title, stock, specification, manufacturer's information of commodityA certain or a few or all. Subsequently, server sends the merchandise news retrieving to mobile terminal, andOn mobile terminal, be shown to user. User can browse these commodity and merchandise news by mobile terminal, and therefrom choosingSelect the commodity that oneself need. For example, user can select to return in the commodity of its mobile terminal by the mode of single choiceOne, such as cap, mobile terminal can further show the price of this cap, supplier, designer's backgroundKnowledge etc. For another example user can by the mode of single choice or final election select to return in the information of its mobile terminal one orMultiple, such as history and the price of BMW, system can further show developing history and the different money of BMWDifferent prices of formula etc. In the time that user determines the commodity of wanting purchase, send and buy by mobile terminal phase serverPayment request information, server passes through Mobile banking, of all categories the moving such as mobile-phone payment or mobile phone wallet after identificationThe moving means of payment completes payment, sends to user's mobile terminal the interaction success information (being further information) that pays. ByThis, the present invention has been completed the retrieval to physical goods and has been bought function by mobile terminal, server.
In another preferred embodiment of the present invention, mobile terminal of the present invention and server interactive system and method thereofCan apply in the environment of video frequency searching.
In this environment, user can, by the camera of mobile terminal, take the image in papery or video placard,Or in browsing page, by the video interception on web page acquisition by mobile terminal or video image. Subsequently, moveMoving terminal is carried out pretreatment to image, and pretreated data are sent to server. Server is to preprocessed dataResolve, in database, retrieve the video information with image correlation. Subsequently, server is by the video retrievingInformation sends mobile terminal to, and is shown to user on mobile terminal, is which electricity such as what judge user's shootingThe placard of shadow, returns corresponding film clips information afterwards. Video information may include but not limited to: video name, breviaryFigure, definition, playout length, video-on-demand times etc. User can browse these video informations by mobile terminal, andAccording to mobile terminal, in software and hardware situation, the video of watching is wished in selection. In the time that user determines the video of wanting to watch,Send video request information by mobile terminal phase server, server, after identification, is sent out to user's mobile terminalSend interaction success information. Meanwhile, server is to user's mobile terminal transmission of video.
Thus, the present invention has completed retrieval and the viewing function to video by mobile terminal, server.
In a preferred embodiment of the invention, mobile terminal of the present invention and server interactive system and method thereof canTo be applied in the environment of retrieval and positioning electronic map.
In this environment, user can, by the camera of mobile terminal, take on-site landmark or tripThe papery simple map at trip scenic spot. Subsequently, mobile terminal carries out pretreatment to image, and pretreated data are sent outDeliver to server. Server is resolved preprocessed data, retrieves the map letter with image correlation in databaseBreath. Subsequently, server sends the cartographic information retrieving to mobile terminal, and is shown to user on mobile terminal.Cartographic information may include but not limited to: corresponding retail shop Business Information etc. on particular location, thumbnail and map.User can browse these cartographic informations by mobile terminal, and selects the electronic chart of wishing. When determining, user wantsElectronic chart time, send electronic chart solicited message by mobile terminal phase server, server after identification,Mobile terminal to user sends interaction success information. Meanwhile, server is selected to user's mobile terminal transmission userElectronic chart.
Thus, the present invention has completed the navigation feature to electronic chart by mobile terminal, server.
Finally, those skilled in the art be to be understood that the system and method that the present invention describes be not inherently with any spyDetermine device relevant but can realize by the combination of any suitable assembly. In addition can describe according to the present invention,Instruction use various types of fexible units, can also construct special purpose device to carry out method step described herein.The present invention has also described some middle detailed description of the invention and/or embodiment, and from any aspect, its object is all illustrativeInstead of restrictive. It will be appreciated by those skilled in the art that, hardware, software and firmware many not on the same groupClose and be all suitable for putting into practice the present invention. For example, described software can be realized with various different programmings or descriptive language, for example,Assembler, C/C++, Perl, Shell, PHP, Java etc.
In addition,, according to disclosed description of the present invention, other realizations of the present invention for those skilled in the art areSignificantly. The various aspects of described embodiment and/or embodiment can separately or be used for of the present invention with any combinationIn system and method. Description and example wherein should be only regard as exemplary, actual range of the present invention and essenceGod is represented by appended claims.
Claims (1)
1. mobile terminal and a server exchange method, is characterized in that,
Described mobile terminal comprises:
Acquiring unit, for obtaining still image;
Image pretreatment unit, for still image is carried out to pretreatment, obtains preprocessed data;
The first communication unit, for communicating with server;
Display unit, for demonstration information on described mobile terminal;
Selected cell, for confirming solicited message with user orientation server;
Described server comprises:
Second communication unit, for communicating with mobile terminal;
Resolution unit, for preprocessed data is resolved, obtains resolution data;
Database, for storing the information being associated with described still image;
The retrieval knot relevant to described still image retrieved in database retrieval unit in database according to resolution dataReally;
Interaction success feedback unit, response described request information, sends further information to described mobile terminal;
Described method comprises following steps:
Step 100, described acquisition for mobile terminal still image;
Step 200, described mobile terminal carries out pretreatment to the still image obtaining, and obtains preprocessed data;
Step 300, preprocessed data is sent to server by described mobile terminal;
Step 400, described server is resolved preprocessed data, obtains resolution data;
Step 500, described server is retrieved the retrieval relevant to described still image in database according to resolution dataResult;
Step 600, described server feeds back described result for retrieval to mobile terminal;
Step 700 shows described result for retrieval on described mobile terminal;
Step 800, in the time that user confirms and selects one or more result for retrieval on described mobile terminal, described in moveMoving terminal to server sends request information, and described request information comprises the knowledge corresponding with the result for retrieval of selectingOther information;
Step 900, described server response described request information, sends further information to described mobile terminal; InstituteState further information and comprise interaction success information;
Wherein, described mobile terminal further comprises camera, touch-screen, hardware button or be presented on touch-screen touchControl button, in the time using camera photographic images, user only need to click the hardware button of shooting or be presented on tactileTouch the touch controlled key of screen, mobile terminal completes focusing, shooting, the pretreatment to still image automatically, and willSend to server through pretreated image;
Wherein said resolution data comprises following arbitrary characteristics of image of described still image or the group of arbitrary image featureClose: SIFT feature, color character, unity and coherence in writing feature, shape facility; In described database, store described static stateImage following characteristics: the memory address of original image, SIFT feature, color character, unity and coherence in writing feature, shapeFeature; The characteristics of image that the characteristics of image of storing in described database and described resolution data comprise is in type oneCause;
And wherein in step 700, with thumbnail, text box, dialog box, radio box, check box, video, audio frequencyOr the streamed demonstration result for retrieval of waterfall.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310307727.XA CN103369049B (en) | 2013-07-22 | 2013-07-22 | Mobile terminal and server exchange method and system thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310307727.XA CN103369049B (en) | 2013-07-22 | 2013-07-22 | Mobile terminal and server exchange method and system thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103369049A CN103369049A (en) | 2013-10-23 |
| CN103369049B true CN103369049B (en) | 2016-05-04 |
Family
ID=49369570
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310307727.XA Expired - Fee Related CN103369049B (en) | 2013-07-22 | 2013-07-22 | Mobile terminal and server exchange method and system thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103369049B (en) |
Families Citing this family (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104580121B (en) * | 2013-10-28 | 2019-03-15 | 腾讯科技（深圳）有限公司 | Missing/personal information matching push method, system, client and server |
| CN104867097A (en) * | 2014-02-26 | 2015-08-26 | 腾讯科技（深圳）有限公司 | Method and device for generating watermark picture |
| CN104616167A (en) * | 2014-12-19 | 2015-05-13 | 百度在线网络技术（北京）有限公司 | Method and device for providing through service at user equipment and network equipment |
| CN104574156B (en) * | 2015-01-26 | 2018-03-23 | 网易有道信息技术（北京）有限公司 | A kind of commodity extension information matches, acquisition methods and device |
| CN104598902A (en) * | 2015-01-29 | 2015-05-06 | 百度在线网络技术（北京）有限公司 | Method and device for identifying screenshot and browser |
| CN104618741A (en) * | 2015-03-02 | 2015-05-13 | 浪潮软件集团有限公司 | Information pushing system and method based on video content |
| CN104765886A (en) | 2015-04-29 | 2015-07-08 | 百度在线网络技术（北京）有限公司 | Information acquisition method and device based on images |
| CN106407984B (en) * | 2015-07-31 | 2020-09-11 | 腾讯科技（深圳）有限公司 | Target object identification method and device |
| CN105303217B (en) * | 2015-10-13 | 2018-12-18 | 北京工业大学 | A kind of efficient implicit 2 D code system |
| CN106598980B (en) * | 2015-10-16 | 2020-03-10 | 阿里巴巴集团控股有限公司 | Information pushing method and device |
| CN105491418A (en) * | 2015-11-30 | 2016-04-13 | 上海联彤网络通讯技术有限公司 | Remote control device and method, electronic device |
| CN105808667A (en) * | 2016-02-29 | 2016-07-27 | 北京小米移动软件有限公司 | Image acquisition method, apparatus and system |
| CN105893519A (en) * | 2016-03-30 | 2016-08-24 | 深圳市讯联智付网络有限公司 | Analyzing device and method for online transactions, online transaction method and user terminal |
| CN106020662B (en) * | 2016-04-29 | 2019-04-30 | 广东小天才科技有限公司 | Content fast search method and device applied to mobile terminal |
| CN106126755A (en) * | 2016-08-24 | 2016-11-16 | 广东华邦云计算股份有限公司 | A kind of purchase method based on image recognition |
| CN116866827A (en) * | 2016-09-27 | 2023-10-10 | 华为技术有限公司 | Method and terminal for displaying current geographical location on emergency call interface |
| CN108154074A (en) * | 2016-12-02 | 2018-06-12 | 金德奎 | A kind of image matching method identified based on position and image |
| CN106407483A (en) * | 2016-12-07 | 2017-02-15 | 连惠城 | Electronic photo album with text search function |
| CN108845888A (en) * | 2018-05-24 | 2018-11-20 | 郑州云海信息技术有限公司 | A kind of method and system based on TensorFlow image recognition diagnosis memory failure |
| CN109146457A (en) * | 2018-08-01 | 2019-01-04 | 阿里巴巴集团控股有限公司 | Data input householder method and device |
| CN109168069A (en) * | 2018-09-03 | 2019-01-08 | 聚好看科技股份有限公司 | A kind of recognition result subregion display methods, device and smart television |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4413633B2 (en) * | 2004-01-29 | 2010-02-10 | 株式会社ゼータ・ブリッジ | Information search system, information search method, information search device, information search program, image recognition device, image recognition method and image recognition program, and sales system |
| US20110082735A1 (en) * | 2009-10-06 | 2011-04-07 | Qualcomm Incorporated | Systems and methods for merchandising transactions via image matching in a content delivery system |
| CN102063436A (en) * | 2009-11-18 | 2011-05-18 | 腾讯科技（深圳）有限公司 | System and method for realizing merchandise information searching by using terminal to acquire images |
| CN103067854A (en) * | 2011-10-21 | 2013-04-24 | 昆山研达电脑科技有限公司 | Mobile phone navigation method and mobile phone navigation method system based on terminal computing |
| CN102761612B (en) * | 2012-06-29 | 2016-08-03 | 惠州Tcl移动通信有限公司 | Take pictures based on wireless telecommunications system the method and system automatically uploaded |
-
2013
- 2013-07-22 CN CN201310307727.XA patent/CN103369049B/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN103369049A (en) | 2013-10-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103369049B (en) | Mobile terminal and server exchange method and system thereof | |
| JP5951759B2 (en) | Extended live view | |
| US20190235814A1 (en) | Building an infrastructure of actionable elements related to printed items | |
| US20200068132A1 (en) | Augmented reality recommendations | |
| US20140111542A1 (en) | Platform for recognising text using mobile devices with a built-in device video camera and automatically retrieving associated content based on the recognised text | |
| JP6272775B2 (en) | Method, client device, and server for accessing network information through graphic codes | |
| US8494589B2 (en) | Service discovery via mobile imaging systems and methods | |
| JP5395920B2 (en) | Search device, search method, search program, and computer-readable recording medium storing the program | |
| US20170169495A1 (en) | System and method for accessing electronic data via an image search engine | |
| JP2014241151A (en) | Use of image-derived information as search criteria for internet and other search engines | |
| JP2014524062A5 (en) | ||
| US10699315B2 (en) | Method and computer program for displaying search information | |
| WO2016033495A2 (en) | Methods and arrangements including data migration among computing platforms, e.g., through use of steganographic screen encoding | |
| CN104504155B (en) | A kind of data capture method and system based on picture search | |
| JP6609434B2 (en) | Product information providing system, product information providing method, and management server | |
| US20070182826A1 (en) | Data access, resolution, and delivery method through the use of multi-bit digital icons | |
| JP5233328B2 (en) | Advertisement display system using photo attribute information and advertisement display method using the system | |
| KR100750408B1 (en) | Service request method and device using multi-dimensional code | |
| AU2012205152B2 (en) | A platform for recognising text using mobile devices with a built-in device video camera and automatically retrieving associated content based on the recognised text | |
| JP6293100B2 (en) | Event information management device | |
| US9268464B1 (en) | Link determination and usage using image recognition | |
| TW201433997A (en) | Method of mobile E-commerce integrated with QR code | |
| KR20130129877A (en) | Payment system using 2 dimensional barcode code and method thereof | |
| US20170024786A1 (en) | Electronic Shopping System and Method for Facilitating the Purchase of Goods and Services of Others | |
| KR102103238B1 (en) | System and method for providing code-based price comparison information using association |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160504 Termination date: 20170722 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |