[go: up one dir, main page]

WO2017190360A1 - Système de détection médicale et son procédé de commande - Google Patents

Système de détection médicale et son procédé de commande Download PDF

Info

Publication number
WO2017190360A1
WO2017190360A1 PCT/CN2016/081338 CN2016081338W WO2017190360A1 WO 2017190360 A1 WO2017190360 A1 WO 2017190360A1 CN 2016081338 W CN2016081338 W CN 2016081338W WO 2017190360 A1 WO2017190360 A1 WO 2017190360A1
Authority
WO
WIPO (PCT)
Prior art keywords
moving contact
continuous moving
attribute information
display screen
touch display
Prior art date
Application number
PCT/CN2016/081338
Other languages
English (en)
Chinese (zh)
Inventor
刘智光
Original Assignee
深圳迈瑞生物医疗电子股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳迈瑞生物医疗电子股份有限公司 filed Critical 深圳迈瑞生物医疗电子股份有限公司
Priority to CN201680041178.8A priority Critical patent/CN107850832B/zh
Priority to PCT/CN2016/081338 priority patent/WO2017190360A1/fr
Publication of WO2017190360A1 publication Critical patent/WO2017190360A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03F—PHOTOMECHANICAL PRODUCTION OF TEXTURED OR PATTERNED SURFACES, e.g. FOR PRINTING, FOR PROCESSING OF SEMICONDUCTOR DEVICES; MATERIALS THEREFOR; ORIGINALS THEREFOR; APPARATUS SPECIALLY ADAPTED THEREFOR
    • G03F3/00—Colour separation; Correction of tonal value

Definitions

  • the present invention relates to a medical detection system with a touch display screen and a control method therefor.
  • an input device that is desired to be selected is sequentially selected by an input device such as a trackball or a mouse to perform multiple selection.
  • an input device such as a trackball or a mouse
  • the displayed list needs to be scrolled to display the remaining alternatives for the user to select.
  • the user's selection operation is more cumbersome.
  • the scrolling operation is typically used to scroll the list.
  • the user can only select the candidate items that are desired to be selected one by one. In this way, the user operation is very cumbersome, the workload is large, very inconvenient, and the user experience is poor.
  • a medical detection system includes:
  • a medical detecting device that detects a detection target to acquire medical detection data
  • the data processing module generating a plurality of candidate objects associated with the medical detection data or the medical detection device;
  • control module that displays the plurality of candidate objects on the touch display screen, detects a continuous moving contact of the input object with the touch display screen, and marks the associated moving contact in response to the continuous moving contact Attribute information corresponding to multiple candidate objects.
  • a method of controlling a medical detection system includes:
  • Attribute information corresponding to the plurality of candidate objects associated with the continuous moving contact is marked in response to the continuous moving contact.
  • a method of controlling a medical detection system includes:
  • a medical detection system includes:
  • a medical detecting device that detects a detection target to acquire medical detection data
  • the data processing module generating a list of information including a plurality of candidate objects associated with the medical detection data or the medical detection device;
  • a control module that displays a first portion of the list of information on a touch display screen, detects contact of the input object with the touch display screen, determines an operational position of the contact on the touch display screen, and when When the operating position is within the selected area on the touch display screen, the plurality of devices associated with the continuous moving contact in the first portion of the list of information are marked in response to the continuous moving contact of the input object within the selected area Selecting attribute information corresponding to the object, when the operation position is located in the scroll area on the touch display screen, moving the display displayed on the touch display screen in response to the movement of the contact of the input object in the scroll area
  • the list of information to display at least a portion of the remainder of the list of information other than the first portion.
  • FIG. 1 is a schematic diagram of a system architecture of an ultrasonic testing apparatus in accordance with some embodiments
  • FIG. 2 is a schematic diagram showing the display of a graphical user interface in accordance with some embodiments
  • FIG. 3 is a schematic diagram of a gesture operation according to some embodiments.
  • FIG. 4 is a flow chart providing a method in accordance with some embodiments.
  • FIG. 5 is a schematic illustration of an operation provided in accordance with some embodiments.
  • FIG. 6 is a schematic diagram showing another operation in accordance with some embodiments.
  • Figure 7 is a schematic diagram showing still another operation in accordance with some embodiments.
  • FIG. 8 is a schematic diagram of an operation for providing another gesture input in accordance with some embodiments.
  • FIG. 9 is a schematic diagram showing a selection operation of an alternative object arrangement manner according to some embodiments.
  • FIG. 10 is a schematic diagram showing a selection operation of another alternative object arrangement manner according to some embodiments.
  • FIG. 11 is a flowchart of a method of providing partial steps in accordance with some embodiments.
  • Figure 12 is a diagram showing one of the operational diagrams in accordance with some embodiments.
  • Figure 13 is a second schematic diagram showing the operation in accordance with some embodiments.
  • FIG. 14 is a schematic diagram showing a continuous operation under one gesture input in accordance with some embodiments.
  • 15 is a schematic diagram of continuous operation based on a single gesture input in a random arrangement, in accordance with some embodiments.
  • Figure 16 (a) is a schematic diagram showing an operational position in accordance with some embodiments
  • Figure 16 (b) is a second schematic diagram showing an operational position in accordance with some embodiments
  • Figure 16 (c) is provided a third schematic diagram of the operational position in accordance with some embodiments
  • 17 is a second schematic diagram of a continuous operation under one gesture input in accordance with some embodiments.
  • 18 is a third schematic diagram of a continuous operation under one gesture input in accordance with some embodiments.
  • 19 is a fourth schematic diagram of a continuous operation under one gesture input in accordance with some embodiments.
  • 20 is a fifth schematic diagram of a continuous operation under one gesture input in accordance with some embodiments.
  • 21 is a sixth schematic diagram of a continuous operation under one gesture input in accordance with some embodiments.
  • 22 is a seventh schematic diagram of a continuous operation under one gesture input in accordance with some embodiments.
  • 23 is a flow chart of a method of providing partial steps in accordance with some embodiments.
  • the device has a touch display screen with a graphical user interface (GUI), one or more processors, memory, and one or more modules stored in the memory for performing various functions, Program or instruction set.
  • these functions may include detecting a test subject (eg, a patient's tissue) to obtain medical test data, image browsing, pathology database construction, retrieval and maintenance, patient file information construction, display, and Management, patient directory information building, display and management, and more.
  • the modules, programs, or instructions for executing these may be included in a computer program product configured for execution by one or more processors.
  • the user interacts with the graphical user interface primarily through gesture input on the touch display.
  • the gesture input herein may include any type of user gesture input that the device can detect by directly touching the touch display or proximity to the touch display.
  • the gesture input may be a finger that the user uses a right or left hand (eg, an index finger, a thumb, etc.), or an input object that can be detected by touching the display screen (eg, a stylus, a touch screen dedicated pen) on the touch display screen.
  • the actions of selecting one location, multiple locations, and/or multiple consecutive locations may include operational actions such as contact, touch release, touch tap, long contact, rotational deployment, and the like.
  • the long contact corresponds to a gesture input of moving a finger, a thumb, a stylus in a predetermined direction or a variable direction while a finger, a thumb, a stylus, or the like is kept in continuous contact with the touch display screen, for example, like a touch drag Gesture operation such as moving, flicking, wiping, sliding, sweeping, and the like.
  • the gesture input is realized by the contact of the input object with the touch display screen, and the contact state with the touch display screen may include a state in which the finger, the thumb, or the stylus pen directly contacts the touch display screen or is in direct contact with the touch display screen.
  • the gesture input that is close to the touch display screen instead of being in direct contact refers to a gesture operation action in a spatial position close to the touch display screen.
  • the above graphical user interface refers to an overall design of human-computer interaction, operation logic, and interface aesthetics of the software, which may include one or more soft keyboards and multiple image control objects.
  • a soft keyboard can include a number of icons (or soft keys). This allows the user to select one or more icons in the soft keyboard and thus select one or more corresponding symbols for input.
  • the gesture input of the touch display screen may also include an actual hardware input device (eg, trackball, keyboard, mouse) a combination of one or more of the targets and/or joysticks to perform an operation similar to the gesture input described above on the graphical user interface, for example, by controlling the movement of the cursor on the graphical user interface by a hardware input device to produce a gesture input similar to that described above
  • an actual hardware input device eg, trackball, keyboard, mouse
  • the medical detection system can include a touch display 130, a medical detection device 300, a data processing module 150 and a control module 140, and a memory 160.
  • the medical detecting device 300 can detect a detection object (for example, an organ, a tissue, a blood vessel, or the like in a human body or an animal body, not shown) to obtain medical detection data (for example, an image, a spectrum, and a physiological parameter waveform of the detection object). , physiological parameter measurements, etc.).
  • the data processing module 150 can then generate a plurality of candidate objects that are associated with the medical detection device or the medical detection data obtained by the medical detection device.
  • the control module 140 may display the candidate object generated by the data processing module 150 on the touch display screen, and detect an input object (eg, a user's finger, a stylus, a touch screen dedicated pen, etc.) on the touch display screen. The operation then operates on the alternate object displayed on the touch display in response to the operation of the input object on the touch display (described in more detail below).
  • an input object eg, a user's finger, a stylus, a touch screen dedicated pen, etc.
  • touch display 130 may be integrated into a medical detection device, ie, part of a medical detection device.
  • the touch display screen may also be a separate device included in the medical detection device that can communicate with the medical detection device in a wired or wireless manner.
  • the aforementioned data processing module and control module can be integrated into the medical detection device. In other embodiments, the aforementioned data processing module and control module can be integrated into a device separate from the medical detection device that includes the aforementioned touch display.
  • the aforementioned "association operation" with the medical detection device or the medical detection data may be any control operation performed on the medical detection device itself or the medical detection data obtained by the medical detection device, for example, selecting a medical detection device. Adjusting the operating parameters of the medical detecting device, switching the working mode of the medical detecting device, selecting the current function of the medical detecting device, adjusting parameters of the medical detecting data, selecting or editing the information of the patient corresponding to the medical detecting data, establishing or selecting the corresponding medical detecting data Output reports, view, zoom in or out, edit, browse, mark, delete, and review medical test data.
  • the aforementioned "alternative object” may be any object for performing the various associated operations described above, such as various options, controls, or any other suitable object.
  • the medical testing device in the embodiment of the present invention is further explained by taking an ultrasonic detecting device as an example in conjunction with FIG. 1 .
  • the medical detection device is an example of the ultrasonic detecting device given in the following embodiments, the present invention is not limited to the ultrasonic detecting device.
  • the ultrasonic testing apparatus 300 shown in FIG. 1 generally includes a probe 301, a transmitting circuit 303, a transmit/receive selection switch 302, a receiving circuit 304, a beam combining module 305, a signal processing module 316, and an image processing module 326.
  • the transmitting circuit 303 transmits a delayed-focused transmission pulse having a certain amplitude and polarity to the probe 301 through the transmission/reception selection switch 302.
  • the probe 301 is excited by the emission pulse, and transmits ultrasonic waves to the detection object (for example, organs, tissues, blood vessels, etc. in the human body or animals, not shown), and receives the reflection from the target area after a certain delay.
  • the detection object for example, organs, tissues, blood vessels, etc. in the human body or animals, not shown
  • the receiving circuit 304 receives the electrical signals generated by the conversion of the probe 301, obtains ultrasonic echo signals, and sends the ultrasonic echo signals to the beam combining module 305.
  • the beam synthesis module 305 performs processing such as focus delay, weighting, and channel summation on the ultrasonic echo signals, and then sends the ultrasonic echo signals to the signal processing module 316 for related signal processing.
  • the ultrasonic echo signals processed by signal processing module 316 are sent to image processing module 326.
  • the image processing module 326 performs different processing on the signals according to different imaging modes required by the user, obtains ultrasonic image data of different modes, and then forms ultrasonic images of different modes through logarithmic compression, dynamic range adjustment, digital scan conversion, and the like.
  • Such as B image, C image, D image, etc. or other types of two-dimensional ultrasound images or three-dimensional ultrasound images.
  • the aforementioned data processing module and control module can be implemented in image processing module 326.
  • the foregoing data processing module and control module may also be separate modules of the ultrasonic detecting device 300 that are separated from the image processing module 326.
  • the signal processing module 316 and the image processing module 326 may be integrated on one motherboard 306, or one or more of the modules (including the number herein above) integrated in one processor/ Implemented on the controller chip.
  • the ultrasound detection device 300 can also include a gesture detection module 203.
  • the gesture detection module 203 can detect a gesture input that interacts between the input object and the touch display screen 130.
  • the gesture detection module 203 includes various operations for performing gesture input detection, such as determining whether a contact has occurred, determining whether the gesture input is continuously input, determining whether to correspond to the predetermined gesture, determining an operation position corresponding to the gesture input, determining Whether the corresponding operation position of the gesture input moves to the edge position of the corresponding display area, determines whether the gesture input has been interrupted (eg, whether the contact has stopped), determines the movement of the gesture input, and tracks the movement trajectory of the gesture input, and the like.
  • Program module determines whether a contact has occurred, determining whether the gesture input is continuously input, determining whether to correspond to the predetermined gesture, determining an operation position corresponding to the gesture input, determining Whether the corresponding operation position of the gesture input moves to the edge position of the corresponding display area, determines whether the gesture input has been interrupted (e
  • Determining the motion of the gesture input may include determining a rate of motion (amplitude), a velocity of motion (amplitude and direction), a velocity of motion (a change in amplitude and/or direction), a motion trajectory, and the like of the operational position corresponding to the gesture input. These operations can be applied to a single operational location (eg, a gesture input implemented by one finger), or multiple simultaneous operational locations (eg, "multi-touch", ie, gesture input implemented by multiple fingers).
  • the gesture detection module 203 is configured to detect motion of one or more input objects on a surface of the touch screen display or at a spatial location proximate to the touch screen display.
  • the medical detection device can also be other types of medical detection devices, such as nuclear magnetic resonance detection devices, patient monitors, CT, X-ray imaging devices, blood analyzers, biochemical analyzers, and the like.
  • the medical test data can be any type of test data from these medical test devices.
  • FIG. 2 illustrates some embodiments of a medical detection system 100 having a touch display 130.
  • One or more graphical objects may be displayed on graphical user interface 400 of touch display 130.
  • the unlock soft key 414 is displayed, and the gesture input control function of turning on or off the touch display screen 130 is realized by clicking the unlock soft key 414, and the display is different when turned on or off.
  • An icon such as by drawing an open lock in Figure 2, indicates that the touch display 130 is currently on, and drawing a closed lock indicates that the touch display 130 is currently off.
  • a hospital icon browsing area 415 can also be provided below the graphical user interface 400, touching the graphical object 418 corresponding to "Hospital 1" by one or more fingers 417, when the finger 417 touches the corresponding hospital graphic object 418
  • the magnified display graphic object 418 is displayed while the image object of the various application function modules corresponding to the hospital 1 is displayed in the upper area 416 of the area 415 of the graphical user interface 400, for example, the graphic object 413 for characterizing the patient file display module, a graphical object 401 characterizing the healthcare communication module, a graphical object 402 for characterizing the communication client module, a graphical object 403 for characterizing the video/audio player module, a graphical object 404 for characterizing the video conferencing module, for characterization a graphical object 405 of the camera module, a graphical object 406 for characterizing the picture browsing module, a graphical object 407 for characterizing the memo module, a graphical object 408 for characterizing the calendar module, a feature map module 409 for characterizing
  • the interface setting manner for example, deleting the area 415 on the graphical user interface 400 in FIG. 2, does not display a plurality of hospital graphic objects 418, and the graphical user interface 400 directly enters the image objects of various application function modules corresponding to a single hospital when the user interface 400 is opened.
  • the graphical user interface 400 directly displays an image display and/or control interface of a medical detection device when turned on. When the graphical user interface 400 is directly displayed, the image display and/or control interface of a medical detecting device may be displayed.
  • the graphical user interface 400 displays the ultrasonic image collected by the ultrasonic detecting device, and the graphical user.
  • the interface 400 displays graphical objects such as playback, ultrasound imaging parameter adjustments, etc., to implement corresponding functions or input of relevant setting parameters through gesture input.
  • the user can use one or more fingers 417, or other input device to contact the touch display screen 130, or select a graphic by gesture input at a spatial position where the touch screen display 130 is located.
  • Graphical objects for each application module given in the user interface Thereby switching to the graphical user interface of the corresponding application module, that is, by touching the graphic object of the corresponding function module to enter the graphic user interface corresponding to the next layer function directory.
  • FIG. 2 shows one of the gesture input modes, that is, using one or more fingers 401 to contact the touch display screen 130, and determining the graphical object controlled by the gesture input by determining the position of the finger 417 in contact with the surface of the touch display screen 130.
  • the contact here includes direct contact with the surface of the touch display 130, or contact with the surface of the touch display 130 that is not in direct contact.
  • gesture input made by a finger or the like in a spatial position at a certain distance from the surface of the touch screen display, and the spatial position at which the gesture input is located is mapped to a corresponding mapping position on the touch display screen, corresponding to the detected mapping position.
  • the graphical object is used to determine the graphical object controlled by the gesture input, thereby transforming the graphical user interface through gesture input control.
  • the detection of such gesture control can be combined with the optical sensor and its controller and gesture detection module to track by acquiring images or sensitizing changes.
  • an optical sensor embedded in the front surface or the edge of the touch display screen can also be used to sense the influence of the input object on the surface effect of the touch screen display at a certain spatial position, thereby determining that the gesture input by the input object corresponds to the touch display.
  • the operation position on the screen effectively realizes the movement change of the tracking gesture input.
  • the touch proximity sensor mentioned in the above embodiment can also be combined to detect the related gesture.
  • the present invention is not limited to the manner of using only the gesture input shown in FIG. 2 above, and other alternative manners may be adopted, for example, the manner in which the gesture input modes shown in FIG. 2 are combined.
  • the gesture input modes shown in FIG. 2 are combined.
  • different functions are operated by two gesture input modes, which will be described in detail below with reference to some embodiments.
  • the medical detection system 100 can also touch the side of the housing of the display screen 130 to set an actual control button such as a power switch button 421, a volume adjustment button 420, and the like.
  • an actual control button such as a power switch button 421, a volume adjustment button 420, and the like.
  • the power of the medical detection system 100 is turned on and off by pressing the pressure state time of the power switch button 421, thereby reducing the installation space of the actual button, and the button can be released by pressing the power switch button 421 before a predetermined time interval elapses. Locking the medical detection system 100, i.e., achieving the same function as the graphical object 414 of the gesture control diagram 2.
  • the doctor The therapy detection system 100 can also input some voice commands through the microphone to open some application modules, such as a voice control to enter the pathology database search function and the like.
  • the gesture input control function of the touch display screen 130 is turned on by pressing the power switch button 421 or the gesture input to control the unlock soft key 414 shown in FIG.
  • gestures can be performed on a plurality of candidate objects displayed on the touch display screen by the list item in the manner shown in FIG. 4, thereby marking the candidate in the current list item.
  • the attribute state of the object where the candidate object includes one, some, or all of the above graphical control objects.
  • the attribute information corresponding to each candidate object includes an enabled state attribute of the optional function control, a control visibility attribute, a prompt information display attribute, and the like.
  • the attribute information mentioned herein includes two optional and opposite states. For example, an enabled state property of an alternate function control, which includes: two optional states, selected or unchecked. There are many ways to mark these two optional states on the graphical user interface.
  • two optional states, selected or unselected are distinguished by adding or not adding a mark symbol such as a selection hook in the attribute mark display area 602 corresponding to the candidate object.
  • the selected state is indicated by filling a mark symbol such as black in the attribute mark display area 602 corresponding to the candidate object, and the unselected state is indicated by the reverse.
  • two selected states are selected or unselected by highlighting the selected candidate objects.
  • the color identification information such as color, contrast, background color, etc. of the corresponding graphic object is specifically displayed by a broken line in FIG. 9 to distinguish the graphic object displayed under normal conditions
  • the selected object is marked by the mark.
  • the color identification information such as the color, contrast, background color of the selected object is used to distinguish the unselected graphic objects from the selected or unselected two optional states, and the like.
  • FIG. 4 provides a method of controlling a medical detection system, the method comprising steps S610 to S630.
  • Step S610 a step for displaying a plurality of candidate object tables on the touch display screen, wherein An alternative object is used to associate with medical test data or a medical test device.
  • a list of information may be presented on the graphical user interface 600 shown in FIG. 5, and the list includes a plurality of candidate objects.
  • the form of the information list presentation can be various.
  • the graphic objects corresponding to the respective candidate objects in the information list can be presented in a tabular form.
  • the respective regions on the graphical user interface 600 are arranged row by row from top to bottom, or column by column from left to right from corresponding regions on the graphical user interface 600.
  • each candidate object in the information list is arranged in a matrix on the graphical user interface 600 according to a predetermined rule or randomly.
  • the information list in this embodiment may be a file information list including a plurality of patient files, a contact address book including a plurality of contacts, a play information list including a plurality of video and/or audio data, and a plurality of images or pictures.
  • a list of device information including a plurality of devices or devices to be remotely controlled, and the like, any information list or root directory index table in which a plurality of alternatives are recorded, and the like.
  • the candidate object may set the graphic control object correspondingly displayed on the graphical user interface according to the content recorded in the information list. For example, as shown in FIG. 5, the step S610 of displaying the plurality of candidate objects on the touch display screen includes :
  • An attribute mark display area 602 corresponding to the candidate object for marking the selectable state is displayed.
  • the attribute mark display area 602 is used to add or fill a mark symbol characterizing the selected state, and the mark symbol may be selected. Hook, check points, fill black, and more.
  • the attribute mark display area 602 may be a border of the graphic object corresponding to the candidate object, an outer edge area, a background ground area, and the like, and then pass through the shape, color, contrast, background color, etc. of the area.
  • the color identification information is used to mark that the corresponding graphic object is selected.
  • the step S610 may further include: displaying an information display area 603 corresponding to the candidate object for recording the candidate object representation information.
  • the information display area 603 may be disposed in parallel with the attribute mark display area 602 as shown in FIGS. 5 and 6, or as shown in FIG. 10, the information display area 603 may be located at any position around the attribute mark display area 602, such as an information display area. 603 is located below the attribute mark display area 602. Of course, the information display area 603 is located in the attribute mark display. In the middle of the display area 602, or the information display area 603 and the attribute mark display area 602 may be combined into one.
  • the information display area 603 and the attribute mark display area 602 may be collectively referred to as sensitive areas of the candidate object.
  • the information display area 603 can be used for:
  • Displaying one of the plurality of corresponding time records corresponding to the calendar time in the time record information list such as a name, a number, a time, a remark information, a text information, a corresponding operation information, or the like, or a combination of two or more types of information;
  • the name, the number, the brief description, the remark information, and the like of the plurality of information items in the data information list are displayed.
  • the plurality of information items may be data item information detected by the detecting device over a period of time.
  • the information display area 603 is mainly used to conveniently locate an candidate object to be selected by the user. Therefore, the information display area 603 can display an index of an alternative object in various information lists.
  • the information may be one or a combination of two or more of a name, a number, a geographical location, a time, a comment, a function description, an effect data, a picture thumbnail, and the like.
  • the graphical object that is converted into a visualized index information is displayed on the touch display. This article is not listed here.
  • the sensitive area of each candidate object may be one, or may be the information display area 603 and the attribute mark display area 602 mentioned above, and the display manner of the plurality of candidate objects on the touch display screen may be as shown in FIG. 5 and 6 is shown in a table form from top to bottom or left to right, or a sensitive area of a plurality of candidate objects as shown in FIG. 10 is randomly or matrix presented on the touch display screen.
  • step S611 may be further included before step S610 for controlling the step of detecting, by the medical detecting device, the detection object to obtain medical detection data.
  • the detection object here may be any one or more living or non-living tissue structures.
  • a step of detecting a continuous moving contact of the input object with the touch display screen is included in step S620.
  • the contact with the touch screen may be one of direct contact with the touch display screen and an action at a spatial position proximate to the touch display screen in the present embodiment, as described in detail above.
  • the contact of the input object with the touch display screen can be tracked to determine different gesture input manners, for example, detecting gestures Inputting corresponding to an operation position on the touch display screen, determining whether a contact has occurred, determining whether the contact of the gesture input is continuously input, determining whether to correspond to the predetermined gesture, determining whether the operation position corresponding to the gesture input is in motion, determining the corresponding gesture input Whether the operating position moves to the edge position of the corresponding display area, determines whether the gesture input has been interrupted (eg, whether the contact has stopped), determines the movement of the gesture input, and tracks the movement trajectory of the gesture input, etc., the technical details can be found in the relevant existing technology.
  • step S620 is one of the types of gesture inputs mentioned in the foregoing, that is, detecting continuous contact of the input object with the touch display screen.
  • a determination may be made by the following steps to determine if a continuous moving contact has been detected. As shown in FIG. 11, step S620 may include:
  • Step S621 detecting whether the input object is in contact with the touch display screen, and if yes, proceeding to the next step Broken, if not, do not operate. In the process, it is detected whether the input object is in contact with the touch display screen, and can be realized by determining whether the operation position corresponding to the touch touch screen is detected.
  • step S622 it is judged whether the contact with the touch display screen is continued and the movement has occurred, and if so, it is determined that the contact for continuous movement is detected, otherwise the operation is not performed.
  • step S622 it is determined whether the contact with the touch display screen is moved by determining whether the corresponding operation position of the gesture input is moving, and determining whether the contact with the touch display screen is continued. It can be detected from many aspects. For example, determining whether the operation position continuously changes, determining whether contact with the touch display screen has continued for a certain period of time, determining whether the motion of the operation position crosses two sensitive areas, and determining to input within a predetermined motion displacement range of the operation position. Whether the object's contact with the touch screen is always present, etc., there are many ways to judge.
  • the continuous moving contact mentioned in this embodiment can be understood as a type of long contact gesture input in which the input object contacts the touch display screen in a continuous change, for example, a sliding operation on the touch screen, or a touch Continuous sliding operation on the display for a continuous period of time.
  • a gesture input of a long contact gesture input is obtained by touching the touch display screen with one finger on the graphical user interface.
  • a long contact gesture input is obtained by simultaneously touching the touch display screen with two fingers. Or, by touching the touch display screen with three fingers at the same time, long contact gesture input and the like are obtained.
  • more than one input object such as a finger contacts the touch display screen to obtain a long contact gesture input.
  • continuous moving contact of the input object with the touch display screen may be detected within a full screen range of the touch display screen, or continuous movement of the input object and the touch display screen may also be detected within a defined area. contact.
  • the range of the detected area can improve the accuracy of the touch control, and can also realize the function distinction of the gesture input of different control functions under the same graphical user interface.
  • step S602 continuous moving contact of the input object with the touch display screen is detected in the selection area set on the touch display screen.
  • a selection area 601 parallel to the arrangement direction of the candidate objects is set on the touch display screen, and the input object and the touch display screen are detected in the selection area 601.
  • the moving contact is continued to respond to the continuous moving contact within the selection area 601 to mark the attribute information of the candidate object.
  • the selection area 601 may be parallel to the arrangement direction from the top to the bottom as shown in FIG. 6, or parallel to the arrangement direction from left to right as shown in FIG. 7, or the selection area 601 may be disposed in any direction.
  • the selection area 601 includes the attribute mark display area 602 corresponding to the plurality of candidate objects mentioned above, or the selection area 601 spans.
  • the selection area 601 includes: an attribute mark display area 602 for displaying attribute information corresponding to each candidate object in the same graphical user interface 600, and the length extension direction of the selection area 601 and the attribute mark display The arrangement direction of the regions 602 is the same.
  • At least two selection areas 601 are included on the touch display screen, and the two selection areas 601 may partially coincide.
  • the plurality of selection areas 601 may be arranged in parallel in the arrangement direction of the rows or columns.
  • two selection areas 601 are respectively disposed along the arrangement direction of the rows and columns, and the input is detected in the selection area 601 disposed along the line arrangement direction.
  • the selected plurality of candidate objects are determined according to the number of rows and the number of columns, for comparing the observed sample values or sampling pictures and the like. Or, as shown in FIG. 13, when the sensitive areas corresponding to the candidate objects are arranged in a matrix form, two selection areas 601 are respectively disposed along the arrangement direction of the rows and columns, and the input is detected in the selection area 601 disposed along the line arrangement direction.
  • the selected state is marked by means of a prominent enlarged display for implementing batch selection of the candidate objects.
  • step S602 a continuous moving contact of the input object within a predetermined pressure range applied on the touch display screen is detected. That is, when the detected contact pressure reaches a predetermined range, such as exceeding a predetermined pressure value, the detected continuous moving contact at this time will be used to respond to the gesture input marking the optional state of the plurality of candidate objects, and vice versa. Can be set to another function controlled gesture input.
  • the pressure detection in this embodiment can be perceived by touching a pressure sensor in the display screen, or the magnitude of the contact area when the finger touches the display screen, or the pressure can be sensed by setting a pressure sensor on the touch panel.
  • the size simultaneously detects continuous moving contact on the touchpad, thereby indirectly controlling the movement or selection of the cursor on the touch display, and the like.
  • the range of the predetermined pressure is set with reference to the parameter specifications of the corresponding hardware detecting device.
  • step S602 a continuous moving contact of the input object within a predetermined pressure range applied on the touch display screen is detected in the selected area set on the touch display screen.
  • the continuous moving contact detected in step S620 may be a motion along a straight line, for example, the continuous moving contact detected in step S620 may be a linear motion along a plurality of candidate object arrangement directions. Alternatively, it can be a motion along a diagonal line, or the like along any motion trajectory.
  • step S630 the attribute information corresponding to the plurality of candidate objects associated with the continuous moving contact is marked in response to the continuous moving contact.
  • a continuous moving contact as referred to in this embodiment may refer to a predetermined or pre-defined association or correlation with the "continuous mobile contact" operation performed on the touch screen, for example, a sensitive area of an alternate object.
  • the operation position corresponding to the continuous moving contact on the touch display screen satisfies a predetermined positional relationship, or the sensitive area of the candidate object is located within a preset range or preset distance referenced to the operation position, or an alternative object
  • the sensitive area is located within the range spanned by the continually touching trajectory, or any other suitable way of association or correlation.
  • the detected continuous moving contact may be a motion implemented on the touch display screen in any direction, and the embodiment determines the selected candidate object according to the motion, thereby implementing batch marking.
  • the optional state of the candidate object compared to the prior art by one-by-one contact/release
  • the current alternative object is more flexible and the user experience is more powerful, which improves the function of the touch screen.
  • Whether the attribute information of the corresponding candidate object in the embodiment corresponds to the mark is to detect the operation position corresponding to the current time input object contacting the touch display screen during the movement of the continuous moving contact, and to use the operation position and the standby position Select the positional relationship of the object to judge. See the description below for details.
  • the marking process of the attribute information corresponding to the plurality of candidate objects includes the following steps:
  • step S630 the current optional state flag of the attribute information corresponding to the plurality of candidate objects associated with the continuous moving contact is responded to the continuous moving contact. Is an optional state that is the opposite of the currently selectable state.
  • distinguishing marks for the opposite states of the attribute information can also be implemented by the following embodiments.
  • step S630 performing one of the following steps:
  • an optional state opposite the one of the selectable states corresponding to the attribute information of the plurality of candidate objects associated with the continuous moving contact is marked.
  • the input object 417 in the upper left diagram inputs a continuous moving contact on the touch display screen in the first movement direction X, according to continuous movement. Touching the motion in the first moving direction X, marking the selectable state corresponding to the attribute information of the plurality of candidate objects to display the mark symbol characterizing the selected state, and displaying the box filled with black in the attribute mark display area 602 in FIG. Indicates that the corresponding candidate object is selected.
  • the corresponding candidate object is selected by means of marking a selection hook, marking a dot, and the like. in.
  • the input object 417 inputs a continuously moving contact on the touch display screen in the second moving direction Y, and according to the movement of the continuous moving contact in the second moving direction Y, the attribute information of the plurality of candidate objects is marked.
  • the selectable state is to display a mark symbol characterizing the unselected state, and a box showing no fill black in the attribute mark display area 602 in FIG. 14 indicates that the corresponding candidate object is not selected.
  • the optional state of the corresponding candidate object can be distinguished by marking or not marking the selection hook, marking the dot, and the like.
  • the candidate objects corresponding to the sensitive area spanned by the motion trajectory are selected, and the selected state is indicated by the highlighted enlarged display in the figure, and
  • the motion track when the operation is unchecked may be the reverse of the original motion track, or may be the cancellation path prompted to the user before confirming the batch selection.
  • the first moving direction and the second moving direction may be a fixed direction, or may be a combination of a plurality of variable directions, such as a tangential direction of a moving track.
  • the motion of the continuous moving contact in the first moving direction or the second moving direction may be a linear motion in a fixed direction, or a curved trajectory movement in a variable direction, or a diagonal motion in a fixed direction.
  • the motion trajectory of the above-mentioned continuous moving contact in the first moving direction and the second moving direction may be uniform or inconsistent.
  • the first moving direction and the second moving direction may be opposite directions. Therefore, as shown in FIG. 14 and FIG. 15 , only the adjustment of the motion track of the continuous moving contact, such as the direction adjustment, can realize the switching of the selected and the unselected under the same gesture input, which is convenient to use and enhance the user experience. It is also possible to increase the function of gesture input by adjusting the direction of the motion track.
  • step S630 in response to an odd number of consecutive moving contacts, an optional state of the attribute information is marked, and the attribute information corresponding to the one is marked in response to an even number of consecutive moving contacts.
  • An optional state with an opposite state of the optional state As shown in FIG. 14, the input object 417 in the upper left diagram inputs a continuous moving contact on the touch display screen in the first moving direction X, and marks the plurality of preparations according to the first input of the continuous moving contact in the first moving direction X.
  • the optional state corresponding to the attribute information of the selected object to display the marked symbol characterizing the selected state, or the mark and the current optional The attribute information of the opposite state (ie, the attribute information is inverted); and when the input object 417 inputs the same continuous moving contact of the second track in the first moving direction X on the touch display screen, the multiple candidate objects are marked.
  • the attribute information corresponds to an optional state to display a tag symbol that characterizes an unselected state, or to perform a negation flag.
  • the motion trajectory of the contact is continuously monitored, and it is determined whether the motion trajectory of the continuous moving contact deviates from the initial motion trajectory, and if so, the motion marker attribute information deviating from the motion trajectory corresponds to an optional state opposite to a state, Otherwise, an optional state of the attribute information is marked.
  • the initial motion trajectory herein refers to a trajectory of motion predicted based on the initial motion direction and the moving speed of the contact motion for a period of time from the start of detecting the continuous moving contact.
  • the initial motion trajectory that is, the motion trajectory along the initial moving direction
  • the motion of the continuous moving contact described above may be a tangential direction deviating from the initial trajectory, an expected trajectory deviating from the initial trajectory, or the like.
  • an optional state of the attribute information is marked when the continuous moving contact is outside the selected area set on the touch display screen. And marking an optional state corresponding to the one optional state corresponding to the attribute information.
  • the input object 417 in the upper left diagram inputs a continuous moving contact in the first moving direction X in the selection area 601 on the touch display screen, and marks the optional state corresponding to the attribute information of the plurality of candidate objects.
  • Marking the marked symbol characterizing the selected state or the attribute information inversion flag when detecting that the continuous moving contact of the input object 417 on the touch display screen is outside the selected area 601, marking the attribute information of the plurality of candidate objects Corresponding optional states to display tag symbols that characterize unselected states, or to perform negation tags.
  • step S630 the marked candidate objects are included and The candidate object associated with the operation position corresponding to the touch object when the input object touches the touch display screen, wherein the associated candidate object includes at least one of the following conditions:
  • the first sensitive area is located in a preset range or a preset distance within a preset distance referenced by the above operating position.
  • Each candidate object is provided with a corresponding sensitive area on the graphical user interface on the touch display screen for displaying relevant index information of each candidate object or a corresponding graphic object of the marker symbol input box on the graphical user interface. Then, according to the positional relationship between the sensitive area and the operation position corresponding to the touch display screen, it is determined whether the candidate object corresponding to the sensitive area is selected.
  • the sensitive area is an alternate object located near the above operational location. In the vicinity, it can be understood that the corresponding operation position when contacting the touch display screen is located within the sensitive area, or partially overlaps with the sensitive area, or the operating position is located at the edge position of the sensitive area.
  • a rectangular coordinate system is established for the length and width of the touch display screen for the Y and X axes, respectively, and each pixel displayed on the graphical user interface 600 can be represented by a rectangular coordinate.
  • the sensitive area 604 can be determined as a pixel point area, and the corresponding operation position 605 when contacting the touch display screen can also use one coordinate position in the Cartesian coordinate system or a coordinate position block (ie, including multiple adjacent coordinate positions). To represent.
  • the operating position 605 corresponding to the contact of the finger with the touch screen, and the sensitive area 604 located near the operating position 605 may include: the coordinate position corresponding to the operating position 605 or the coordinate position block is located in the sensitive area 604.
  • the coordinate position corresponding to the operation position 605 is located at the edge position of the pixel area corresponding to the sensitive area 604, or the coordinate position block corresponding to the operation position 605 partially overlaps the pixel area corresponding to the sensitive area 604.
  • the portion of the sensitive area 604 is located in an alternate object within a predetermined range of positions centered on the operational position described above.
  • the portion of the pixel area corresponding to the sensitive area 604 is located within a preset position range centered on the above-mentioned operation position 605, and the preset range here may be set to a range of 10 pixels with the radius of the operation position 605 as the center. .
  • the sensitive area 604 is an alternate object within a predetermined distance from the above-described operating position.
  • the preset distance can be set to 10 pixels or 5 pixels, and so on.
  • the distance between the sensitive area 604 and the above-mentioned operating position may be calculated from the edge of the sensitive area 604 to the operating position 605.
  • the candidate object is an candidate object associated with the operation position corresponding to the touch touch screen display. Need to be marked. As shown in FIG. 16(b), when the operation position 605 sequentially passes through the positions 605a, 605b, 605c, 605d, the candidate object 1 mark is selected, the candidate object 2 mark is selected, and the candidate object 3 mark is not selected. The optional object 3 tag is selected.
  • the ratio in this embodiment may be 50%.
  • the sensitive area of the candidate object may be an attribute mark display area 602 for displaying an optional object selectable state mark symbol, and when the operation position 605 sequentially passes through the position 605a, 605b, 605c, In 605d, the candidate object 1 tag is selected, the candidate object 2 tag is selected, the candidate object 3 tag is not selected, and the candidate object 3 tag is selected.
  • the center of the sensitive area of the candidate object coincides with the center of the coordinate area in which the operating position is located.
  • the sensitive area center of the candidate object includes a center point, a center line, a center spot, and the like.
  • the center of the sensitive area of the candidate object may be the center line along the X direction, and the center line along the X direction when it is in the coordinate area with the operation position (605a, 605b, 605c, 605d).
  • the optional state of the candidate object is marked. As shown in FIG.
  • the sensitive area of the above candidate object may be the attribute mark display area 602 for displaying the candidate object selectable state mark symbol, then when the center point or the center spot of the attribute mark display area 602 coincides When the center point or the center spot of the coordinate area in which the operation position (605a, 605b, 605c, 605d) is located, the optional state of the candidate object is marked.
  • the candidate object corresponding to the sensitive area spanned by the motion track of the continuous contact of the input screen may be: an alternative object corresponding to the partially sensitive area spanned, or all pairs of sensitive areas spanned Alternative object should be.
  • the sensitive area herein may be an attribute mark display area 602 for displaying an alternative object selectable state mark symbol, or an information display area 603 for displaying alternate object index information.
  • the upper figure is a method of performing an alternate object mark after continuously moving contact along the first track, and when the mark is selected, it is highlighted and enlarged.
  • the figure below is the way to uncheck the reverse trajectory along the first trajectory.
  • the unmark When the unmark is selected, it does not highlight the enlarged display and returns to the original state.
  • the candidate object corresponding to the graphic object is selected and corresponding Perform a tag operation.
  • the marking of the selectable states of the plurality of candidate objects may be completed according to the motion trajectory or direction of the continuous moving contact.
  • the attribute information corresponding to the plurality of candidate objects is continuously marked in sequence along the moving direction of the continuous moving contact.
  • the moving direction of the moving contact obtains the selected candidate objects corresponding to the operation positions of the plurality of times at a time, and then sequentially marks the attribute information of the plurality of candidate objects in chronological order.
  • the information list is displayed on the touch display screen in the form of a table, and the contact between the input object and the touch display screen is continuously moved along the arrangement direction of the candidate object, and the candidate objects in the information list are continuously marked in sequence along the moving direction of the continuous moving contact. 1 to the candidate object 7
  • the attribute information of the plurality of candidate objects is selected, and the mark symbol characterizing the selected state is displayed.
  • the information list displayed in the form of a table is provided in FIG. 17, the manner of sequentially marking is also applicable to the information list displayed in the above non-table form, such as an alternate object arranged in a random manner.
  • the attribute information of the plurality of candidate objects may be continuously marked in order to display the motion of the continuous moving contact in the first moving direction (for example, the X direction in FIG. 17). Characterizing the selected symbol of the selected state; then, when deselected, referring to FIG. 17, the motion of the continuous moving contact in the second moving direction (for example, the reverse direction of the X direction in FIG. 17) is successively marked in sequence.
  • the attribute information of the candidate object is used to display the mark symbol characterizing the unselected state, that is, the mark symbol characterizing the selected state is cancelled.
  • the corresponding candidate objects are sequentially selected one by one to perform marking in the selected or unselected state.
  • attribute information corresponding to all candidate objects spanned by the motion trajectory of the continuous moving contact is simultaneously marked.
  • this embodiment by detecting a continuous moving contact of the input object with the touch display screen, and tracking the continuous operation position corresponding to the continuous moving contact for each period of time, determining that the selected candidate object is contacted every time period, thereby The motion track of the continuous moving contact obtains the selected candidate object corresponding to the continuous operation position for a period of time, and then simultaneously marks the attribute information of the selected candidate object corresponding to the continuous operation position.
  • the selectable states of all candidate objects spanned by the motion trajectory for each successive moving contact are simultaneously marked.
  • the input object 417 continuously moves from the sensitive area of the candidate object 1 to the sensitive area of the candidate object 4 it means that the candidate object 1 to the candidate object 4 are simultaneously selected, and the candidate object is simultaneously selected. 1 to the candidate object 4 is marked to simultaneously display the marker symbol characterizing the selected state.
  • the input object 417 continuously moves from the sensitive area of the candidate object 5 to the sensitive area of the candidate object 7 it means that the candidate object 5 to the candidate object 7 are simultaneously selected, and at the same time, the candidate object is selected. 5 to the candidate object 7 is marked to simultaneously display the marker symbol characterizing the selected state.
  • FIG. 18 it may be a motion of the continuous moving contact in the first moving direction (for example, the X direction in FIG. 17) while marking the attributes of all the candidate objects spanned by the motion trajectory of the above-described continuous moving contact.
  • Information to display a mark symbol characterizing the selected state may also be made to FIG. 18 to continuously move the contact in the second moving direction (for example, the reverse direction of the X direction in FIG. 17) while marking
  • the attribute information of all candidate objects spanned by the motion trajectory of the above continuous moving contact to display the mark symbol representing the unselected state, ie cancel Displays the marker symbol that characterizes the selected state.
  • the selected multiple candidate objects may be marked in the selected or unselected state at the same time.
  • the corresponding attribute information of the plurality of candidate objects spanned by the motion track of the continuous moving contact may be skipped according to the change of the motion track of the continuous moving contact.
  • the attribute information of the plurality of candidate objects is continuously marked sequentially along the moving direction of the initial trajectory of the continuous moving contact, or the attributes of all the candidate objects spanned by the initial trajectory are simultaneously marked.
  • Information when the motion of the continuous moving contact deviates from the initial trajectory, the continuation of the moving contact after the deviation from the initial trajectory, the marking operation is performed not in response to the movement of the contact; and when the motion of the continuous moving contact returns to the initial trajectory, the response
  • the above continuous moving contact after returning to the above initial trajectory marks attribute information of a plurality of candidate objects.
  • the movement of the continuous moving contact from the initial trajectory may be a tangential direction deviating from the initial trajectory, an expected trajectory deviating from the initial trajectory, etc., for example, as shown in FIG. 19, the dotted arrow indicates continuous contact of the input object with the touch display screen.
  • the direction of motion, its initial motion trajectory may be a straight line along the direction in which the candidate objects are arranged, and a plurality of candidate objects are successively marked in sequence along the moving direction of the linear trajectory of the above continuous moving contact (alternative object 1 to Attribute information of the candidate object 4), or an optional state of all candidate objects (alternative object 1 to candidate object 4) spanned by the above-mentioned straight trajectory; when the above continuous moving contact deviates from the above straight line In the case of the trajectory, that is, the continuous moving contact deviates from the linear trajectory or the continuous moving contact deviates from the tangential direction of the linear trajectory, and the continuous moving contact after the deviation from the linear trajectory is not marked, and the continuous moving contact with the mark does not correspond to Touching the candidate object associated with the operating position of the display (alternative object) Attribute information of item 6 to candidate object 7); conversely, when the above-mentioned continuous moving contact returns to the above-mentioned linear trajectory, in response to the above-
  • the method may further be implemented by other means, for example, as shown in FIG. 20 Show.
  • the method further includes: marking the attribute information of the candidate object when the continuous moving contact is no longer detected on the touch display screen until the continuous moving contact with the last moment is corresponding to the marking Touch the last candidate object associated with the operating position on the display. Specifically, the real-time monitoring whether the contact of the input object with the touch display screen is released, and if so, the continuous moving contact is no longer detected on the touch display screen, and then the end of the gesture input is ended, that is, the continuous moving contact ends. The marker then stops the optional state of the candidate object associated with the corresponding operational position of the continuous movement contact associated with the last moment before the end of the continuous moving contact.
  • a list of information including a plurality of candidate objects is displayed on the touch display screen and the information is displayed on the graphical user interface 600 of the touch display screen, as described above.
  • Part of the list, the rest of which is not displayed on the same graphical user interface 600, can be implemented in the following manner in order to be able to mark alternative objects in the rest of the displayed information list.
  • the method in this embodiment further includes:
  • the edge display position 702 in this embodiment refers to an edge position of a display area in which part or all of the information list is displayed on the graphic user interface 600.
  • the edge position may refer to the graphical user interface 600.
  • the sensitive area corresponding to the first candidate object (such as the sensitive area corresponding to the candidate object 9 in FIG. 21).
  • the first direction here may be a direction along the alternate object, for example, may be the pointing direction of the black short arrow 703 in FIG. 21, or may be the direction perpendicular to the pointing direction of the black short arrow 703 in FIG. (such as horizontal to the left or right), or can also be the horizontal or vertical of the graphical object in Figure 7, Figure 9, and Figure 13. Straight the direction.
  • the display information list displayed on the touch display screen is moved in the first direction, the display information list is moved each time to display the information list. For the rest, multiple alternative objects are displayed.
  • the display information list is paused for each time in the first direction. a time period, for example 1-2 seconds, while only the candidate object is displayed for a predetermined time, without marking, until the predetermined time period arrives, and then responding to continuous contact with the touch screen display, marking the rest of the information list.
  • a plurality of candidate objects that are subsequently displayed may be sequentially marked, simultaneously marked, or marked according to the trajectory change according to the manner described above with reference to the previous input. For details, refer to the related descriptions shown in FIG. 12 to FIG.
  • a plurality of consecutive candidate objects may be marked in a manner of one gesture input, or a plurality of candidate objects displayed in a scrolling manner may be continuously marked.
  • a partition setting manner may also be adopted. To capture the response commands corresponding to the gesture input by collecting gesture inputs from different regions.
  • the area is one of the selection area 601 and the other is the scroll area 704.
  • the selection area is not repeatedly explained herein with reference to the previous description, and the scroll area 704 may be a display area parallel to the selection area 601, which may be used to display a list of information.
  • the display area is a display area other than the selection area 601, or may be part or all of the information display area 603 including the information for describing the candidate object.
  • a first portion of the information list displayed on the touch display screen is located in the scroll area 704 on the touch display screen, detecting movement of the input object in contact with the touch display screen 417b, in response to the movement of the contact 417b, in the second direction (Fig.
  • the black arrow 703 in 22 moves up the display information list displayed on the touch display screen to display the rest of the information list except the first portion.
  • the second direction in this embodiment may be the moving direction of the contact 417b.
  • the movement of the contact 417b in the step of detecting the movement of the contact 417b on the touch display screen, the movement of the contact 417b may be detected in the rolling area on the touch display screen in accordance with the moving direction of the contact 417b.
  • the display information list displayed on the touch display screen is moved in the second direction (black arrow 703 in FIG. 22) to display the rest of the information list except the first portion.
  • the alternate object is arranged in the same direction as the first direction described above.
  • the step of moving the display information list displayed on the touch display screen in the second direction to display the remaining portion of the information list other than the first portion in the step of displaying the information list Touching the movement in the second direction on the display screen to display the candidate objects in the rest of the information list one by one, that is, each time the display information list is moved to display the rest of the information list, the candidate objects are displayed one by one;
  • the list of information displayed on the touch display screen is scrolled in the second direction to display the second portion of the list of information, and the second portion is different from the first portion.
  • the scroll display means that the information list continuously shifts the information list at a certain speed, and at this time, the scroll display is stopped until the gesture input for stopping the scroll display is detected.
  • the scroll bar may be set in the scroll area. The input object touches and drags the scroll bar to achieve page turning of the information list.
  • each candidate object 800 is classified according to the attribute operation type.
  • the enable state function control area 801 of the candidate object 800 is included in FIG. 3, which may be located in the selection area 601.
  • the enable state function control area 801 in FIG. 3 can also be understood as an attribute mark displayed on the touch display screen. Display area.
  • FIG. 22 it provides a two-partition on the touch display screen, one is a selection area 601, and the other is a scroll area 704, respectively providing gesture input of two areas to simultaneously implement multiple candidate objects. Purpose Batch selection and page turning of information lists.
  • FIG. 23 a method for controlling a medical detection system is provided, comprising: steps S710 to S750.
  • a first portion of the list of information containing a plurality of candidate objects is displayed on the touch display.
  • a list of information including a plurality of candidate objects is displayed on the touch display screen.
  • the information list is not fully displayed in the same graphical user interface 600, but needs to be displayed in a page, then it is necessary to display other parts of the information list by turning pages or scrolling or panning.
  • the above information list is displayed in a tabular form on the touch display screen as shown in FIGS. 5 to 9.
  • a plurality of candidate objects in the information list are randomly arranged on the graphical user interface, as shown in FIG.
  • step S720 contact of the input object with the touch display screen is detected.
  • the specific detection input object is in contact with the touch display screen.
  • the related hardware and software modules are used to track the contact state of the input object with the touch display screen, thereby determining the type of gesture input of the input object on the touch display screen.
  • the contact includes at least one of direct contact with the touch display screen and an action at a spatial location proximate to the touch display screen.
  • the above-mentioned detected contact may be any of the gesture inputs mentioned in the foregoing.
  • step S730 the operational position of the above contact on the touch display screen is determined.
  • the input object has a corresponding operation position on the touch display screen, and the continuous movement contact corresponds to a sequence of operation positions that change with time.
  • the operation position refer to the above discussion about constructing a Cartesian coordinate system using the touch display screen to determine the input. The method of positioning the object contact position.
  • step S740 when the above-mentioned operating position is located in the selected area on the touch display screen, a plurality of items associated with the continuous moving contact in the first portion of the marked information list in response to the continuous moving contact of the input object within the selected area Select the attribute information corresponding to the object.
  • the movement of the contact in this embodiment is the continuous movement of the contact while maintaining the continuous input of the contact on the touch display screen, that is, the contact is a continuous moving contact.
  • the selection area includes: an attribute mark display area for displaying an optional object selectable state mark symbol corresponding to each candidate object in the same graphical user interface, and a length extension direction of the selected area and an attribute mark display area
  • an attribute mark display area for displaying an optional object selectable state mark symbol corresponding to each candidate object in the same graphical user interface
  • a length extension direction of the selected area and an attribute mark display area The arrangement is the same.
  • the selection area please refer to the relevant explanations in the previous section, which are not exhaustive.
  • detecting a motion of the input object in contact with the touch display screen detecting a motion of the contact of the input object on the touch display screen that satisfies a predetermined pressure condition; and, when the operation is When the position is within the selected area on the touch display screen, an optional state of the plurality of candidate objects is marked in response to the movement of the contact in the selected area that satisfies the predetermined pressure condition.
  • step S630 how to mark the attribute information corresponding to the plurality of candidate objects according to the continuous moving contact in the selection area, refer to the detailed description of step S630 in the foregoing, and may be combined with FIG. 14 and FIG. 15 and FIG. (c), the relevant characters in Fig. 18, Fig. 20, and Fig. 22 are explained.
  • step S750 when the operation position is located in the scroll area on the touch display screen, the display information list displayed on the touch display screen is moved in response to the movement of the contact of the input object in the scroll area to display the At least a portion of the remainder of the list of information except the first portion.
  • the step of moving the display information list displayed on the touch display screen in the second direction to display the remaining portion of the information list other than the first portion in the step of displaying the information list Touching the movement in the second direction on the display screen to display the candidate objects in the rest of the information list one by one; that is, each time the display information list is moved to display the rest of the information list, the candidate objects are displayed one by one;
  • the list of information displayed on the touch display screen is scrolled in the second direction to display the second portion of the list of information, and the second portion is different from the first portion.
  • the scroll display means that the information list continuously shifts the information list at a certain speed, and at this time, the scroll display is stopped until the gesture input for stopping the scroll display is detected.
  • the scroll bar may be set in the scroll area. The input object touches and drags the scroll bar to achieve page turning of the information list.
  • the scroll area 704 may be a display area parallel to the selection area 601, which may be used to display information.
  • the display area of the list may be a display area other than the selection area 601, or may be part or all of the information display area 603 including the information for describing the candidate object.
  • a first portion of the information list displayed on the touch display screen is located in the scroll area 704 on the touch display screen, detecting movement of the input object in contact with the touch display screen 417b, in response to the movement of the contact 417b, in the second direction (Fig.
  • the black arrow 703 in 22 moves up the display information list displayed on the touch display screen to display the rest of the information list except the first portion, thereby performing page display and scrolling of the information list based on the contact detection of the scroll area 704. Display or page turning, etc.
  • a continuous moving contact 417a of the input object and the touch display screen is detected in the selection area 601 for identifying an instruction for performing batch selection of a plurality of candidate object objects, and displaying the selected or unselected symbol symbols corresponding to the plurality of candidate objects in response to the instruction .
  • a selection area and a scroll area are respectively set on the touch display screen.
  • the user slides in the selection area the corresponding candidate object is selected, and the list does not scroll; while in the scroll area, the list scrolls and the corresponding candidate object is not selected.
  • the user's operation is very convenient and greatly improves the user experience.
  • step S711 may be further included to control the medical detecting device to detect the detected object to obtain the medical detection data.
  • the detection object here may be any one or more living or non-living tissue structures.
  • the shape, size, and position of the selection area 601 and the scroll area 704 can be flexibly set according to actual conditions (for example, the position, length, width of the list, the overall layout of each element displayed on the touch screen, etc.).
  • actual conditions for example, the position, length, width of the list, the overall layout of each element displayed on the touch screen, etc.
  • the specific details of the method steps in FIG. 23 can also be referred to the related descriptions in the foregoing, and will not be repeated here.
  • an embodiment of the present invention further provides a medical detection system, including:
  • step S611 to step S630 The above-mentioned medical detection system is used to perform step S611 to step S630 in FIG. 4, and therefore each of the modules is specifically included to perform step S611, step S610, and step S620, respectively, according to the detailed description of steps S611 to S630 in the foregoing. And the module or unit of the subdivision step or the refinement step in each specific embodiment in step S630.
  • the front is placed in “for”, and the "module or unit” is placed at the end of the step for obtaining the subdivision structure of each module of the medical detection system in this embodiment.
  • a medical detection system comprising:
  • the above control system for an electronic device with a touch display screen is used to perform steps S711 to S750 in FIG. 23, and thus each of the modules is specifically included for use according to the detailed description of steps S711 to S750 in the foregoing.
  • the modules or units of the subdivision step or the refinement step in the specific embodiments in step S711 to step S750 are respectively performed.
  • the step is preceded by "for" and placed at the end of the step "module or unit” for obtaining the subdivision structure of the various modules of the control system for the electronic device with touch display in this embodiment.
  • the technical solution of the present invention which is essential or contributes to the prior art, may be embodied in the form of a software product carried on a non-transitory computer readable storage carrier (eg ROM, disk, optical disk, server cloud space, including a number of instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to execute the system structure and method of various embodiments of the present invention.
  • a non-transitory computer readable storage carrier eg ROM, disk, optical disk, server cloud space, including a number of instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to execute the system structure and method of various embodiments of the present invention.
  • the present invention provides a use based on the above method and system.
  • a touch display such as a medical detection system
  • memory 160 stores one or more software programs, modules, and data structures similar to programs, modules, and data structures or subsets thereof.
  • the one or more processors respectively implement the method illustrated in FIG. 4 or FIG. 23 by calling a program, module, and data structure of the memory 160, modules, and data structures, or a subset thereof, for display on the touch display 130.
  • the information list displays the attribute information of the candidate object.
  • the memory 160 may also store programs, modules, and data structures or subsets thereof that are not embodied or labeled in FIG. 1 or in FIG. 4, FIG.
  • Each of the units or modules used to perform the various steps in FIG. 4 may be stored in one or more of the aforementioned memories, while the above embodiments are used to implement the touch display of FIG. 4 or FIG. 23, respectively.
  • the module or the program ie, the instruction set
  • the various sub-blocks of these modules may be combined or rearranged in various embodiments, and thus, in some embodiments of the invention, memory 160 may store a subset of modules or data structures as described above.
  • the processor may be configured to call an instruction stored in the memory, and execute displaying a plurality of candidate objects on the touch display screen, detecting continuous moving contact of the input object with the touch display screen, and responding
  • the continuously moving contact marks a step of attribute information corresponding to a plurality of candidate objects associated with the continuous moving contact, wherein the attribute information includes two selectable and opposite states.
  • the processor may be configured to invoke an instruction stored in the memory and execute a first portion of displaying a list of information including a plurality of candidate objects on the touch display screen, detecting the input object and the touch display screen Contacting, determining that the contact corresponds to an operating position on the touch display screen, and when the operating position is within the selected area on the touch display screen, marking the list of information in response to the continuous moving contact of the input object within the selected area Part of the continuous moving contact Attribute information corresponding to the plurality of candidate objects; when the operation position is located in the scroll area on the touch display screen, moving the display information list displayed on the touch display screen in response to the movement of the contact of the input object in the scroll area To display at least a portion of the remainder of the list of information other than the first portion.
  • the processor may be configured to invoke an instruction stored in the memory and execute a first portion of displaying a list of information including a plurality of candidate objects on the touch display screen, detecting the input object and the touch display screen Contacting, determining that the contact correspond
  • the embodiment of the present invention further provides a medical detection system with a touch display screen.
  • the medical detection device includes: an ultrasonic detection device that transmits ultrasonic waves to the detection object through a probe, Ultrasound echoes are received and ultrasound image data is obtained as medical test data.
  • the ultrasonic detecting device (see the foregoing detailed description) and the electronic device with a touch display screen (such as a medical detecting system) as described above, the ultrasonic detecting device 300 communicates with the electronic device via a wireless or wired signal.
  • the medical detection system can include a memory 160, a touch display screen 130, and a medical detection device, and the medical detection device can be used to acquire medical detection data, such as the ultrasonic detection device of FIG.
  • the ultrasonic image data can be obtained as the medical detection data after the ultrasonic wave is transmitted to the detection object by the probe.
  • the medical detection system may further include: a data processing module and a control module.
  • the data processing module is configured to process the medical detection data, and generate a plurality of candidate objects that are associated with the medical detection data. For example, the data processing module in FIG.
  • the ultrasonic medical test data mentioned above includes medical detection data for recording the ultrasonic detection result, which may be ultrasonic image data, parameter detection data obtained according to ultrasonic image detection (for example, size and position of a tissue such as a long diameter of a skull), Medical test data such as configuration parameters for ultrasound imaging that can be accessed or input by the user according to the requirements of access, editing, and modification.
  • the index table can be easily viewed or accessed by the user, and the index table can be established according to the patient.
  • the name, number, organization name, date, etc. by displaying the index table on the touch display screen, can select the candidate object displayed therein to enter the relevant ultrasonic medical detection data display interface, and the index table can be regarded as a primary directory list. For example, if the information list records a list of patient names, numbers, etc., then one or more patient names, numbers, etc. (each name, number, etc. corresponding to an alternate object) can be entered to enter the corresponding ultrasound medical test data reading interface. A comparison of ultrasound medical test data under, or multiple patients, is displayed under the interface.
  • the index information of the information list directly displays the relevant content of the ultrasound medical detection data so that the user can directly locate the relevant ultrasound medical detection data for which he wants to know the details.
  • the processing of the ultrasound image data mentioned in this embodiment is intended to store an ultrasound image and establish index information for retrieval or searching.
  • a control module for displaying the plurality of candidate objects on a touch display screen, detecting continuous moving contact of the input object with the touch display screen, and marking a plurality of alternatives associated with the continuous moving contact in response to the continuous moving contact
  • the attribute information corresponding to the object The control module combines the software module or hardware structure of the gesture detection module, the touch display screen and its controller provided in FIG. 1 to implement its corresponding functions.
  • the control module in this embodiment can be used to implement the control method described in FIG. 4.
  • the foregoing multiple devices may be implemented by multiple processors or a single processor, and the invention may be implemented based on the system architecture of the software layer based on the related hardware layer architecture in combination with the foregoing explanation about FIG. 1 .
  • the purpose of batch selection of multiple candidate objects is achieved by a single gesture input.
  • the data processing module is configured to process the medical detection data, and generate a list of information including a plurality of candidate objects associated with the medical detection data.
  • a control module configured to display a first portion of the information list including the plurality of candidate objects on the touch display screen, detect contact of the input object with the touch display screen, and determine that the contact corresponds to an operation position on the touch display screen
  • the first part of the marked information list is continuously moved
  • Contacting attribute information corresponding to the plurality of candidate objects
  • the operation position is within the scroll area on the touch display screen, moving the display information displayed on the touch display screen in response to the movement of the contact of the input object in the scroll area
  • the list displays at least a portion of the remainder of the list of information except the first portion.
  • the control module combines the software module or hardware structure of the gesture detection module, the touch display screen and its controller provided in FIG. 1 to implement its corresponding functions.
  • the control module in this embodiment can be used to implement the control method described in FIG. 23.
  • the foregoing multiple systems may be implemented by multiple processors or a single processor, and the invention may be implemented based on the system architecture of the software layer based on the relevant hardware layer architecture in combination with the foregoing explanation of FIG.
  • the purpose of batch selection of multiple candidate objects is achieved by a single gesture input.
  • the foregoing control module and the data processing module in the foregoing embodiments may be separately configured or may be uniformly configured.
  • the processing may be performed based on one or more processing of the processor boards on different independent devices.
  • the data processing module can be implemented by a motherboard, and the control module can be implemented by another motherboard. As another example, it can be done based on one or more processors provided on the same motherboard, respectively.
  • the touch display screen of Figure 1 can be combined with a medical detection device or can be provided separately from the medical detection device. On the independent medical detection device with a touch display screen, the main board 110 and the main board 306 in FIG. 1 can be integrated to obtain a processor integrated with multiple functions, and the data processing module and the control module can be used by the processor. to realise.
  • control module and the data processing module may be implemented based on the processor 110 in FIG. 1, and the corresponding program module, instruction set, and the like are obtained by a computer program and stored in the memory. It will not be described in detail herein, and may be combined with the detailed description in FIG. 1 above.
  • the information list in each of the foregoing embodiments may be an index table, but is not limited to only an index table, and may also be a list of information stored in other formats. And the number of rows and columns of the above index table can be freely defined according to actual conditions, such as one row or one column, or multiple rows and columns, and the like.
  • the technology of the present invention relates to an electronic device with a touch display screen, and more particularly to an ultrasonic detecting device with a touch display screen, and more particularly to realizing a list candidate object selection function on a touch display screen.
  • the prior art further relates to the implementation of a batch selection function for ultrasonic medical test data on an ultrasonic testing device with a touch display.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

La présente invention concerne un système de détection médicale et son procédé de commande. Le procédé comprend : une étape d'affichage, sur un écran d'affichage tactile (130), d'une liste d'informations comprenant une pluralité d'objets alternatifs (800) (S610) ; une étape de détection d'un contact mobile continu entre un objet d'entrée (417) et l'écran d'affichage tactile (130) (S620) ; et une étape de marquage, en réponse au contact mobile continu, d'informations d'attribut concernant la pluralité d'objets alternatifs (800) (S630). Au moyen d'une commande tactile sur l'écran d'affichage tactile (130), un utilisateur peut effectuer de manière commode et rapide une sélection par lots sur la pluralité d'objets alternatifs (800), ce qui permet ainsi d'améliorer la commodité d'une opération d'utilisateur et d'améliorer l'expérience d'utilisateur.
PCT/CN2016/081338 2016-05-06 2016-05-06 Système de détection médicale et son procédé de commande WO2017190360A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201680041178.8A CN107850832B (zh) 2016-05-06 2016-05-06 一种医疗检测系统及其控制方法
PCT/CN2016/081338 WO2017190360A1 (fr) 2016-05-06 2016-05-06 Système de détection médicale et son procédé de commande

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/081338 WO2017190360A1 (fr) 2016-05-06 2016-05-06 Système de détection médicale et son procédé de commande

Publications (1)

Publication Number Publication Date
WO2017190360A1 true WO2017190360A1 (fr) 2017-11-09

Family

ID=60202791

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/081338 WO2017190360A1 (fr) 2016-05-06 2016-05-06 Système de détection médicale et son procédé de commande

Country Status (2)

Country Link
CN (1) CN107850832B (fr)
WO (1) WO2017190360A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112967796A (zh) * 2019-12-13 2021-06-15 深圳迈瑞生物医疗电子股份有限公司 体外诊断设备的非接触式控制方法、设备及存储介质

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113741300B (zh) * 2021-09-13 2023-05-26 中国科学院深圳先进技术研究院 信息标记系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102473069A (zh) * 2009-07-28 2012-05-23 索尼公司 显示控制设备、显示控制方法和计算机程序
CN102662573A (zh) * 2012-03-24 2012-09-12 上海量明科技发展有限公司 通过触压获得选择项的方法及终端
CN103313650A (zh) * 2010-11-11 2013-09-18 卓尔医学产品公司 急诊处理系统信息面板
WO2013148730A2 (fr) * 2012-03-26 2013-10-03 Teratech Corporation Système ultrasonore de tablette
CN103890695A (zh) * 2011-08-11 2014-06-25 视力移动技术有限公司 基于手势的接口系统和方法

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102023749A (zh) * 2010-12-02 2011-04-20 广东宝莱特医用科技股份有限公司 医疗设备触摸屏界面上列表型控件的区域拖动处理方法
JP2014199572A (ja) * 2013-03-29 2014-10-23 パナソニックヘルスケア株式会社 データ通信装置、プログラム
CN105335091A (zh) * 2015-11-11 2016-02-17 百度在线网络技术（北京）有限公司 一种用于选中文件的方法和装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102473069A (zh) * 2009-07-28 2012-05-23 索尼公司 显示控制设备、显示控制方法和计算机程序
CN103313650A (zh) * 2010-11-11 2013-09-18 卓尔医学产品公司 急诊处理系统信息面板
CN103890695A (zh) * 2011-08-11 2014-06-25 视力移动技术有限公司 基于手势的接口系统和方法
CN102662573A (zh) * 2012-03-24 2012-09-12 上海量明科技发展有限公司 通过触压获得选择项的方法及终端
WO2013148730A2 (fr) * 2012-03-26 2013-10-03 Teratech Corporation Système ultrasonore de tablette

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112967796A (zh) * 2019-12-13 2021-06-15 深圳迈瑞生物医疗电子股份有限公司 体外诊断设备的非接触式控制方法、设备及存储介质

Also Published As

Publication number Publication date
CN107850832B (zh) 2020-11-10
CN107850832A (zh) 2018-03-27

Similar Documents

Publication Publication Date Title
CN109061985B (zh) 用于相机效果的用户界面
KR101997896B1 (ko) 초음파 장치 및 초음파 장치의 정보 제공 방법
US9753639B2 (en) Device, method, and graphical user interface for displaying content associated with a corresponding affordance
KR101167248B1 (ko) 터치 인터랙션을 사용하는 초음파 진단 장치
US11704142B2 (en) Computer application with built in training capability
JP2021191429A (ja) 医療画像のアノテーションのための装置、方法、及びシステム
CN103513920A (zh) 与超声系统交互的系统和方法
CN109069108B (zh) 超声医学检测设备、传输控制方法以及成像系统和终端
US11751850B2 (en) Ultrasound unified contrast and time gain compensation control
CN108958627A (zh) 触控操作方法、装置、存储介质及电子设备
JP2010102395A (ja) 画像処理装置、画像処理方法およびプログラム
KR20160044401A (ko) 복수의 디스플레이부를 이용한 정보 제공 방법 및 이를 위한 초음파 장치
US8457924B2 (en) Control system and method using an ultrasonic area array
US20140010042A1 (en) Sonar Preview Mode
WO2017190360A1 (fr) Système de détection médicale et son procédé de commande
CN109069104B (zh) 超声医学检测设备及成像控制方法、成像系统、控制器
CN109069105B (zh) 超声医学检测设备及成像控制方法、成像系统、控制器
JP2014082605A (ja) 情報処理装置、その制御方法及びプログラム
WO2022057604A1 (fr) Procédé d'affichage d'informations, dispositif associé, équipement médical associé, et support de stockage associé
US20130298077A1 (en) Display control apparatus capable of placing objects on screen according to position attributes of the objects, control method therefor, and storage medium
CN113208602B (zh) 心电波形的处理方法、心电图机和可读存储介质
JP2014160416A (ja) 閲覧システム及びプログラム
CN114625294A (zh) 智能终端虚拟导航键的操作方法、装置、终端和存储介质
CN112668380A (zh) 心电波形的数据测量方法、心电图机和装置
CN112947804B (zh) 一种用于测量设备的控制方法、系统、设备及介质

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16900882

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 26.03.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 16900882

Country of ref document: EP

Kind code of ref document: A1