WO2013173001A1 - Monitoring behavioral features in a mobile multiprocessor platform - Google Patents

Monitoring behavioral features in a mobile multiprocessor platform Download PDF

Info

Publication number
WO2013173001A1
WO2013173001A1 PCT/US2013/035952 US2013035952W WO2013173001A1 WO 2013173001 A1 WO2013173001 A1 WO 2013173001A1 US 2013035952 W US2013035952 W US 2013035952W WO 2013173001 A1 WO2013173001 A1 WO 2013173001A1
Authority
WO
WIPO (PCT)
Prior art keywords
behavior
processor
master
mobile device
processing core
Prior art date
Application number
PCT/US2013/035952
Other languages
French (fr)
Inventor
Anil GATHALA
Rajarshi Gupta
Original Assignee
Qualcomm Incorporated
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Incorporated filed Critical Qualcomm Incorporated
Priority to CN201380024849.6A priority Critical patent/CN104303156B/en
Priority to JP2015512656A priority patent/JP6110482B2/en
Priority to EP13718700.1A priority patent/EP2850524B1/en
Publication of WO2013173001A1 publication Critical patent/WO2013173001A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/50Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
    • G06F21/55Detecting local intrusion or implementing counter-measures
    • G06F21/552Detecting local intrusion or implementing counter-measures involving long-term monitoring or reporting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3003Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/3006Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1415Saving, restoring, recovering or retrying at system level
    • G06F11/1433Saving, restoring, recovering or retrying at system level during software upgrading
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1458Management of the backup or restore process
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3065Monitoring arrangements determined by the means or processing involved in reporting the monitored data
    • G06F11/3072Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting
    • G06F11/3082Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting the data filtering being achieved by aggregating or compressing the monitored data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3466Performance evaluation by tracing or monitoring
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/50Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
    • G06F21/55Detecting local intrusion or implementing counter-measures
    • G06F21/554Detecting local intrusion or implementing counter-measures involving event detection and direct action
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/50Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
    • G06F21/55Detecting local intrusion or implementing counter-measures
    • G06F21/56Computer malware detection or handling, e.g. anti-virus arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00Machine learning
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W12/00Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/12Detection or prevention of fraud
    • H04W12/128Anti-malware arrangements, e.g. protection against SMS fraud or mobile malware
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W24/00Supervisory, monitoring or testing arrangements
    • H04W24/08Testing, supervising or monitoring using real traffic
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W52/00Power management, e.g. TPC [Transmission Power Control], power saving or power classes
    • H04W52/02Power saving arrangements
    • H04W52/0209Power saving arrangements in terminal devices
    • H04W52/0251Power saving arrangements in terminal devices using monitoring of local events, e.g. events related to user activity
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W52/00Power management, e.g. TPC [Transmission Power Control], power saving or power classes
    • H04W52/02Power saving arrangements
    • H04W52/0209Power saving arrangements in terminal devices
    • H04W52/0251Power saving arrangements in terminal devices using monitoring of local events, e.g. events related to user activity
    • H04W52/0258Power saving arrangements in terminal devices using monitoring of local events, e.g. events related to user activity controlling an operation mode according to history or models of usage information, e.g. activity schedule or time of day
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3466Performance evaluation by tracing or monitoring
    • G06F11/3476Data logging
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/86Event-based monitoring
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/14Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic
    • H04L63/1433Vulnerability analysis
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W12/00Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/12Detection or prevention of fraud
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W88/00Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
    • H04W88/02Terminal devices
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Definitions

  • Wireless service providers are now able to offer their customers an ever- expanding array of features and services, and provide users with unprecedented levels of access to information, resources, and communications.
  • mobile electronic devices e.g., cellular phones, tablets, laptops, etc.
  • SoCs system-on-chips
  • This complexity has created new opportunities for malicious software, software conflicts, hardware faults, and other similar errors or phenomena to negatively impact a mobile device's long-term and continued performance and power utilization levels.
  • new and improved solutions for identifying and correcting conditions and/or mobile device behaviors that may negatively impact the mobile device's long term and continued performance and power utilization levels will be beneficial to consumers.
  • the various aspects include a method of monitoring behaviors of a mobile computing device by observing in a non-master processing core a portion of a mobile device behavior that is relevant to the non-master processing core, generating in the non-master processing core a behavior signature that describes the observed portion of the mobile device behavior, sending the generated behavior signature to a master processing core, combining two or more behavior signatures received from non-master processing cores in the master processing core to generate a global behavior vector, and providing the global behavior vector to an analyzer module for processing.
  • processing by the analyzer module may include determining whether a software application is benign or not benign based on the generated behavior vector.
  • the method may include generating a task graph in the master core, and combining two or more behavior signatures in the master processing core to generate a global behavior vector may include combining the two or more behavior signatures based on the generated task graph.
  • the method may include monitoring in the master processing core a distribution of sub-tasks of a single application to one or more non-master cores.
  • monitoring the distribution of sub-tasks may include monitoring calls to a transport layer of the mobile device.
  • FIG. 1 Further aspects may include a computing device having a memory, a master processor and one or more non-master processors coupled to the memory.
  • Each of the one or more non- master processors may be configured with processor-executable instructions to perform operations that may include observing in a non-master processing core a portion of a mobile device behavior that is relevant to the non-master processing core, generating in the non-master processing core a behavior signature that describes the observed portion of the mobile device behavior, and sending the generated behavior signature to a master processor.
  • the master processor may be configured with processor-executable instructions to perform operations that may include combining two or more behavior signatures received from non-master processing cores in the master processing core to generate a global behavior vector, and providing the global behavior vector to an analyzer module for processing.
  • the master processor may be configured with processor- executable instructions to perform operations that further include determining whether a software application is benign or not benign based on the generated behavior vector in the analyzer module.
  • the master processor may be configured with processor-executable instructions to perform operations further including generating a task graph, and the master processor may be configured with processor-executable instructions such that combining two or more behavior signatures to generate a global behavior vector may include combining the two or more behavior signatures based on the generated task graph.
  • the master processor may be configured with processor-executable instructions to perform operations that further include monitoring a distribution of sub-tasks of a single application to the non-master processors.
  • the master processor may be configured with processor-executable instructions such that monitoring the distribution of sub- tasks may include monitoring calls to a transport layer of the mobile device.
  • Further aspects may include a computing device having multiple heterogeneous cores, and means for observing in a non-master processing core a portion of a mobile device behavior that is relevant to the non-master processing core, means for generating in the non-master processing core a behavior signature that describes the observed portion of the mobile device behavior, means for sending the generated behavior signature to a master processing core, means for combining two or more behavior signatures received from non-master processing cores in the master processing core to generate a global behavior vector, and means for providing the global behavior vector to an analyzer module for processing.
  • the computing device may include means for generating a task graph in the master core, and means for combining two or more behavior signatures in the master processing core to generate a global behavior vector may include means for combining the two or more behavior signatures based on the generated task graph.
  • the computing device may include means for monitoring in the master processing core a distribution of sub- tasks of a single application to one or more non-master cores.
  • means for monitoring the distribution of sub-tasks may include means for monitoring calls to a transport layer of the mobile device
  • FIG. 10 Further aspects include a non-transitory server-readable storage medium having stored thereon processor-executable instructions configured cause a heterogeneous multiprocessor system (e.g., of mobile computing device) to perform various operations, including observing in a non-master processing core a portion of a mobile device behavior that is relevant to the non-master processing core, generating in the non-master processing core a behavior signature that describes the observed portion of the mobile device behavior, sending the generated behavior signature to a master processing core, combining two or more behavior signatures received from non-master processing cores in the master processing core to generate a global behavior vector, and providing the global behavior vector to an analyzer module for processing.
  • the stored processor-executable software instructions may be configured to cause a processor to perform operations further including processing the global behavior vector by the analyzer module to determine whether a software application is benign or not benign based on the generated behavior vector.
  • the stored processor-executable software instructions may be configured to cause a processor to perform operations including generating a task graph in the master core, and wherein the stored processor- executable software instructions may be configured to cause a processor to perform operations such that combining two or more behavior signatures in the master processing core to generate a global behavior vector may include combining the two or more behavior signatures based on the generated task graph.
  • the stored processor-executable software instructions may be configured to cause a processor to perform operations including monitoring in the master processing core a distribution of sub-tasks of a single application to one or more non-master cores.
  • the stored processor-executable software instructions may be configured to cause a processor to perform operations such that monitoring the distribution of sub-tasks may include monitoring calls to a transport layer of the mobile device
  • FIG. 1 is an architectural diagram of an example system on chip suitable for implementing the various aspects.
  • FIG. 2 is an architectural diagram of an example multicore processor suitable for implementing the various aspects.
  • FIG. 3 is a block diagram illustrating example logical components and information flows in a computing system configured to perform dynamic and adaptive observations in a heterogeneous platform in accordance with the various aspects.
  • FIG. 3 is a block diagram illustrating example logical components and information flows in a computing system configured to perform dynamic and adaptive observations in a heterogeneous platform in accordance with the various aspects.
  • FIG. 4 is an illustration of an application task graph that characterizes the behavior of a software application distributed across multiple heterogeneous processing cores and is suitable for use in combining partial behavior signatures in accordance with various aspects.
  • FIG. 5 is another illustration of an application task graph that
  • FIG. 6 is a block diagram illustrating example logical components and information flows in an aspect heterogeneous multiprocessor system having a master core and two secondary cores.
  • FIG. 7 is a block diagram illustrating example logical components and information flows in an observer module of a computing system configured to perform dynamic and adaptive observations in accordance with an aspect.
  • FIG. 8 is a block diagram illustrating logical components and information flows in a computing system implementing an aspect observer daemon.
  • FIG. 9 is a process flow diagram illustrating an aspect method for performing adaptive observations on mobile devices.
  • FIG. 10 is a process flow diagram illustrating aspect method for performing adaptive observations on mobile device having multiple
  • FIG. 11 is a process flow diagram illustrating another aspect method for performing adaptive observations on mobile devices.
  • FIG. 12 is a component block diagram of mobile device suitable for use with the various aspects.
  • FIG. 13 is an illustration of an example mobile device suitable for use with the various aspects.
  • FIG. 14 is an illustration of an example server computer suitable for use with the various aspects.
  • mobile computing device and “mobile device” are used interchangeably herein to refer to any one or all of cellular telephones, smartphones, personal or mobile multi-media players, personal data assistants (PDA's), laptop computers, tablet computers, smartbooks, ultrabooks, palm- top computers, wireless electronic mail receivers, multimedia Internet enabled cellular telephones, wireless gaming controllers, and similar personal electronic devices which include a memory, a programmable processor for which performance is important, and operate under battery power such that power conservation methods are of benefit. While the various aspects are particularly useful for mobile computing devices, such as smartphones, which have limited processing power and battery life, the aspects are generally useful in any computing device that includes multiple heterogeneous processors/cores suitable for executing application programs.
  • multiprocessor computing systems configured to execute the methods, for performing behavior detection and analysis operations in a mobile device having multiple distributed or heterogeneous computational units (e.g., processors, cores, etc.) to efficiently identify, prevent, and/or correct the conditions and mobile device behaviors that have a high potential to contribute to the
  • the behavior analysis operations may include identifying the overall behavior of a single software application whose operations are distributed across a plurality of heterogeneous cores. This may be achieved by observing or monitoring a partial mobile device behavior in each of the plurality of heterogeneous cores and using a task graph to recombine the observed partial mobile device behaviors in a main processor/core (e.g., CPU, applications processor, etc.) to generate a behavior vector suitable for use in determining whether the overall behavior of the software application or mobile device is consistent with normal operating patterns of that mobile device.
  • a main processor/core e.g., CPU, applications processor, etc.
  • a partial mobile device behavior may be a portion of a mobile device behavior that is relevant to the monitoring core, such as the portions that have access to the same memory and processing resources as the processing core, portions that are executed by the processing core, portions that invoke functions/operations on the processing core, etc.
  • SOC system on chip
  • IC integrated circuit
  • a single SOC may contain circuitry for digital, analog, mixed-signal, and radio-frequency functions, as well as any number of general purpose and/or specialized processors (digital signal processors, modem processors, video processors, etc.), memory blocks (e.g., ROM, RAM, Flash, etc.), and resources (e.g., timers, voltage regulators, oscillators, etc.).
  • SOCs may also include software for controlling the integrated resources and processors, as well as for controlling peripheral devices.
  • SIP system in a package
  • a SIP may include a single substrate on which multiple IC chips or semiconductor dies are stacked in a vertical configuration.
  • the SIP may include one or more multi-chip modules (MCMs) on which multiple ICs or semiconductor dies are packaged into a unifying substrate.
  • MCMs multi-chip modules
  • a SIP may also include multiple independent SOCs coupled together via high speed communication circuitry and packaged in close proximity, such as on a single motherboard or in a single mobile computing device. The proximity of the SOCs facilitates high speed communications and the sharing of memory and resources, as well as for more coordinated cooperation and synchronization between the components in the SOCs.
  • multiprocessor and “multiprocessor computing system” are used herein to refer to a system or device that includes two or more
  • multicore processor is used herein to refer to a single integrated circuit (IC) chip or chip package that contains two or more ICs.
  • a SOC may include multiple multicore processors, and each processor in an SOC may be referred to as a core.
  • context information is used herein to refer to any information available to a thread or process running in a host operating system (e.g., Android, Windows 8, LINUX, etc.), and may include operational state data and
  • Such operational state data may include the process's address space, stack space, virtual address space, register set image (e.g. program counter, stack pointer, instruction register, program status word, etc.), accounting information, permissions, access restrictions, and state information.
  • register set image e.g. program counter, stack pointer, instruction register, program status word, etc.
  • these solutions are typically limited to detecting known viruses and malware, and do not address the multiple complex factors and/or the interactions that often combine to contribute to a mobile device's degradation over time (e.g., when the performance degradation is not caused by viruses or malware).
  • existing anti-virus, firewall, and encryption products do not provide adequate solutions for identifying the mobile device behaviors that may contribute to that mobile device's performance degradation over time.
  • Mobile devices are resource constrained systems that have relatively limited processing, memory, and energy resources. Modern mobile devices are also complex systems, and there are a large variety of factors that may contribute to the degradation in performance and power utilization levels of a mobile device over time, including poorly designed software applications, malware, viruses, fragmented memory, background processes, etc. Due to the number, variety, and complexity of these factors, it is often not feasible to evaluate all the factors that may contribute to the degradation in performance and/or power utilization levels of the complex yet resource-constrained systems of modern mobile devices.
  • the various aspects include multiprocessor mobile devices, systems, and methods for efficiently identifying, analyzing, classifying, modeling, preventing, and/or correcting the conditions and/or mobile device behaviors that often degrade a mobile device's performance and/or power utilization levels over time from a limited (coarse) set of behavior observations.
  • the various aspects improve the efficiency and the performance and power consumption characteristics of the mobile device.
  • a single software application may be broken down into several sub-tasks, each of which may be scheduled onto (or performed in) a different processing core. That is, different portions of a software application may perform operations (e.g., API calls) on different individual processing cores, and the application's behavior may be spread (or distributed) across the different heterogeneous processing cores. For this reason, it is often difficult/challenging to obtain a complete picture of an application's behavior across multiple heterogeneous processing cores without cumbersome or exhaustive communications or coordination between the processing cores.
  • operations e.g., API calls
  • the various aspects may identify, analyze and/or respond to mobile device behaviors and conditions that have a high potential to negatively impact the mobile device without consuming an excessive amount of the mobile device's battery or processing resources.
  • each of the processing cores may be configured with a different operating system and/or implement different hardware description languages (HDL) or instruction set architectures (ISA).
  • HDL hardware description languages
  • ISA instruction set architectures
  • RPC/RMI mechanisms may provide an interface that allows a calling process on a first processing core to cause an operation, service, or process to execute in a second processing core, and for the second processing core to send the results of the execution back to the first processing core.
  • the first processing core requires access to information that is not readily available to the processes that do not share the same context as the operation, service, or process executed on the second processing core.
  • existing RPC/RMI solutions require that the second processing core include in the results all the context information (i.e., state information, permissions, etc.) that is to be used by the called service.
  • each processing core may be required to collect a large amount of behavior information, and send all the collected behavior information and context information to another processing core for analysis.
  • communicating such large amounts of information between the processing cores is an inefficient use of mobile device resources, and may degrade or reduce the performance and power consumption characteristics of the mobile device.
  • Mobile devices are resource constrained systems that have relatively limited processing, memory and energy resources. Therefore, cumbersome or exhaustive approaches to (or methods of) coordinating the operations of the multiple processing cores in order to observe or monitor a software application or behavior are not well suited for use in mobile devices. For example, transferring API logs (e.g., via memory read/write operations) and context information from slave or secondary processing cores to a master or primary processing core (i.e., the main applications processor core or CPU) can result in prohibitive overheads, particularly for the battery-driven mobile devices.
  • API logs e.g., via memory read/write operations
  • context information from slave or secondary processing cores i.e., the main applications processor core or CPU
  • the various aspects overcome the limitations existing solutions by providing mobile devices having one or more secondary processing cores configured to observe a portion of a mobile device behavior and generate a behavior signature that identifies the most relevant features of the observed mobile device behavior from the perspective of the monitoring secondary processing core.
  • Each secondary processing core may send the generated behavior signature to a primary processing core of the mobile device, which may intelligently combine the behavior signatures received from the secondary processing cores (e.g., via a task graph) and generate a global behavior vector that identifies a complete behavior of a distributed software application or a complete mobile device behavior.
  • the mobile device may then use the generated behavior vector to identify, classify, model, prevent, and/or correct the conditions and behaviors that have a high potential to negatively impact the mobile device.
  • an master observer process, daemon, module, or sub-system (herein collectively referred to as a "module") of a primary processing core of the mobile device may instrument or coordinate various application programming interfaces (APIs) at various levels of the mobile device system and collect behavior information from the instrumented APIs.
  • the master observer module may receive partial/incomplete behavior signatures generated in slave observer modules of secondary processing cores. Each partial/incomplete behavior signature may succinctly describe a portion of the overall behavior of the mobile device or software application observed (e.g., via the instrumented APIs) in the secondary processing core in a value or vector data-structure (e.g., in the form of a string of numbers, state machine, etc.).
  • Each partial/incomplete behavior signature may also describe the overall behavior of the mobile device or software application from the perspective of, or from within the context of, a secondary processing core.
  • a partial/incomplete behavior signature may describe portions of a software application executed by a secondary processing core or which accessed memory or processing resources available to the secondary processing core.
  • the master observer module in the primary processing core may use a task graph to recombine the partial/incomplete behavior signatures received from the secondary processing cores to generate a behavior vector suitable for use in determining whether the overall behavior of the software application or mobile device is consistent with normal operating patterns of that mobile device.
  • Each behavior vector may succinctly describe the overall behavior of the mobile device or a specific software application in a value or vector data- structure (e.g., in the form of a string of numbers, state machine, etc.).
  • the master observer module may send the generated behavior vector to an analyzer module (e.g., via a memory write operation, etc.) of the mobile device, which may generate spatial and/or temporal correlations based on information included in the behavior vector and/or information collected from various other mobile device sub-systems.
  • the generated spatial and/or temporal correlations may be used by various modules (e.g., by an actuation module, etc.) of the mobile device to identify and/or respond to behaviors that are determined to have a high probably of negatively impacting the mobile device's performance or battery consumption levels.
  • the primary processing core of the mobile device may be on the same chip or substrate as the secondary processing cores.
  • one or more of the secondary processing core may be on a different chip or substrate as the primary processing core.
  • the master and secondary processing cores may each be configured with a different operating system and/or implement different hardware description languages or instruction set architectures.
  • the primary and secondary processing cores may be in the same SIP, SOC, chip, substrate, circuit, or microprocessor.
  • FIG. 1 is an architectural diagram illustrating an example system- on-chip (SOC) 100 architecture that may be used in computing devices implementing the various aspects.
  • the SOC 100 may include a number of heterogeneous processors, such as a digital signal processor (DSP) 101, a modem processor 104, a graphics processor 106, and an application processor 108.
  • the SOC 100 may also include one or more coprocessors 110 (e.g., vector coprocessor) connected to one or more of the heterogeneous processors 101, 104, 106, 108.
  • Each processor 101, 104, 106, 108, 110 may include one or more cores, and each processor/core may perform operations independent of the other processors/cores.
  • the SOC 100 may include a processor that executes a first type of operating system (e.g., FreeBSD, LINUX, OS X, etc.) and a processor that executes a second type of operating system (e.g., Microsoft Windows 8).
  • each of the processors 101, 104, 106, 108, 110 may be a master or primary processing core, and each of the other processors 101, 104, 106, 108, 110 may be a non-master or secondary processing core.
  • the SOC 100 may also include analog circuitry and custom circuitry 114 for managing sensor data, analog-to-digital conversions, wireless data
  • the SOC 100 may further include system components and resources 116, such as voltage regulators, oscillators, phase-locked loops, peripheral bridges, data controllers, memory controllers, system controllers, access ports, timers, and other similar components and resources 116, such as voltage regulators, oscillators, phase-locked loops, peripheral bridges, data controllers, memory controllers, system controllers, access ports, timers, and other similar components and resources 116, such as voltage regulators, oscillators, phase-locked loops, peripheral bridges, data controllers, memory controllers, system controllers, access ports, timers, and other similar
  • the resources/system components 116 and custom circuitry 114 may include circuitry to interface with peripheral devices, such as cameras, electronic displays, wireless communication devices, external memory chips, etc.
  • the processors 101, 104, 106, 108 may be interconnected to one or more memory elements 112, system components, and resources 116 and custom circuitry 114 via an interconnection/bus module 124, which may include an array of reconfigurable logic gates and/or implement a bus architecture (e.g.,
  • Communications may be provided by advanced interconnects, such as high performance networks-on chip (NoCs).
  • NoCs networks-on chip
  • the SOC 100 may further include an input/output module (not illustrated) for communicating with resources external to the SOC, such as a clock 118 and a voltage regulator 120.
  • resources external to the SOC e.g., clock 118, voltage regulator 120
  • processors/cores e.g., DSP 101, modem processor 104, graphics processor 106, application processor 108, etc.
  • the SOC 100 may also include hardware and/or software components suitable for collecting sensor data from sensors, including speakers, user interface elements (e.g., input buttons, touch screen display, etc.), microphone arrays, sensors for monitoring physical conditions (e.g., location, direction, motion, orientation, vibration, pressure, etc.), cameras, compasses, global positioning system (GPS) receivers, communications circuitry (e.g., Bluetooth®, WLAN, WiFi, etc.), and other well known components (e.g., accelerometer, etc.) of modern electronic devices.
  • GPS global positioning system
  • the application processor 108 may be a master processing core, and the other processors 101, 104, 106, 110 may be non-master processing cores.
  • the application processor 108 may be a master processor, and the other processors 101, 104, 106, 110 may be a plurality of non-master processing cores or a plurality of non-master processors of a mobile device.
  • the master processor may be configured to monitor a distribution of sub-tasks of a single application to the plurality of non-master processors.
  • each non-master processor may be configured to observe a portion of a mobile device behavior that is relevant to that non-master processor and generate a behavior signature based on the observations.
  • the master processor may be configured to combine two or more behavior signatures received from two or more non-master processors in the master processor to generate a global behavior vector that describes an entire or complete mobile device behavior or application and which may be provided to an analyzer module for processing.
  • the master processor may include means for processing the global behavior vector in an analyzer module to determine whether a software application is benign or not benign.
  • FIG. 2 illustrates an example multicore processor architecture that may be used to implement the various aspects.
  • the multicore processor 202 may include two or more independent processing cores 204, 206, 230, 232 in close proximity (e.g., on a single substrate, die, integrated chip, etc.).
  • the proximity of the processing cores 204, 206, 230, 232 allows memory to operate at a much higher frequency/clock-rate than is possible if the signals have to travel off-chip.
  • the proximity of the processing cores 204, 206, 230, 232 allows for the sharing of on-chip memory and resources (e.g., voltage rail), as well as for more coordinated cooperation and synchronization between cores.
  • processing cores 204, 206, 230, 232 may be identical to one another, be heterogeneous, and/or implement different specialized functions. Thus, processing cores 204, 206, 230, 232 need not be symmetric, either from the operating system perspective (e.g., may execute different operating systems) or from the hardware perspective (e.g., may implement different instruction sets/architectures). In addition, each processing core 204, 206, 230, 232 may have exclusive control over some resources and share other resources with the other cores.
  • the processing cores 204, 206, 230, 232 may communicate with each other via the bus/interconnect interface 218, direct memory read/write operations to a shared memory, function calls, method invocations, procedure calls, message exchanges, domain sockets (e.g., Unix-domain sockets), and other forms of interprocess communication (IPC).
  • IPC interprocess communication
  • the multicore processor 202 may be a master processing core (e.g., an application processor 108, CPU, etc.) or a non-master processing core.
  • one processing core 204 may be a mater processing core and the other processing cores 206, 230, 232 may be non-master processing cores.
  • the multicore processor 202 includes a multi-level cache, which includes a plurality of Level 1 (LI) caches 212, 214, 238, 240 and Level 2 (L2) caches 216, 226, 242.
  • the multicore processor 202 also includes a bus/interconnect interface 218, a main memory 220, and an input/output module 222.
  • the L2 caches 216, 226, 242 may be larger (and slower) than the LI caches 212, 214, 238, 240, but smaller (and substantially faster) than a main memory 220 unit.
  • Each processing core 204, 206, 230, 232 may include a processing unit 208, 210, 234, 236 that has private access to an LI cache 212, 214, 238, 240.
  • the processing cores 204, 206, 230, 232 may share access to an L2 cache (e.g., L2 cache 242) or may have access to an independent L2 cache (e.g., L2 cache 216, 226).
  • the LI and L2 caches may be used to store data frequently accessed by the processing units, whereas the main memory 220 may be used to store larger files and data units being accessed by the processing cores 204, 206, 230, 232.
  • the multicore processor 202 may be configured so that the processing cores 204, 206, 230, 232 seek data from memory in order, first querying the LI cache, then L2 cache, and then the main memory if the information is not stored in the caches. If the information is not stored in the caches or the main memory 220, multicore processor 202 may seek information from an external memory and/or a hard disk memory 224.
  • Multiprocessor hardware designs may include multiple processing cores of different capabilities inside the same package, often on the same piece of silicon.
  • Symmetric multiprocessing hardware includes two or more identical processors connected to a single shared main memory that are controlled by a single operating system.
  • Asymmetric or "loosely-coupled" multiprocessing hardware may include two or more heterogeneous processors/cores that may each be controlled by an independent operating system and connected to one or more shared
  • the various aspects may include or make use of any combination of symmetric and asymmetric multiprocessing hardware systems.
  • FIG. 3 illustrates example logical components and information flows in an aspect processing core 301 of a heterogeneous multiprocessor system 300 configured to identify, prevent, and/or correct the conditions and mobile device behaviors that have a high potential to contribute to the degradation in performance and power utilization levels of the mobile device over time.
  • the processing core 301 may be a primary or master processing core.
  • the processing core 301 includes a behavior observer module 302, a behavior analyzer module 306, an external context information module 304, and an actuator module 308.
  • the processing core 301 may be configured to receive behavior signatures and other
  • Each of the modules 302-308 may be implemented in software, hardware, or any combination thereof.
  • the modules 302-308 may be implemented within parts of the operating system (e.g., within the kernel, in the kernel space, in the user space, etc.), within separate programs or applications, in specialized hardware buffers or processors, or any combination thereof.
  • one or more of the modules 302-308 may be implemented as software instructions executing on one or more processing cores of a mobile device.
  • Any of the behavior observer modules 302, 303 may be configured to instrument or coordinate application programming interfaces (APIs) at various levels/modules of the mobile device, and monitor/observe mobile device operations and events (e.g., system events, state changes, etc.) at the various levels/modules via the instrumented APIs, collect information pertaining to the observed operations/events, intelligently filter the collected information, generate one or more observations based on the filtered information, generate behavior signatures, store the generated observations and/or behavior signatures in a memory (e.g., in a log file, cache memory, etc.) and/or send (e.g., via memory writes, function calls, etc.) the generated signatures or observations to a master/primary processing core or to a behavior analyzer module 306.
  • APIs application programming interfaces
  • the behavior observer modules 302, 303 may generate behavior information from a reduced set of observations (and thus operations) that may be more readily combined with other observations/behavior information collected from other processing cores to identify, analyze and/or respond to a complete mobile device behavior or condition that has a high potential to negatively impact the mobile device.
  • the behavior signatures allow the behavior information to be communicated across/among/between multiple heterogeneous processing cores efficiently and without negatively impacting the mobile device.
  • Any of the behavior observer modules 302, 303 may monitor/observe mobile device operations and events by collecting information pertaining to library application programming interface (API) calls in an application framework or run-time libraries, system call APIs, file-system and networking sub-system operations, device (including sensor devices) state changes, and other similar events.
  • the behavior observer modules 302, 303 may also monitor file system activity, which may include searching for filenames, categories of file accesses (personal info or normal data files), creating or deleting files (e.g., type exe, zip, etc.), file read/write/seek operations, changing file permissions, etc.
  • the behavior observer modules 302, 303 may also monitor/observe data network activity, which may include types of connections, protocols, port numbers, server/client that the device is connected to, the number of connections, volume or frequency of communications, etc.
  • the behavior observer modules 302, 303 may monitor phone network activity, which may include monitoring the type and number of calls or messages (e.g., SMS, etc.) sent out, received, or intercepted (e.g., the number of premium calls placed).
  • the behavior observer modules 302, 303 may also monitor/observe the system resource usage, which may include monitoring the number of forks, memory access operations, number of files open, etc.
  • the behavior observer modules 302, 303 may monitor the state of the mobile device, which may include monitoring various factors, such as whether the display is on or off, whether the device is locked or unlocked, the amount of battery remaining, the state of the camera, etc.
  • the behavior observer modules 302, 303 may also monitor interprocess communications (IPC) by, for example, monitoring intents to crucial services (browser, contracts provider, etc.), the degree of inter-process communications, pop-up windows, etc.
  • IPC interprocess communications
  • the behavior observer modules 302, 303 may also monitor/observe driver statistics and/or the status of one or more hardware components, which may include cameras, sensors, electronic displays, WiFi communication components, data controllers, memory controllers, system controllers, access ports, timers, peripheral devices, wireless communication components, external memory chips, voltage regulators, oscillators, phase-locked loops, peripheral bridges, and other similar components used to support the processors and clients running on the mobile computing device.
  • hardware components may include cameras, sensors, electronic displays, WiFi communication components, data controllers, memory controllers, system controllers, access ports, timers, peripheral devices, wireless communication components, external memory chips, voltage regulators, oscillators, phase-locked loops, peripheral bridges, and other similar components used to support the processors and clients running on the mobile computing device.
  • the behavior observer modules 302, 303 may also monitor/observe one or more hardware counters that denote the state or status of the mobile computing device and/or mobile device sub-systems.
  • a hardware counter may include a special-purpose register of the processors/cores that is configured to store a count or state of hardware-related activities or events occurring in the mobile computing device.
  • the behavior observer modules 302, 303 may also monitor/observe actions or operations of software applications, software downloads from an application download server (e.g., Apple® App Store server), mobile device information used by software applications, call information, text messaging information (e.g., SendSMS, BlockSMS, ReadSMS, ec ), media messaging information (e.g., ReceiveMMS), user account information, location information, camera information, accelerometer information, browser information, content of browser-based communications, content of voice-based communications, short range radio communications (e.g., Bluetooth, WiFi, etc.), content of text-based communications, content of recorded audio files, phonebook or contact information, contacts lists, etc.
  • an application download server e.g., Apple® App Store server
  • mobile device information used by software applications call information
  • text messaging information e.g., SendSMS, BlockSMS, ReadSMS, ec
  • media messaging information e.g., ReceiveMMS
  • user account information e.g., location information, camera information, accelerometer information, browser
  • the behavior observer modules 302, 303 may monitor/observe
  • VoiceMailComm voicemail
  • Device identifiers UserAccountComm
  • UserAccountComm user account information
  • CalendarComm calendar information
  • CalendarComm location information
  • RecordAudioComm recorded audio information
  • accelerometer information accelerometer information
  • the behavior observer modules 302, 303 may monitor/observe usage of and updates/changes to compass information, mobile device settings, battery life, gyroscope information, pressure sensors, magnet sensors, screen activity, etc.
  • the behavior observer modules 302, 303 may monitor/observe notifications communicated to and from a software application (AppNotifications), application updates, etc.
  • the behavior observer modules 302, 303 may monitor/observe conditions or events pertaining to a first software application requesting the downloading and/or install of a second software application.
  • the behavior observer modules 302, 303 may monitor/observe conditions or events pertaining to user verification, such as the entry of a password, etc.
  • the behavior observer modules 302, 303 may monitor/observe conditions or events at multiple levels of the mobile device, including the application level, radio level, and sensor level.
  • Application level observations may include observing the user via facial recognition software, observing social streams, observing notes entered by the user, observing events pertaining to the use of PassBook /Google Wallet /Paypal, etc.
  • Application level observations may also include observing events relating to the use of virtual private networks (VPNs) and events pertaining to
  • voice searches e.g., voice control (e.g., lock/unlock a phone by saying one word)
  • language translators e.g., the offloading of data for computations, video streaming, camera usage without user activity, microphone usage without user activity, etc.
  • Radio level observations may include determining the presence, existence or amount of any or more of: user interaction with the mobile device before establishing radio communication links or transmitting information, dual/multiple SIM cards, Internet radio, mobile phone tethering, offloading data for computations, device state communications, the use as a game controller or home controller, vehicle communications, mobile device synchronization, etc. Radio level observations may also include monitoring the use of radios (WiFi, WiMax, Bluetooth, etc.) for positioning, peer-to-peer (p2p) communications,
  • Radio level observations may further include monitoring network traffic usage, statistics, or profiles.
  • Sensor level observations may include monitoring a magnet sensor or other sensor to determine the usage and/or external environment of the mobile device.
  • the mobile device processor may be configured to determine whether the phone is in a holster (e.g., via a magnet sensor configured to sense a magnet within the holster) or in the user's pocket (e.g., via the amount of light detected by a camera or light sensor).
  • Detecting that the mobile device is in a holster may be relevant to recognizing suspicious behaviors, for example, because activities and functions related to active usage by a user (e.g., taking photographs or videos, sending messages, conducting a voice call, recording sounds, etc.) occurring while the mobile device is holstered could be signs of nefarious processes executing on the device (e.g., to track or spy on the user).
  • activities and functions related to active usage by a user e.g., taking photographs or videos, sending messages, conducting a voice call, recording sounds, etc.
  • activities and functions related to active usage by a user e.g., taking photographs or videos, sending messages, conducting a voice call, recording sounds, etc.
  • the mobile device is holstered could be signs of nefarious processes executing on the device (e.g., to track or spy on the user).
  • sensor level observations related to usage or external environments include, detecting near-field communications (NFC), collecting information from a credit card scanner, barcode scanner, or mobile tag reader, detecting the presence of a USB power charging source, detecting that a keyboard or auxiliary device has been coupled to the mobile device, detecting that the mobile device has been coupled to a computing device (e.g., via USB, etc.), determining whether an LED, flash, flashlight, or light source has been modified or disabled (e.g., maliciously disabling an emergency signaling app, etc.), detecting that a speaker or microphone has been turned on or powered, detecting a charging or power event, detecting that the mobile device is being used as a game controller, etc.
  • NFC near-field communications
  • a computing device e.g., via USB, etc.
  • determining whether an LED, flash, flashlight, or light source e.g., maliciously disabling an emergency signaling app, etc.
  • detecting that a speaker or microphone has been turned on or powered
  • Sensor level observations may also include collecting information from medical or healthcare sensors or from scanning the user's body, collecting information from an external sensor plugged into the USB/audio jack, collecting information from a tactile or haptic sensor (e.g., via a vibrator interface, etc.), collecting information pertaining to the thermal state of the mobile device, etc.
  • the behavior observer modules 302, 303 may perform coarse observations by monitoring/observing an initial set of behaviors or factors that are a small subset of all factors that could contribute to the mobile device's degradation.
  • the initial set of behaviors and/or subset of the factors may be selected by analysis of benign and problematic applications on mobile devices.
  • the behavior observer module 302, 303 may receive the initial set of behaviors and/or factors from another processing core (e.g., master processing core, etc.), a network server, or a component in a cloud service provider network.
  • the behavior analyzer module 306 may receive behavior vectors from the behavior observer module 302 and compare them to one or more behavior modules to determine whether a particular mobile device behavior, software application, or process is performance-degrading/malicious, benign, or suspicious.
  • the behavior analyzer module 306 may also compare the received information (i.e., observations) with contextual information received from the external context information module 304 to identify subsystems, processes, and/or applications that are contributing to (or are likely to contribute to) the device's degradation over time or which may otherwise cause problems on the mobile device.
  • the behavior analyzer module 306 may include intelligence for utilizing a limited set of information (i.e., coarse observations) to identify behaviors, processes, or programs that are contributing to— or are likely to contribute to— the device's degradation over time, or which may otherwise cause problems on the device.
  • the behavior analyzer module 306 may be configured to analyze information (e.g., in the form of observations) collected from the various processing cores and modules (e.g., the behavior observer module 302, external context information module 304, etc.), learn the normal operational behaviors of the mobile device, and generate or update one or more behavior vectors based the results of the comparisons.
  • the behavior analyzer module 306 may send the generated behavior vectors to the actuator module 308, which may perform various actions or operations to correct mobile device behaviors determined to be malicious or performance-degrading and/or perform operations to heal, cure, isolate, or otherwise fix the identified problem.
  • the behavior analyzer module 306 may notify the behavior observer module 302, which may adjust the adjust the granularity of its observations (i.e., the level of detail at which mobile device behaviors are observed) and/or change the behaviors that are observed based on information received from the behavior analyzer module 306 (e.g., results of the real-time analysis operations), generate or collect new or additional behavior information, and send the new/additional information to the behavior analyzer module 306 for further analysis/classification.
  • the behavior observer module 302 may adjust the adjust the granularity of its observations (i.e., the level of detail at which mobile device behaviors are observed) and/or change the behaviors that are observed based on information received from the behavior analyzer module 306 (e.g., results of the real-time analysis operations), generate or collect new or additional behavior information, and send the new/additional information to the behavior analyzer module 306 for further analysis/classification.
  • Such feedback communications between the behavior observer module 302 and the behavior analyzer module 306 enable the mobile device to recursively increase the granularity of the observations (i.e., make finer or more detailed observations) or change the features/behaviors that are observed until a source of a suspicious or performance-degrading mobile device behavior is identified, until a processing or batter consumption threshold is reached, or until the mobile device processor determines that the source of the suspicious or performance-degrading mobile device behavior cannot be identified from further increases in observation granularity.
  • FIG. 4 is an illustration of an application task graph that characterizes the complete behavior of a software application distributed across multiple heterogeneous processing cores and which is suitable for use in combining partial behavior signatures in accordance with various aspects.
  • a task may be any module, execution block, logic, or unit of code that may be represented in an application task graph 402 and which identifies a complete or unified behavior of a software application.
  • a task may include a plurality of subtasks 404, each of which may be a minimal execution block, module, logic, or unit of code within the task that is sufficiently independent of the other sub-tasks/execution blocks that it may be mapped onto, or moved to, a different processing core.
  • a subtask 404 may be a module that includes any number of (e.g., thousands of) operations or lines of code, and which is sufficiently independent and self-contained so that it may be shifted to another core.
  • a subtask 404 may be any module, logic, or unit of code with clearly defined inputs and outputs and which may be moved, mapped, or shifted to another processing core.
  • a software application may be broken down into several sub-tasks, each of which may be scheduled onto a different core. That is, different portions of a software application may perform operations (e.g., API calls) on different individual cores, and the application's behavior may be spread across the different cores. For this reason, it is often difficult/challenging to obtain a complete picture of an application's behavior across the multiple heterogeneous cores/processing units.
  • operations e.g., API calls
  • the mobile device may be configured to generate a task graph that characterizes the complete behavior of a software application distributed across multiple heterogeneous processing cores as a function of parameters, API calls, parameter values, and timestamps.
  • the task graph may be used to obtain a complete picture of an application's behavior across the multiple heterogeneous processing cores.
  • FIG. 5 is another illustration of an application task graph that
  • FIG. 5 illustrates that the application task graph 402, and thus the overall or complete behavior of a software application, may be equal to the sum of the subtasks included in each of the plurality of heterogeneous processing cores (Cores 1-3).
  • the various aspects may reduce or avoid cumbersome communications or exhaustive approaches to coordinating the operations of the multiple cores by generating behavior signatures in the secondary cores and communicating the behavior signatures (instead of API logs) the across cores.
  • the master processing core may receive and combine the partial signatures in a meaningful fashion (i.e., via the task graph, based on time, using an action- sequence-number, etc.) to obtain the overall behavior of the software application.
  • FIG. 6 illustrates example logical components and information flows in an aspect heterogeneous multiprocessor system 600 that includes a master core 602 and two secondary cores 604, 606.
  • the secondary cores 604, 606 may be on the same or a different chip as the master processing core 602. Communications between the processing cores may be facilitated by a heterogonous transport protocol 620 module (e.g., a bus, IPC, network-on-chip, fabric, etc.).
  • a heterogonous transport protocol 620 module e.g., a bus, IPC, network-on-chip, fabric, etc.
  • the master core 602 includes a master behavior observer module 302 that includes a global behavior detection unit 610 module, a local behavior detection unit 612 module, a task graph 614 module, a work distribution monitor 616 module, and a local observation 618 module.
  • Each of the secondary cores 604, 606 may include a slave behavior observer module 303 that includes a local behavior detection unit 612 module and a local observation 618 module.
  • the local behavior detection unit 612 modules may be configured to interpret local observations in their respective cores and provide a behavior signature to the global behavior detection unit 610 module for each software application being monitored.
  • Each slave behavior observer module 303 may monitor one or more activities (e.g., important APIs) in its respective secondary core 604, 606, generate a signature of the monitored activity that describes the behavior of the software application with respect to that particular core 604, 606 (and is thus a signature of a partial-behavior of the application).
  • the behavior signature may be generated from behavior information collected by the slave behavior observer module 303 and succinctly describe portions of the mobile device behavior in a value or vector data- structure (e.g., in the form of a string of numbers, etc.).
  • the behavior signature may function as an identifier and/or a certification that enables the master processing core to quickly recognize and identify a sub-task and its position in the application task graph 402 without performing any additional, cumbersome, or power intensive analysis or verification operations.
  • the slave behavior observer module 303 may send the generated signature to the master behavior observer module 302, which may use the application task graph 402 to combine the partial/incomplete behavior signatures to
  • the work distribution monitor 616 may be configured to keep track of how the operations/work (i.e., sub-tasks) within a single application are being distributed to the various secondary cores 604, 606, which may be achieved by monitoring calls to the transport layer, the heterogonous transport protocol 620 module, or to the global behavior detection unit 610 module.
  • the work distribution monitor 616 may also generate and maintain the application task graph 402 (i.e., a concurrent execution pattern) for use by the global behavior detection unit, which may use local behavior signatures received from the secondary cores 604, 606 in conjunction with the task graph 402 to generate a behavior vector that describes the overall behavior of the software application. This behavior vector may then be sent to the behavior analyzer module 306 and used to identify behaviors that have a high probably of negatively impacting the mobile device's performance or battery consumption levels.
  • FIG. 7 illustrates example logical components and information flows in an behavior observer module 302 of a computing system configured to perform dynamic and adaptive observations in accordance with an aspect.
  • the behavior observer module 302 may include an adaptive filter module 702, a throttle module 704, an observer mode module 706, a high-level behavior detection module 708, a behavior vector generator 710, and a secure buffer 712.
  • the high- level behavior detection module 708 may include a spatial correlation module 714 and a temporal correlation module 716.
  • the observer mode module 706 may receive control information from various sources, which may include an analyzer unit (e.g., the behavior analyzer module 306 described above with reference to FIG. 3) and/or an application API.
  • the observer mode module 706 may send control information pertaining to various observer modes to the adaptive filter module 702 and the high-level behavior detection module 708.
  • the adaptive filter module 702 may receive data/information from multiple sources, and intelligently filter the received information to generate a smaller subset of information selected from the received information. This filter may be adapted based on information or control received from the analyzer module, or a higher- level process communicating through an API. The filtered information may be sent to the throttle module 704, which may be responsible for controlling the amount of information flowing from the filter to ensure that the high-level behavior detection module 708 does not become flooded or overloaded with requests or information.
  • the high-level behavior detection module 708 may receive
  • the high-level behavior detection module 708 may use the received information to perform spatial and temporal correlations to detect or identify high level behaviors that may cause the device to perform at sub-optimal levels.
  • the results of the spatial and temporal correlations may be sent to the behavior vector generator 710, which may receive the correlation information and generate a behavior vector that describes the behaviors of particular process, application, or sub-system.
  • the behavior vector generator 710 may generate the behavior vector such that each high-level behavior of a particular process, application, or sub-system is an element of the behavior vector.
  • the generated behavior vector may be stored in a secure buffer 712.
  • Examples of high-level behavior detection may include detection of the existence of a particular event, the amount or frequency of another event, the relationship between multiple events, the order in which events occur, time differences between the occurrence of certain events, etc.
  • the behavior observer module 302 may perform adaptive observation techniques and control the observation granularity based on information received from a variety of sources.
  • the high-level behavior detection module 708 may receive information from the throttle module 704, the observer mode module 706, and context information received from other components (e.g., sensors) of the mobile device.
  • a high-level behavior detection module 708 performing temporal correlations might detect that a camera has been used and that the mobile device is attempting to upload the picture to a server.
  • the high-level behavior detection module 708 may also perform spatial correlations to determine whether an application on the mobile device took the picture while the device was holstered and attached to the user' s belt.
  • the high- level behavior detection module 708 may determine whether this detected high- level behavior (e.g., usage of the camera while holstered) is a behavior that is acceptable or common, which may be achieved by comparing the current behavior with past behaviors of the mobile device and/or accessing information collected from a plurality of devices (e.g., information received from a crowd- sourcing server). Since taking pictures and uploading them to a server while holstered is an unusual behavior (as may be determined from observed normal behaviors in the context of being holstered), in this situation the high-level behavior detection module 708 may recognize this as a potentially threatening behavior and initiate an appropriate response (e.g., shutting off the camera, sounding an alarm, etc.).
  • this detected high- level behavior e.g., usage of the camera while holstered
  • a behavior that is acceptable or common which may be achieved by comparing the current behavior with past behaviors of the mobile device and/or accessing information collected from a plurality of devices (e.g., information received from a
  • the behavior observer module 302 may be implemented in multiple parts.
  • FIG. 8 illustrates logical components and information flows in a computing system 800 implementing an aspect observer daemon.
  • the computing system 800 includes a behavior detector 802 module, a database engine 804 module, and a behavior analyzer module 306 in the user space, and a ring buffer 814, a filter rules 816 module, a throttling rules 818 module, and a secure buffer 820 in the kernel space.
  • the computing system 800 may further include an observer daemon that includes the behavior detector 802 and the database engine 804 in the user space, and the secure buffer manager 806, the rules manager 808, and the system health monitor 810 in the kernel space.
  • the various aspects may provide cross-layer observations on mobile devices encompassing webkit, SDK, NDK, kernel, drivers, and hardware in order to characterize system behavior.
  • the behavior observations may be made in real time.
  • the observer module may perform adaptive observation techniques and control the observation granularity. As discussed above, there are a large number (i.e., thousands) of factors that could contribute to the mobile device's degradation, and it may not be feasible to monitor/observe all of the different factors that may contribute to the degradation of the device's performance. To overcome this, the various aspects dynamically identify the relevant behaviors that are to be observed, and dynamically determine the level of detail at which the identified behaviors are to be observed.
  • FIG. 9 illustrates an example method 900 for performing dynamic and adaptive observations in accordance with an aspect.
  • the mobile device processor may perform coarse observations by monitoring/observing a subset of large number factors/behaviors that could contribute to the mobile device's degradation.
  • the mobile device processor may generate a behavior vector characterizing the coarse observations and/or the mobile device behavior based on the coarse observations.
  • the mobile device processor may identify subsystems, processes, and/or applications associated with the coarse observations that may potentially contribute to the mobile device's degradation. This may be achieved, for example, by comparing information received from multiple sources with contextual information received from sensors of the mobile device.
  • the mobile device processor may perform behavioral analysis operations based on the coarse observations.
  • the mobile device processor may determine whether suspicious behaviors or potential problems can be identified and corrected based on the results of the behavioral analysis.
  • the processor may initiate a process to correct the behavior and return to block 902 to perform additional coarse observations.
  • the mobile device processor may determine whether there is a likelihood of a problem.
  • the mobile device processor may determine that there is a likelihood of a problem by computing a probability of the mobile device encountering potential problems and/or engaging in suspicious behaviors, and determining whether the computed probability is greater than a predetermined threshold.
  • the processor may return to block 902 to perform additional coarse observations.
  • the mobile device processor may perform deeper logging/observations or final logging on the identified subsystems, processes or applications.
  • the mobile device processor may perform deeper and more detailed observations on the identified subsystems, processes or applications.
  • the mobile device processor may perform further and/or deeper behavioral analysis based on the deeper and more detailed observations.
  • the mobile device processor may again determine whether the suspicious behaviors or potential problems can be identified and corrected based on the results of the deeper behavioral analysis.
  • the processor may repeat the operations in blocks 910-914 until the level of detail is fine enough to identify the problem or until it is determined that the problem cannot be identified with additional detail or that no problem exists.
  • the mobile device processor may perform operations to correct the problem/behavior, and the processor may return to block 902 to perform additional operations.
  • the mobile device processor may perform real-time behavior analysis of the system's behaviors to identify suspicious behavior from limited and coarse observations, to
  • FIG. 10 illustrates an example master observer method 1000 for performing observations on a mobile device processor in accordance with an aspect.
  • slave observer modules in each of the slave or secondary processing cores may repeatedly monitor mobile device activities in their respective cores, generate a behavior signature based on the monitored activities, and send the generated signature to the master processing core (Master Core).
  • Master Core master processing core
  • a master observer module of the master or primary processing core may monitor calls to the transport layer and generate a task graph.
  • the master observer module may receive behavior signatures from the slave/secondary processing cores (Core 1, Core 2, Core n).
  • the master observer module may combine the received behavior signatures with behavior information collected on the master core to generate a global behavior vector.
  • the master observer module may send the generated global behavior vector to an analyzer module for further analysis.
  • FIG. 11 illustrates another example method 1100 for perform dynamic and adaptive observations by a mobile device processor in accordance with another aspect.
  • the mobile device processor may dynamically identify the relevant behaviors that are to be observed on the mobile device.
  • the mobile device processor may dynamically determine the level of detail at which the identified behaviors are to be observed. In optional block 1106, the mobile device processor may dynamically adapt to what is being observed. In optional block 1108, the mobile device processor may dynamically change or update the parameters, factors, behaviors, processes, applications, and/or subsystems that are to be observed. The operations of blocks 1102-1108 may be repeated continuously or as is necessary to improve the mobile device performance (e.g., battery power consumption, processing speed, network communication speeds, etc.).
  • a mobile computing device 102 may include a circuit board 1202 of electronic components, some or all of which may be integrated into an on-chip system, that includes a control processor 1201 coupled to memory 1204.
  • the control processor 1201 may further be coupled to a digital signal processor 1206 and/or an analog signal processor 1208, which also be coupled together.
  • the control processor 1201 and a digital signal processor 1206 may be the same component or may be integrated into the same processor chip.
  • a display controller 1210 and a touchscreen controller 1212 may be coupled to the control processor 1201 and to a display/touchscreen 1214 within or connected to the mobile computing device 102.
  • the control processor 1201 may also be coupled to removable memory 1216 (e.g., an SD memory or SIM card in the case of mobile computing devices) and/or to external memory 1218, such as one or more of a disk drive, CD drive, and a DVD drive.
  • removable memory 1216 e.g., an SD memory or SIM card in the case of mobile computing devices
  • external memory 1218 such as one or more of a disk drive, CD drive, and a DVD drive.
  • the control processor 1201 may also be coupled to a
  • USB controller 1220 which couples to a USB port 1222.
  • a power supply 1221 may be coupled to the circuit board 1202 through the USB controller 1220 or through different electrical connections to provide power (e.g., DC power) to the various electronic components.
  • the control processor 1201 may also be coupled to a video encoder 1224, e.g., a phase alternating line (PAL) encoder, a sequential 07 a memoire (SECAM) encoder, or a national television system(s) committee (NTSC) encoder. Further, the video encoder 1224 may be coupled to a video amplifier 1226 which may be coupled to the video encoder 1224 and
  • a video port 1228 may be coupled to the video amplifier 1226 to enable connecting the mobile computing device 102 to an external monitor, television or other display (not shown).
  • the control processor 1201 may be coupled to a radio frequency (RF) transceiver 1230, such as via an analog signal processor 1208.
  • the RF transceiver 1230 may be coupled to an RF antenna 1218 for transmitting and receiving RF signals.
  • the RF transceiver 1230 may be configured to transmit and receive communication signals of one or more different wireless
  • communication protocols including, for example, cellular telephone (e.g., G-3, UMTS, CDMA, etc.), WiFi, WiMax, and Bluetooth.
  • cellular telephone e.g., G-3, UMTS, CDMA, etc.
  • WiFi Wireless Fidelity
  • WiMax Wireless Fidelity
  • Bluetooth Wireless Fidelity
  • the control processor 1201 may further be coupled to a network card 1232 which may be coupled to a network connector 1231 and/or the RF transceiver 1230 and configured to enable communications via an external network (e.g., local area networks, the Internet, an intranet, WiFi networks, Bluetooth networks, personal area network (PAN) etc.)
  • the network card 1232 may be in the form of a separate chip or card, or may be implemented as part of the control processor 1201 or the RF transceiver 1230 (or both) as a full solution communication chip.
  • a number of analog devices may be coupled to the control processor 1201 via the analog signal processor 1208, such as a keypad 1234.
  • a keypad or keyboard may include its own processor so that the interface with the control processor 1201 may be via direct connection (not shown), via a network connection (e.g., via the network card), or via the USB port 1222.
  • a digital camera 1236 may be coupled to the control processor 1201.
  • the digital camera 1236 may be a charge-coupled device (CCD) camera or a complementary metal-oxide semiconductor (CMOS) camera.
  • CMOS complementary metal-oxide semiconductor
  • the digital camera 1236 may be built into the mobile computing device 102 or coupled to the device by an external cable.
  • an audio CODEC 1238 may be coupled to the analog signal processor 1208 and configured to send sound signals to one or more speakers 1240 via an audio amplifier 1242.
  • the audio CODEC 1238 may also be coupled to a microphone amplifier 1244 which may be coupled to a microphone 1246 (e.g., via a microphone jack).
  • a headphone jack 1248 may also be coupled to the audio CODEC 1238 for outputting audio to headphones.
  • the mobile computing device 102 may include a separate RF receiver circuit 1250 which may be coupled to an antenna 1252 for receiving broadcast wireless communication signals.
  • the receiver circuit 1250 may be configured to receive broadcast television signals (e.g., EBMS broadcasts), and provide received signals to the DSP 1206 for processing.
  • the receiver circuit 1250 may be configured to receive FM radio signals, in which case the received signals may be passed to the Audio CODEC 1238 for processing.
  • processor-executable instructions for accomplishing one or more of the method operations described above may be stored in the internal memory 1204, removable memory 1216 and/or non-volatile memory 1218 (e.g., as on a hard drive, CD drive, or other storage accessible via a network). Such processor-executable instructions may be executed by the control processor 1201 in order to perform the methods described herein.
  • the various aspects may be implemented on a variety of mobile computing devices, an example of which is illustrated in FIG. 13 in the form of a smartphone.
  • a smartphone 1300 may include a processor 1301 coupled to internal memory 1302, a display 1303, and to a speaker.
  • the smartphone 1300 may include an antenna 1304 for sending and receiving electromagnetic radiation that may be connected to a wireless data link and/or cellular telephone transceiver 1305 coupled to the processor 1301.
  • Smartphone 1300 typically also include menu selection buttons or rocker switches 1306 for receiving user inputs.
  • a typical smartphone 1300 also includes a sound encoding/decoding (CODEC) circuit 1312, which digitizes sound received from a microphone into data packets suitable for wireless transmission and decodes received sound data packets to generate analog signals that are provided to the speaker to generate sound.
  • CODEC sound encoding/decoding
  • one or more of the processor 1301, wireless transceiver 1305 and CODEC 1312 may include a digital signal processor (DSP) circuit (not shown separately).
  • DSP digital signal processor
  • Portions of the aspect methods may be accomplished in a client-server architecture with some of the processing occurring in a server, such as maintaining databases of normal operational behaviors, which may be accessed by a mobile device processor while executing the aspect methods.
  • Such aspects may be implemented on any of a variety of commercially available server devices, such as the server 1400 illustrated in FIG. 14.
  • a server 1400 typically includes a processor 1401 coupled to volatile memory 1402 and a large capacity nonvolatile memory, such as a disk drive 1403.
  • the server 1400 may also include a floppy disc drive, compact disc (CD) or DVD disc drive 1411 coupled to the processor 1401.
  • the server 1400 may also include network access ports 1404 coupled to the processor 1401 for establishing data connections with a network 1405, such as a local area network coupled to other broadcast system computers and servers.
  • the processors 1301, 1401 may be any programmable microprocessor, microcomputer or multiple processor chip or chips that can be configured by software instructions (applications) to perform a variety of functions, including the functions of the various aspects described below. In some mobile devices, multiple processors 1301 may be provided, such as one processor dedicated to wireless communication functions and one processor dedicated to running other applications. Typically, software applications may be stored in the internal memory 1302, 1402, 1403 before they are accessed and loaded into the processor 1301, 1401.
  • the processor 1301, 1401 may include internal memory sufficient to store the application software instructions.
  • a component As used in this application, the terms “component,” “module,” “system,” “service,” “engine,” “listener,” “manager,” and the like are intended to include a computer-related entity, such as, but not limited to, hardware, firmware, a combination of hardware and software, software, or software in execution, which are configured to perform particular operations or functions.
  • a component may be, but is not limited to, a process running on a processor, a processor, an object, an executable, a thread of execution, a program, and/or a computer.
  • an application running on a computing device and the computing device may be referred to as a component.
  • One or more components may reside within a process and/or thread of execution and a component may be localized on one processor or core, and/or distributed between two or more processors or cores. In addition, these components may execute from various non-transitory computer readable media having various instructions and/or data structures stored thereon. Components may communicate by way of local and/or remote processes, function or procedure calls, electronic signals, data packets, memory read/writes, and other known computer, processor, and/or process related communication methodologies.
  • DSP digital signal processor
  • ASIC application specific integrated circuit
  • FPGA field programmable gate array
  • a general-purpose processor may be a multiprocessor, but, in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine.
  • a processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a multiprocessor, a plurality of multiprocessors, one or more multiprocessors in conjunction with a DSP core, or any other such configuration. Alternatively, some steps or methods may be performed by circuitry that is specific to a given function.
  • the functions described may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored as one or more instructions or code on a non-transitory computer readable storage medium, non-transitory computer-readable medium or non-transitory processor-readable medium. The steps of a method or algorithm disclosed herein may be embodied in a processor- executable software module which may reside on a non-transitory computer- readable or processor-readable storage medium.
  • Non-transitory computer- readable or processor-readable storage media may be any storage media that may be accessed by a computer or a processor.
  • non-transitory computer-readable or processor-readable media may include RAM, ROM, EEPROM, FLASH memory, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that may be used to store desired program code in the form of instructions or data structures and that may be accessed by a computer.
  • Disk and disc includes compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk, and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above are also included within the scope of non-transitory computer- readable and processor-readable media.
  • the operations of a method or algorithm may reside as one or any combination or set of codes and/or instructions on a non-transitory processor-readable medium and/or computer- readable medium, which may be incorporated into a computer program product.

Abstract

Methods, devices and systems for monitoring behaviors of a mobile computing device include observing in a non-master processing core a portion of a mobile device behavior that is relevant to the non-master processing core, generating a behavior signature that describes the observed portion of the mobile device behavior, and sending the generated behavior signature to a master processing core. The master processing core combines two or more behavior signatures received from the non-master processing cores to generate a global behavior vector, which may be used by an analyzer module to determine whether a distributed software application is benign or not benign.

Description

ADAPTIVE OBSERVATION OF BEHAVIORAL
FEATURES ON A HETEROGENEOUS PLATFORM
RELATED APPLICATIONS
[0001] This application claims the benefit of priority to U.S. Provisional Patent Application No. 61/646,590 entitled "System, Apparatus and Method for
Adaptive Observation of Mobile Device Behavior" filed May 14, 2012; and U.S. Provisional Application No. 61/683,274, entitled "System, Apparatus and Method for Adaptive Observation of Mobile Device Behavior" filed August 15, 2012, the entire contents of both which are hereby incorporated by reference for all purposes.
BACKGROUND
[0002] Cellular and wireless communication technologies have seen explosive growth over the past several years. This growth has been fueled by better communications, hardware, larger networks, and more reliable protocols.
Wireless service providers are now able to offer their customers an ever- expanding array of features and services, and provide users with unprecedented levels of access to information, resources, and communications. To keep pace with these service enhancements, mobile electronic devices (e.g., cellular phones, tablets, laptops, etc.) have become more powerful and complex than ever, and now commonly include multiple processors, system-on-chips (SoCs), and other resources that allow mobile device users to execute complex and power intensive software applications (e.g., video streaming, video processing, etc.) on their mobile devices. This complexity has created new opportunities for malicious software, software conflicts, hardware faults, and other similar errors or phenomena to negatively impact a mobile device's long-term and continued performance and power utilization levels. Accordingly, new and improved solutions for identifying and correcting conditions and/or mobile device behaviors that may negatively impact the mobile device's long term and continued performance and power utilization levels will be beneficial to consumers. SUMMARY
[0003] The various aspects include a method of monitoring behaviors of a mobile computing device by observing in a non-master processing core a portion of a mobile device behavior that is relevant to the non-master processing core, generating in the non-master processing core a behavior signature that describes the observed portion of the mobile device behavior, sending the generated behavior signature to a master processing core, combining two or more behavior signatures received from non-master processing cores in the master processing core to generate a global behavior vector, and providing the global behavior vector to an analyzer module for processing.
[0004] In an aspect, processing by the analyzer module may include determining whether a software application is benign or not benign based on the generated behavior vector. In a further aspect, the method may include generating a task graph in the master core, and combining two or more behavior signatures in the master processing core to generate a global behavior vector may include combining the two or more behavior signatures based on the generated task graph. In a further aspect, the method may include monitoring in the master processing core a distribution of sub-tasks of a single application to one or more non-master cores. In a further aspect, monitoring the distribution of sub-tasks may include monitoring calls to a transport layer of the mobile device.
[0005] Further aspects may include a computing device having a memory, a master processor and one or more non-master processors coupled to the memory. Each of the one or more non- master processors may be configured with processor-executable instructions to perform operations that may include observing in a non-master processing core a portion of a mobile device behavior that is relevant to the non-master processing core, generating in the non-master processing core a behavior signature that describes the observed portion of the mobile device behavior, and sending the generated behavior signature to a master processor. The master processor may be configured with processor-executable instructions to perform operations that may include combining two or more behavior signatures received from non-master processing cores in the master processing core to generate a global behavior vector, and providing the global behavior vector to an analyzer module for processing.
[0006] In an aspect, the master processor may be configured with processor- executable instructions to perform operations that further include determining whether a software application is benign or not benign based on the generated behavior vector in the analyzer module. In a further aspect, the master processor may be configured with processor-executable instructions to perform operations further including generating a task graph, and the master processor may be configured with processor-executable instructions such that combining two or more behavior signatures to generate a global behavior vector may include combining the two or more behavior signatures based on the generated task graph.
[0007] In a further aspect, the master processor may be configured with processor-executable instructions to perform operations that further include monitoring a distribution of sub-tasks of a single application to the non-master processors. In a further aspect, the master processor may be configured with processor-executable instructions such that monitoring the distribution of sub- tasks may include monitoring calls to a transport layer of the mobile device.
[0008] Further aspects may include a computing device having multiple heterogeneous cores, and means for observing in a non-master processing core a portion of a mobile device behavior that is relevant to the non-master processing core, means for generating in the non-master processing core a behavior signature that describes the observed portion of the mobile device behavior, means for sending the generated behavior signature to a master processing core, means for combining two or more behavior signatures received from non-master processing cores in the master processing core to generate a global behavior vector, and means for providing the global behavior vector to an analyzer module for processing. In an aspect, means for determining in the analyzer module whether a software application is benign or not benign based on the generated behavior vector.
[0009] In a further aspect, the computing device may include means for generating a task graph in the master core, and means for combining two or more behavior signatures in the master processing core to generate a global behavior vector may include means for combining the two or more behavior signatures based on the generated task graph. In a further aspect, the computing device may include means for monitoring in the master processing core a distribution of sub- tasks of a single application to one or more non-master cores. In a further aspect, means for monitoring the distribution of sub-tasks may include means for monitoring calls to a transport layer of the mobile device
[0010] Further aspects include a non-transitory server-readable storage medium having stored thereon processor-executable instructions configured cause a heterogeneous multiprocessor system (e.g., of mobile computing device) to perform various operations, including observing in a non-master processing core a portion of a mobile device behavior that is relevant to the non-master processing core, generating in the non-master processing core a behavior signature that describes the observed portion of the mobile device behavior, sending the generated behavior signature to a master processing core, combining two or more behavior signatures received from non-master processing cores in the master processing core to generate a global behavior vector, and providing the global behavior vector to an analyzer module for processing. In an aspect, the stored processor-executable software instructions may be configured to cause a processor to perform operations further including processing the global behavior vector by the analyzer module to determine whether a software application is benign or not benign based on the generated behavior vector.
[0011] In a further aspect, the stored processor-executable software instructions may be configured to cause a processor to perform operations including generating a task graph in the master core, and wherein the stored processor- executable software instructions may be configured to cause a processor to perform operations such that combining two or more behavior signatures in the master processing core to generate a global behavior vector may include combining the two or more behavior signatures based on the generated task graph. In a further aspect, the stored processor-executable software instructions may be configured to cause a processor to perform operations including monitoring in the master processing core a distribution of sub-tasks of a single application to one or more non-master cores. In a further aspect, the stored processor-executable software instructions may be configured to cause a processor to perform operations such that monitoring the distribution of sub-tasks may include monitoring calls to a transport layer of the mobile device
BRIEF DESCRIPTION OF THE DRAWINGS
[0012] The accompanying drawings, which are incorporated herein and constitute part of this specification, illustrate exemplary aspects of the invention, and together with the general description given above and the detailed description given below, serve to explain the features of the invention.
[0013] FIG. 1 is an architectural diagram of an example system on chip suitable for implementing the various aspects.
[0014] FIG. 2 is an architectural diagram of an example multicore processor suitable for implementing the various aspects.
[0015] FIG. 3 is a block diagram illustrating example logical components and information flows in a computing system configured to perform dynamic and adaptive observations in a heterogeneous platform in accordance with the various aspects.
[0016] FIG. 3 is a block diagram illustrating example logical components and information flows in a computing system configured to perform dynamic and adaptive observations in a heterogeneous platform in accordance with the various aspects.
[0017] FIG. 4 is an illustration of an application task graph that characterizes the behavior of a software application distributed across multiple heterogeneous processing cores and is suitable for use in combining partial behavior signatures in accordance with various aspects.
[0018] FIG. 5 is another illustration of an application task graph that
characterizes the complete behavior of a software application distributed across multiple heterogeneous processing cores and which is suitable for use in combining partial behavior signatures in accordance with various aspects.
[0019] FIG. 6 is a block diagram illustrating example logical components and information flows in an aspect heterogeneous multiprocessor system having a master core and two secondary cores.
[0020] FIG. 7 is a block diagram illustrating example logical components and information flows in an observer module of a computing system configured to perform dynamic and adaptive observations in accordance with an aspect.
[0021] FIG. 8 is a block diagram illustrating logical components and information flows in a computing system implementing an aspect observer daemon.
[0022] FIG. 9 is a process flow diagram illustrating an aspect method for performing adaptive observations on mobile devices.
[0023] FIG. 10 is a process flow diagram illustrating aspect method for performing adaptive observations on mobile device having multiple
heterogeneous processing cores.
[0024] FIG. 11 is a process flow diagram illustrating another aspect method for performing adaptive observations on mobile devices. [0025] FIG. 12 is a component block diagram of mobile device suitable for use with the various aspects.
[0026] FIG. 13 is an illustration of an example mobile device suitable for use with the various aspects.
[0027] FIG. 14 is an illustration of an example server computer suitable for use with the various aspects.
DETAILED DESCRIPTION
[0028] The various aspects will be described in detail with reference to the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts. References made to particular examples and implementations are for illustrative purposes, and are not intended to limit the scope of the invention or the claims.
[0029] The word "exemplary" is used herein to mean "serving as an example, instance, or illustration." Any implementation described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other implementations .
[0030] The terms "mobile computing device" and "mobile device" are used interchangeably herein to refer to any one or all of cellular telephones, smartphones, personal or mobile multi-media players, personal data assistants (PDA's), laptop computers, tablet computers, smartbooks, ultrabooks, palm- top computers, wireless electronic mail receivers, multimedia Internet enabled cellular telephones, wireless gaming controllers, and similar personal electronic devices which include a memory, a programmable processor for which performance is important, and operate under battery power such that power conservation methods are of benefit. While the various aspects are particularly useful for mobile computing devices, such as smartphones, which have limited processing power and battery life, the aspects are generally useful in any computing device that includes multiple heterogeneous processors/cores suitable for executing application programs.
[0031] In overview, the various aspects include methods, as well as
multiprocessor computing systems configured to execute the methods, for performing behavior detection and analysis operations in a mobile device having multiple distributed or heterogeneous computational units (e.g., processors, cores, etc.) to efficiently identify, prevent, and/or correct the conditions and mobile device behaviors that have a high potential to contribute to the
degradation in performance and power utilization levels of the mobile device over time. The behavior analysis operations may include identifying the overall behavior of a single software application whose operations are distributed across a plurality of heterogeneous cores. This may be achieved by observing or monitoring a partial mobile device behavior in each of the plurality of heterogeneous cores and using a task graph to recombine the observed partial mobile device behaviors in a main processor/core (e.g., CPU, applications processor, etc.) to generate a behavior vector suitable for use in determining whether the overall behavior of the software application or mobile device is consistent with normal operating patterns of that mobile device. A partial mobile device behavior may be a portion of a mobile device behavior that is relevant to the monitoring core, such as the portions that have access to the same memory and processing resources as the processing core, portions that are executed by the processing core, portions that invoke functions/operations on the processing core, etc.
[0032] The term "system on chip" (SOC) is used herein to refer to a single integrated circuit (IC) chip that contains multiple resources, computational units, processors and/or cores integrated on a single substrate. A single SOC may contain circuitry for digital, analog, mixed-signal, and radio-frequency functions, as well as any number of general purpose and/or specialized processors (digital signal processors, modem processors, video processors, etc.), memory blocks (e.g., ROM, RAM, Flash, etc.), and resources (e.g., timers, voltage regulators, oscillators, etc.). SOCs may also include software for controlling the integrated resources and processors, as well as for controlling peripheral devices.
[0033] The term "system in a package" (SIP) is used herein to refer to a single module or package that contains multiple resources, computational units, cores and/or processors on two or more IC chips or substrates. For example, a SIP may include a single substrate on which multiple IC chips or semiconductor dies are stacked in a vertical configuration. Similarly, the SIP may include one or more multi-chip modules (MCMs) on which multiple ICs or semiconductor dies are packaged into a unifying substrate. A SIP may also include multiple independent SOCs coupled together via high speed communication circuitry and packaged in close proximity, such as on a single motherboard or in a single mobile computing device. The proximity of the SOCs facilitates high speed communications and the sharing of memory and resources, as well as for more coordinated cooperation and synchronization between the components in the SOCs.
[0034] The terms "multiprocessor" and "multiprocessor computing system" are used herein to refer to a system or device that includes two or more
computational or processing units configured to read and execute program instructions. The term "multicore processor" is used herein to refer to a single integrated circuit (IC) chip or chip package that contains two or more
independent computational or processing units (e.g., CPU cores, IP cores, etc.) configured to read and execute program instructions. A SOC may include multiple multicore processors, and each processor in an SOC may be referred to as a core.
[0035] The term "context information" is used herein to refer to any information available to a thread or process running in a host operating system (e.g., Android, Windows 8, LINUX, etc.), and may include operational state data and
permissions and/or access restrictions that identify the operating system services, libraries, file systems, and other resources that the thread/process may access. Such operational state data may include the process's address space, stack space, virtual address space, register set image (e.g. program counter, stack pointer, instruction register, program status word, etc.), accounting information, permissions, access restrictions, and state information.
[0036] Generally, the performance and power efficiency of a mobile device degrade over time. Recently, anti-virus companies (e.g., McAfee, Symantec, etc.) have begun marketing mobile anti-virus, firewall, and encryption products that aim to slow this degradation. However, many of these solutions rely on the periodic execution of a computationally-intensive scanning engine on the mobile device, which may consume many of the mobile device's processing and battery resources, slow or render the mobile device useless for extended periods of time, and/or otherwise degrade the user experience. In addition, these solutions are typically limited to detecting known viruses and malware, and do not address the multiple complex factors and/or the interactions that often combine to contribute to a mobile device's degradation over time (e.g., when the performance degradation is not caused by viruses or malware). For these and other reasons, existing anti-virus, firewall, and encryption products do not provide adequate solutions for identifying the mobile device behaviors that may contribute to that mobile device's performance degradation over time.
[0037] Various other solutions exist for modeling the behavior of processes or application programs executing on a computing device, and such behavior models may be used to differentiate between malicious and benign
process/programs on computing devices. However, these existing modeling solutions are not suitable for use on mobile devices because such solutions generally require the execution of computationally-intensive processes that consume a significant amount of processing, memory, and energy resources, all of which may be scarce on mobile devices. In addition, these solutions are generally limited to evaluating the behavior of an individual application program or process and/or with respect to a single processor or core (herein collectively processing core), and do not provide an accurate or complete model of complex mobile device behaviors that may be distributed across multiple heterogeneous processing cores. For these and other reasons, existing modeling solutions are not suitable for use in mobile devices that include multiple heterogeneous processing cores.
[0038] Mobile devices are resource constrained systems that have relatively limited processing, memory, and energy resources. Modern mobile devices are also complex systems, and there are a large variety of factors that may contribute to the degradation in performance and power utilization levels of a mobile device over time, including poorly designed software applications, malware, viruses, fragmented memory, background processes, etc. Due to the number, variety, and complexity of these factors, it is often not feasible to evaluate all the factors that may contribute to the degradation in performance and/or power utilization levels of the complex yet resource-constrained systems of modern mobile devices.
[0039] The various aspects include multiprocessor mobile devices, systems, and methods for efficiently identifying, analyzing, classifying, modeling, preventing, and/or correcting the conditions and/or mobile device behaviors that often degrade a mobile device's performance and/or power utilization levels over time from a limited (coarse) set of behavior observations. By reducing the number of factors that are observed or monitored in each processing core, and by reducing the amount of information communicated between heterogeneous processing cores, the various aspects improve the efficiency and the performance and power consumption characteristics of the mobile device.
[0040] On a heterogeneous platform (e.g., SIP, SOC, multi-processor devices, etc.), a single software application may be broken down into several sub-tasks, each of which may be scheduled onto (or performed in) a different processing core. That is, different portions of a software application may perform operations (e.g., API calls) on different individual processing cores, and the application's behavior may be spread (or distributed) across the different heterogeneous processing cores. For this reason, it is often difficult/challenging to obtain a complete picture of an application's behavior across multiple heterogeneous processing cores without cumbersome or exhaustive communications or coordination between the processing cores. By generating a partial, incomplete, light-weight, or succinct behavior signature in each processing core to describe a portion of the application from the perspective of (or from within the context of) each individual processing core, and by efficiently communicating behavior information across/among/between multiple heterogeneous processing cores via the generated behavior signatures, the various aspects may identify, analyze and/or respond to mobile device behaviors and conditions that have a high potential to negatively impact the mobile device without consuming an excessive amount of the mobile device's battery or processing resources.
[0041] In both single and multi processor systems, processes or threads (herein collectively processes) that share, have access to, and/or operate within the same context may communicate via relatively fast memory read/write operations. On the other hand, communications between independent processes that do not share a context are often accomplished via relatively slow and expensive (e.g., in terms of performance costs, energy consumption, memory access times, etc.) function calls, method invocations, procedure calls, message exchanges, domain sockets, and other forms of inter-process communication (IPC). Remote procedure calls (RPC) and remote method invocations (RMI) are inter-process communications (IPCs) that allow a calling process to cause a subroutine, procedure, process, or service to execute in another address space, commonly on another processor, chip, or computing device.
[0042] On a heterogeneous platform, the memory and resources available to different processing cores are often in separate domains (e.g., protection domains, physical domains, etc.). In addition, each of the processing cores may be configured with a different operating system and/or implement different hardware description languages (HDL) or instruction set architectures (ISA). In such systems, RPC/RMI mechanisms may provide an interface that allows a calling process on a first processing core to cause an operation, service, or process to execute in a second processing core, and for the second processing core to send the results of the execution back to the first processing core. Often, to interpret the results, the first processing core requires access to information that is not readily available to the processes that do not share the same context as the operation, service, or process executed on the second processing core. In such situations, existing RPC/RMI solutions require that the second processing core include in the results all the context information (i.e., state information, permissions, etc.) that is to be used by the called service.
[0043] Communicating such large amounts of information (e.g., the results of a program, procedure, or service execution, etc.) between a first and second processing core via existing RPC/RMI mechanisms typically consumes an excessive amount of power, memory, and processing resources. In addition, the processing cores may have different operating systems and/or implement different hardware description languages, in which case the first processing core may be required to perform complex and power intensive operations to recreate the second processing core's context before it can interpret the execution results received from the second processing core. Recreating the context may also require modifications to the kernel or host operating system of the first processing core, which may require the execution of additional complex and power intensive operations and/or require significant modifications to the mobile device architecture. For these and other reasons, using standard RMI/RPC solutions to communicate behavior information between heterogeneous cores may degrade or reduce the performance and power consumption characteristics of a mobile device, and degrade the user experience.
[0044] When performing behavior observation and analysis operation on a heterogeneous platform, each processing core may be required to collect a large amount of behavior information, and send all the collected behavior information and context information to another processing core for analysis. However, communicating such large amounts of information between the processing cores is an inefficient use of mobile device resources, and may degrade or reduce the performance and power consumption characteristics of the mobile device.
[0045] Mobile devices are resource constrained systems that have relatively limited processing, memory and energy resources. Therefore, cumbersome or exhaustive approaches to (or methods of) coordinating the operations of the multiple processing cores in order to observe or monitor a software application or behavior are not well suited for use in mobile devices. For example, transferring API logs (e.g., via memory read/write operations) and context information from slave or secondary processing cores to a master or primary processing core (i.e., the main applications processor core or CPU) can result in prohibitive overheads, particularly for the battery-driven mobile devices.
[0046] For all of the forgoing reasons, existing solutions are not suitable for use in mobile devices that include multiple heterogeneous processing cores.
[0047] The various aspects overcome the limitations existing solutions by providing mobile devices having one or more secondary processing cores configured to observe a portion of a mobile device behavior and generate a behavior signature that identifies the most relevant features of the observed mobile device behavior from the perspective of the monitoring secondary processing core. Each secondary processing core may send the generated behavior signature to a primary processing core of the mobile device, which may intelligently combine the behavior signatures received from the secondary processing cores (e.g., via a task graph) and generate a global behavior vector that identifies a complete behavior of a distributed software application or a complete mobile device behavior. The mobile device may then use the generated behavior vector to identify, classify, model, prevent, and/or correct the conditions and behaviors that have a high potential to negatively impact the mobile device.
[0048] In an aspect, an master observer process, daemon, module, or sub-system (herein collectively referred to as a "module") of a primary processing core of the mobile device may instrument or coordinate various application programming interfaces (APIs) at various levels of the mobile device system and collect behavior information from the instrumented APIs. In an aspect, the master observer module may receive partial/incomplete behavior signatures generated in slave observer modules of secondary processing cores. Each partial/incomplete behavior signature may succinctly describe a portion of the overall behavior of the mobile device or software application observed (e.g., via the instrumented APIs) in the secondary processing core in a value or vector data-structure (e.g., in the form of a string of numbers, state machine, etc.). Each partial/incomplete behavior signature may also describe the overall behavior of the mobile device or software application from the perspective of, or from within the context of, a secondary processing core. For example, a partial/incomplete behavior signature may describe portions of a software application executed by a secondary processing core or which accessed memory or processing resources available to the secondary processing core.
[0049] The master observer module in the primary processing core may use a task graph to recombine the partial/incomplete behavior signatures received from the secondary processing cores to generate a behavior vector suitable for use in determining whether the overall behavior of the software application or mobile device is consistent with normal operating patterns of that mobile device. Each behavior vector may succinctly describe the overall behavior of the mobile device or a specific software application in a value or vector data- structure (e.g., in the form of a string of numbers, state machine, etc.).
[0050] The master observer module may send the generated behavior vector to an analyzer module (e.g., via a memory write operation, etc.) of the mobile device, which may generate spatial and/or temporal correlations based on information included in the behavior vector and/or information collected from various other mobile device sub-systems. The generated spatial and/or temporal correlations may be used by various modules (e.g., by an actuation module, etc.) of the mobile device to identify and/or respond to behaviors that are determined to have a high probably of negatively impacting the mobile device's performance or battery consumption levels.
[0051] In an aspect, the primary processing core of the mobile device may be on the same chip or substrate as the secondary processing cores. In an aspect, one or more of the secondary processing core may be on a different chip or substrate as the primary processing core. In an aspect, the master and secondary processing cores may each be configured with a different operating system and/or implement different hardware description languages or instruction set architectures. In various aspects, the primary and secondary processing cores may be in the same SIP, SOC, chip, substrate, circuit, or microprocessor.
[0052] The various aspects may be implemented in a number of different mobile devices, including single processor and multiprocessor systems, and a system-on- chip (SOC). FIG. 1 is an architectural diagram illustrating an example system- on-chip (SOC) 100 architecture that may be used in computing devices implementing the various aspects. The SOC 100 may include a number of heterogeneous processors, such as a digital signal processor (DSP) 101, a modem processor 104, a graphics processor 106, and an application processor 108. The SOC 100 may also include one or more coprocessors 110 (e.g., vector coprocessor) connected to one or more of the heterogeneous processors 101, 104, 106, 108.
[0053] Each processor 101, 104, 106, 108, 110 may include one or more cores, and each processor/core may perform operations independent of the other processors/cores. For example, the SOC 100 may include a processor that executes a first type of operating system (e.g., FreeBSD, LINUX, OS X, etc.) and a processor that executes a second type of operating system (e.g., Microsoft Windows 8). In various aspects, each of the processors 101, 104, 106, 108, 110 may be a master or primary processing core, and each of the other processors 101, 104, 106, 108, 110 may be a non-master or secondary processing core. [0054] The SOC 100 may also include analog circuitry and custom circuitry 114 for managing sensor data, analog-to-digital conversions, wireless data
transmissions, and for performing other specialized operations, such as processing encoded audio signals for games and movies. The SOC 100 may further include system components and resources 116, such as voltage regulators, oscillators, phase-locked loops, peripheral bridges, data controllers, memory controllers, system controllers, access ports, timers, and other similar
components used to support the processors and clients running on a computing device.
[0055] The resources/system components 116 and custom circuitry 114 may include circuitry to interface with peripheral devices, such as cameras, electronic displays, wireless communication devices, external memory chips, etc. The processors 101, 104, 106, 108 may be interconnected to one or more memory elements 112, system components, and resources 116 and custom circuitry 114 via an interconnection/bus module 124, which may include an array of reconfigurable logic gates and/or implement a bus architecture (e.g.,
CoreConnect, AMBA, etc.). Communications may be provided by advanced interconnects, such as high performance networks-on chip (NoCs).
[0056] The SOC 100 may further include an input/output module (not illustrated) for communicating with resources external to the SOC, such as a clock 118 and a voltage regulator 120. Resources external to the SOC (e.g., clock 118, voltage regulator 120) may be shared by two or more of the internal SOC
processors/cores (e.g., DSP 101, modem processor 104, graphics processor 106, application processor 108, etc.).
[0057] The SOC 100 may also include hardware and/or software components suitable for collecting sensor data from sensors, including speakers, user interface elements (e.g., input buttons, touch screen display, etc.), microphone arrays, sensors for monitoring physical conditions (e.g., location, direction, motion, orientation, vibration, pressure, etc.), cameras, compasses, global positioning system (GPS) receivers, communications circuitry (e.g., Bluetooth®, WLAN, WiFi, etc.), and other well known components (e.g., accelerometer, etc.) of modern electronic devices.
[0058] In an aspect, the application processor 108 may be a master processing core, and the other processors 101, 104, 106, 110 may be non-master processing cores. In an aspect, the application processor 108 may be a master processor, and the other processors 101, 104, 106, 110 may be a plurality of non-master processing cores or a plurality of non-master processors of a mobile device. In an aspect, the master processor may be configured to monitor a distribution of sub-tasks of a single application to the plurality of non-master processors. In an aspect, each non-master processor may be configured to observe a portion of a mobile device behavior that is relevant to that non-master processor and generate a behavior signature based on the observations. In an aspect, the master processor may be configured to combine two or more behavior signatures received from two or more non-master processors in the master processor to generate a global behavior vector that describes an entire or complete mobile device behavior or application and which may be provided to an analyzer module for processing. In an aspect, the master processor may include means for processing the global behavior vector in an analyzer module to determine whether a software application is benign or not benign.
[0059] In addition to the SOC 100 discussed above, the various aspects may be implemented in a wide variety of multiprocessor and multicore processor systems. FIG. 2 illustrates an example multicore processor architecture that may be used to implement the various aspects. The multicore processor 202 may include two or more independent processing cores 204, 206, 230, 232 in close proximity (e.g., on a single substrate, die, integrated chip, etc.). The proximity of the processing cores 204, 206, 230, 232 allows memory to operate at a much higher frequency/clock-rate than is possible if the signals have to travel off-chip. Moreover, the proximity of the processing cores 204, 206, 230, 232 allows for the sharing of on-chip memory and resources (e.g., voltage rail), as well as for more coordinated cooperation and synchronization between cores.
[0060] In various aspects, the processing cores 204, 206, 230, 232 may be identical to one another, be heterogeneous, and/or implement different specialized functions. Thus, processing cores 204, 206, 230, 232 need not be symmetric, either from the operating system perspective (e.g., may execute different operating systems) or from the hardware perspective (e.g., may implement different instruction sets/architectures). In addition, each processing core 204, 206, 230, 232 may have exclusive control over some resources and share other resources with the other cores.
[0061] The processing cores 204, 206, 230, 232 may communicate with each other via the bus/interconnect interface 218, direct memory read/write operations to a shared memory, function calls, method invocations, procedure calls, message exchanges, domain sockets (e.g., Unix-domain sockets), and other forms of interprocess communication (IPC).
[0062] In various aspects, the multicore processor 202 may be a master processing core (e.g., an application processor 108, CPU, etc.) or a non-master processing core. In an aspect, one processing core 204 may be a mater processing core and the other processing cores 206, 230, 232 may be non-master processing cores.
[0063] In the example illustrated in FIG. 2, the multicore processor 202 includes a multi-level cache, which includes a plurality of Level 1 (LI) caches 212, 214, 238, 240 and Level 2 (L2) caches 216, 226, 242. The multicore processor 202 also includes a bus/interconnect interface 218, a main memory 220, and an input/output module 222. The L2 caches 216, 226, 242 may be larger (and slower) than the LI caches 212, 214, 238, 240, but smaller (and substantially faster) than a main memory 220 unit. Each processing core 204, 206, 230, 232 may include a processing unit 208, 210, 234, 236 that has private access to an LI cache 212, 214, 238, 240. The processing cores 204, 206, 230, 232 may share access to an L2 cache (e.g., L2 cache 242) or may have access to an independent L2 cache (e.g., L2 cache 216, 226).
[0064] The LI and L2 caches may be used to store data frequently accessed by the processing units, whereas the main memory 220 may be used to store larger files and data units being accessed by the processing cores 204, 206, 230, 232. The multicore processor 202 may be configured so that the processing cores 204, 206, 230, 232 seek data from memory in order, first querying the LI cache, then L2 cache, and then the main memory if the information is not stored in the caches. If the information is not stored in the caches or the main memory 220, multicore processor 202 may seek information from an external memory and/or a hard disk memory 224.
[0065] Multiprocessor hardware designs, such as those discussed with reference to FIGs. 1 and 2, may include multiple processing cores of different capabilities inside the same package, often on the same piece of silicon. Symmetric multiprocessing hardware includes two or more identical processors connected to a single shared main memory that are controlled by a single operating system. Asymmetric or "loosely-coupled" multiprocessing hardware may include two or more heterogeneous processors/cores that may each be controlled by an independent operating system and connected to one or more shared
memories/resources. The various aspects may include or make use of any combination of symmetric and asymmetric multiprocessing hardware systems.
[0066] FIG. 3 illustrates example logical components and information flows in an aspect processing core 301 of a heterogeneous multiprocessor system 300 configured to identify, prevent, and/or correct the conditions and mobile device behaviors that have a high potential to contribute to the degradation in performance and power utilization levels of the mobile device over time. In an aspect, the processing core 301 may be a primary or master processing core.
[0067] In the example illustrated in FIG. 3, the processing core 301 includes a behavior observer module 302, a behavior analyzer module 306, an external context information module 304, and an actuator module 308. The processing core 301 may be configured to receive behavior signatures and other
communications from one or more slave behavior observer modules 303.
[0068] Each of the modules 302-308 may be implemented in software, hardware, or any combination thereof. In various aspects, the modules 302-308 may be implemented within parts of the operating system (e.g., within the kernel, in the kernel space, in the user space, etc.), within separate programs or applications, in specialized hardware buffers or processors, or any combination thereof. In an aspect, one or more of the modules 302-308 may be implemented as software instructions executing on one or more processing cores of a mobile device.
[0069] Any of the behavior observer modules 302, 303 may be configured to instrument or coordinate application programming interfaces (APIs) at various levels/modules of the mobile device, and monitor/observe mobile device operations and events (e.g., system events, state changes, etc.) at the various levels/modules via the instrumented APIs, collect information pertaining to the observed operations/events, intelligently filter the collected information, generate one or more observations based on the filtered information, generate behavior signatures, store the generated observations and/or behavior signatures in a memory (e.g., in a log file, cache memory, etc.) and/or send (e.g., via memory writes, function calls, etc.) the generated signatures or observations to a master/primary processing core or to a behavior analyzer module 306.
[0070] By generating a partial, incomplete, light-weight, or succinct behavior signature in each processing core to describe a portion of the application from the perspective of (or from within the context of) each individual processing core, the behavior observer modules 302, 303 may generate behavior information from a reduced set of observations (and thus operations) that may be more readily combined with other observations/behavior information collected from other processing cores to identify, analyze and/or respond to a complete mobile device behavior or condition that has a high potential to negatively impact the mobile device. In addition, the behavior signatures allow the behavior information to be communicated across/among/between multiple heterogeneous processing cores efficiently and without negatively impacting the mobile device.
[0071] Any of the behavior observer modules 302, 303 may monitor/observe mobile device operations and events by collecting information pertaining to library application programming interface (API) calls in an application framework or run-time libraries, system call APIs, file-system and networking sub-system operations, device (including sensor devices) state changes, and other similar events. The behavior observer modules 302, 303 may also monitor file system activity, which may include searching for filenames, categories of file accesses (personal info or normal data files), creating or deleting files (e.g., type exe, zip, etc.), file read/write/seek operations, changing file permissions, etc.
[0072] The behavior observer modules 302, 303 may also monitor/observe data network activity, which may include types of connections, protocols, port numbers, server/client that the device is connected to, the number of connections, volume or frequency of communications, etc. The behavior observer modules 302, 303 may monitor phone network activity, which may include monitoring the type and number of calls or messages (e.g., SMS, etc.) sent out, received, or intercepted (e.g., the number of premium calls placed).
[0073] The behavior observer modules 302, 303 may also monitor/observe the system resource usage, which may include monitoring the number of forks, memory access operations, number of files open, etc. The behavior observer modules 302, 303 may monitor the state of the mobile device, which may include monitoring various factors, such as whether the display is on or off, whether the device is locked or unlocked, the amount of battery remaining, the state of the camera, etc. The behavior observer modules 302, 303 may also monitor interprocess communications (IPC) by, for example, monitoring intents to crucial services (browser, contracts provider, etc.), the degree of inter-process communications, pop-up windows, etc. [0074] The behavior observer modules 302, 303 may also monitor/observe driver statistics and/or the status of one or more hardware components, which may include cameras, sensors, electronic displays, WiFi communication components, data controllers, memory controllers, system controllers, access ports, timers, peripheral devices, wireless communication components, external memory chips, voltage regulators, oscillators, phase-locked loops, peripheral bridges, and other similar components used to support the processors and clients running on the mobile computing device.
[0075] The behavior observer modules 302, 303 may also monitor/observe one or more hardware counters that denote the state or status of the mobile computing device and/or mobile device sub-systems. A hardware counter may include a special-purpose register of the processors/cores that is configured to store a count or state of hardware-related activities or events occurring in the mobile computing device.
[0076] The behavior observer modules 302, 303 may also monitor/observe actions or operations of software applications, software downloads from an application download server (e.g., Apple® App Store server), mobile device information used by software applications, call information, text messaging information (e.g., SendSMS, BlockSMS, ReadSMS, ec ), media messaging information (e.g., ReceiveMMS), user account information, location information, camera information, accelerometer information, browser information, content of browser-based communications, content of voice-based communications, short range radio communications (e.g., Bluetooth, WiFi, etc.), content of text-based communications, content of recorded audio files, phonebook or contact information, contacts lists, etc.
[0077] The behavior observer modules 302, 303 may monitor/observe
transmissions or communications of the mobile device, including
communications that include voicemail (VoiceMailComm), device identifiers (DevicelDComm), user account information (UserAccountComm), calendar information (CalendarComm ), location information (LocationComm), recorded audio information (RecordAudioComm ), accelerometer information
(AccelerometerComm), etc.
[0078] The behavior observer modules 302, 303 may monitor/observe usage of and updates/changes to compass information, mobile device settings, battery life, gyroscope information, pressure sensors, magnet sensors, screen activity, etc. The behavior observer modules 302, 303 may monitor/observe notifications communicated to and from a software application (AppNotifications), application updates, etc. The behavior observer modules 302, 303 may monitor/observe conditions or events pertaining to a first software application requesting the downloading and/or install of a second software application. The behavior observer modules 302, 303 may monitor/observe conditions or events pertaining to user verification, such as the entry of a password, etc.
[0079] The behavior observer modules 302, 303 may monitor/observe conditions or events at multiple levels of the mobile device, including the application level, radio level, and sensor level.
[0080] Application level observations may include observing the user via facial recognition software, observing social streams, observing notes entered by the user, observing events pertaining to the use of PassBook /Google Wallet /Paypal, etc. Application level observations may also include observing events relating to the use of virtual private networks (VPNs) and events pertaining to
synchronization, voice searches, voice control (e.g., lock/unlock a phone by saying one word), language translators, the offloading of data for computations, video streaming, camera usage without user activity, microphone usage without user activity, etc.
[0081] Radio level observations may include determining the presence, existence or amount of any or more of: user interaction with the mobile device before establishing radio communication links or transmitting information, dual/multiple SIM cards, Internet radio, mobile phone tethering, offloading data for computations, device state communications, the use as a game controller or home controller, vehicle communications, mobile device synchronization, etc. Radio level observations may also include monitoring the use of radios (WiFi, WiMax, Bluetooth, etc.) for positioning, peer-to-peer (p2p) communications,
synchronization, vehicle to vehicle communications, and/or machine-to-machine (m2m). Radio level observations may further include monitoring network traffic usage, statistics, or profiles.
[0082] Sensor level observations may include monitoring a magnet sensor or other sensor to determine the usage and/or external environment of the mobile device. For example, the mobile device processor may be configured to determine whether the phone is in a holster (e.g., via a magnet sensor configured to sense a magnet within the holster) or in the user's pocket (e.g., via the amount of light detected by a camera or light sensor). Detecting that the mobile device is in a holster may be relevant to recognizing suspicious behaviors, for example, because activities and functions related to active usage by a user (e.g., taking photographs or videos, sending messages, conducting a voice call, recording sounds, etc.) occurring while the mobile device is holstered could be signs of nefarious processes executing on the device (e.g., to track or spy on the user). Other examples of sensor level observations related to usage or external environments include, detecting near-field communications (NFC), collecting information from a credit card scanner, barcode scanner, or mobile tag reader, detecting the presence of a USB power charging source, detecting that a keyboard or auxiliary device has been coupled to the mobile device, detecting that the mobile device has been coupled to a computing device (e.g., via USB, etc.), determining whether an LED, flash, flashlight, or light source has been modified or disabled (e.g., maliciously disabling an emergency signaling app, etc.), detecting that a speaker or microphone has been turned on or powered, detecting a charging or power event, detecting that the mobile device is being used as a game controller, etc. Sensor level observations may also include collecting information from medical or healthcare sensors or from scanning the user's body, collecting information from an external sensor plugged into the USB/audio jack, collecting information from a tactile or haptic sensor (e.g., via a vibrator interface, etc.), collecting information pertaining to the thermal state of the mobile device, etc.
[0083] To reduce the number of factors monitored to a manageable level, in an aspect, the behavior observer modules 302, 303 may perform coarse observations by monitoring/observing an initial set of behaviors or factors that are a small subset of all factors that could contribute to the mobile device's degradation. In an aspect, the initial set of behaviors and/or subset of the factors may be selected by analysis of benign and problematic applications on mobile devices. In various aspects, the behavior observer module 302, 303 may receive the initial set of behaviors and/or factors from another processing core (e.g., master processing core, etc.), a network server, or a component in a cloud service provider network.
[0084] The behavior analyzer module 306 may receive behavior vectors from the behavior observer module 302 and compare them to one or more behavior modules to determine whether a particular mobile device behavior, software application, or process is performance-degrading/malicious, benign, or suspicious. The behavior analyzer module 306 may also compare the received information (i.e., observations) with contextual information received from the external context information module 304 to identify subsystems, processes, and/or applications that are contributing to (or are likely to contribute to) the device's degradation over time or which may otherwise cause problems on the mobile device.
[0085] In an aspect, the behavior analyzer module 306 may include intelligence for utilizing a limited set of information (i.e., coarse observations) to identify behaviors, processes, or programs that are contributing to— or are likely to contribute to— the device's degradation over time, or which may otherwise cause problems on the device. For example, the behavior analyzer module 306 may be configured to analyze information (e.g., in the form of observations) collected from the various processing cores and modules (e.g., the behavior observer module 302, external context information module 304, etc.), learn the normal operational behaviors of the mobile device, and generate or update one or more behavior vectors based the results of the comparisons. In an aspect, the behavior analyzer module 306 may send the generated behavior vectors to the actuator module 308, which may perform various actions or operations to correct mobile device behaviors determined to be malicious or performance-degrading and/or perform operations to heal, cure, isolate, or otherwise fix the identified problem.
[0086] In an aspect, if the behavior analyzer module 306 determines that a behavior, software application, or process is suspicious, the behavior analyzer module 306 may notify the behavior observer module 302, which may adjust the adjust the granularity of its observations (i.e., the level of detail at which mobile device behaviors are observed) and/or change the behaviors that are observed based on information received from the behavior analyzer module 306 (e.g., results of the real-time analysis operations), generate or collect new or additional behavior information, and send the new/additional information to the behavior analyzer module 306 for further analysis/classification. Such feedback communications between the behavior observer module 302 and the behavior analyzer module 306 enable the mobile device to recursively increase the granularity of the observations (i.e., make finer or more detailed observations) or change the features/behaviors that are observed until a source of a suspicious or performance-degrading mobile device behavior is identified, until a processing or batter consumption threshold is reached, or until the mobile device processor determines that the source of the suspicious or performance-degrading mobile device behavior cannot be identified from further increases in observation granularity.
[0087] FIG. 4 is an illustration of an application task graph that characterizes the complete behavior of a software application distributed across multiple heterogeneous processing cores and which is suitable for use in combining partial behavior signatures in accordance with various aspects. Generally, a task may be any module, execution block, logic, or unit of code that may be represented in an application task graph 402 and which identifies a complete or unified behavior of a software application. A task may include a plurality of subtasks 404, each of which may be a minimal execution block, module, logic, or unit of code within the task that is sufficiently independent of the other sub-tasks/execution blocks that it may be mapped onto, or moved to, a different processing core. For example, a subtask 404 may be a module that includes any number of (e.g., thousands of) operations or lines of code, and which is sufficiently independent and self-contained so that it may be shifted to another core. In an aspect, a subtask 404 may be any module, logic, or unit of code with clearly defined inputs and outputs and which may be moved, mapped, or shifted to another processing core.
[0088] On a heterogeneous platform, a software application may be broken down into several sub-tasks, each of which may be scheduled onto a different core. That is, different portions of a software application may perform operations (e.g., API calls) on different individual cores, and the application's behavior may be spread across the different cores. For this reason, it is often difficult/challenging to obtain a complete picture of an application's behavior across the multiple heterogeneous cores/processing units.
[0089] In an aspect, the mobile device may be configured to generate a task graph that characterizes the complete behavior of a software application distributed across multiple heterogeneous processing cores as a function of parameters, API calls, parameter values, and timestamps. In an aspect, the task graph may be used to obtain a complete picture of an application's behavior across the multiple heterogeneous processing cores.
[0090] FIG. 5 is another illustration of an application task graph that
characterizes the complete behavior of a software application distributed across multiple heterogeneous processing cores and which is suitable for use in combining partial behavior signatures in accordance with various aspects.
Specifically, FIG. 5 illustrates that the application task graph 402, and thus the overall or complete behavior of a software application, may be equal to the sum of the subtasks included in each of the plurality of heterogeneous processing cores (Cores 1-3).
[0091] Due to the hardware, software, and/or architectural differences between the heterogeneous cores (Cores 1-3), communicating information between the cores may be prohibitively expensive, or may reduce the performance and power consumption of the mobile device. That is, mobile devices are resource constrained systems that have relatively limited processing, memory and energy resources. Therefore, cumbersome or exhaustive approaches to coordinating the operations of the multiple cores in order to observe or monitor a software application or behavior are not well suited for use in mobile devices. For example, transferring API logs from the various slave cores to a master core can result in prohibitive overheads, particularly for the battery-driven mobile devices. That is, it may be prohibitively expensive to transfer or send API logs generated in the secondary processing cores to the master core for analysis.
[0092] The various aspects may reduce or avoid cumbersome communications or exhaustive approaches to coordinating the operations of the multiple cores by generating behavior signatures in the secondary cores and communicating the behavior signatures (instead of API logs) the across cores. The master processing core may receive and combine the partial signatures in a meaningful fashion (i.e., via the task graph, based on time, using an action- sequence-number, etc.) to obtain the overall behavior of the software application.
[0093] FIG. 6 illustrates example logical components and information flows in an aspect heterogeneous multiprocessor system 600 that includes a master core 602 and two secondary cores 604, 606. In various aspects, the secondary cores 604, 606 may be on the same or a different chip as the master processing core 602. Communications between the processing cores may be facilitated by a heterogonous transport protocol 620 module (e.g., a bus, IPC, network-on-chip, fabric, etc.). [0094] In the example illustrated in FIG. 6, the master core 602 includes a master behavior observer module 302 that includes a global behavior detection unit 610 module, a local behavior detection unit 612 module, a task graph 614 module, a work distribution monitor 616 module, and a local observation 618 module. Each of the secondary cores 604, 606 may include a slave behavior observer module 303 that includes a local behavior detection unit 612 module and a local observation 618 module. The local behavior detection unit 612 modules may be configured to interpret local observations in their respective cores and provide a behavior signature to the global behavior detection unit 610 module for each software application being monitored.
[0095] Each slave behavior observer module 303 may monitor one or more activities (e.g., important APIs) in its respective secondary core 604, 606, generate a signature of the monitored activity that describes the behavior of the software application with respect to that particular core 604, 606 (and is thus a signature of a partial-behavior of the application). The behavior signature may be generated from behavior information collected by the slave behavior observer module 303 and succinctly describe portions of the mobile device behavior in a value or vector data- structure (e.g., in the form of a string of numbers, etc.). In an aspect, the behavior signature may function as an identifier and/or a certification that enables the master processing core to quickly recognize and identify a sub-task and its position in the application task graph 402 without performing any additional, cumbersome, or power intensive analysis or verification operations.
[0096] The slave behavior observer module 303 may send the generated signature to the master behavior observer module 302, which may use the application task graph 402 to combine the partial/incomplete behavior signatures to
obtain/identify the complete behavior of the software application.
[0097] The work distribution monitor 616 may be configured to keep track of how the operations/work (i.e., sub-tasks) within a single application are being distributed to the various secondary cores 604, 606, which may be achieved by monitoring calls to the transport layer, the heterogonous transport protocol 620 module, or to the global behavior detection unit 610 module. The work distribution monitor 616 may also generate and maintain the application task graph 402 (i.e., a concurrent execution pattern) for use by the global behavior detection unit, which may use local behavior signatures received from the secondary cores 604, 606 in conjunction with the task graph 402 to generate a behavior vector that describes the overall behavior of the software application. This behavior vector may then be sent to the behavior analyzer module 306 and used to identify behaviors that have a high probably of negatively impacting the mobile device's performance or battery consumption levels.
[0098] FIG. 7 illustrates example logical components and information flows in an behavior observer module 302 of a computing system configured to perform dynamic and adaptive observations in accordance with an aspect. The behavior observer module 302 may include an adaptive filter module 702, a throttle module 704, an observer mode module 706, a high-level behavior detection module 708, a behavior vector generator 710, and a secure buffer 712. The high- level behavior detection module 708 may include a spatial correlation module 714 and a temporal correlation module 716.
[0099] The observer mode module 706 may receive control information from various sources, which may include an analyzer unit (e.g., the behavior analyzer module 306 described above with reference to FIG. 3) and/or an application API. The observer mode module 706 may send control information pertaining to various observer modes to the adaptive filter module 702 and the high-level behavior detection module 708.
[00100] The adaptive filter module 702 may receive data/information from multiple sources, and intelligently filter the received information to generate a smaller subset of information selected from the received information. This filter may be adapted based on information or control received from the analyzer module, or a higher- level process communicating through an API. The filtered information may be sent to the throttle module 704, which may be responsible for controlling the amount of information flowing from the filter to ensure that the high-level behavior detection module 708 does not become flooded or overloaded with requests or information.
[00101] The high-level behavior detection module 708 may receive
data/information from the throttle module 704, control information from the observer mode module 706, and context information from other components of the mobile device. The high-level behavior detection module 708 may use the received information to perform spatial and temporal correlations to detect or identify high level behaviors that may cause the device to perform at sub-optimal levels. The results of the spatial and temporal correlations may be sent to the behavior vector generator 710, which may receive the correlation information and generate a behavior vector that describes the behaviors of particular process, application, or sub-system. In an aspect, the behavior vector generator 710 may generate the behavior vector such that each high-level behavior of a particular process, application, or sub-system is an element of the behavior vector. In an aspect, the generated behavior vector may be stored in a secure buffer 712.
Examples of high-level behavior detection may include detection of the existence of a particular event, the amount or frequency of another event, the relationship between multiple events, the order in which events occur, time differences between the occurrence of certain events, etc.
[00102] The behavior observer module 302 may perform adaptive observation techniques and control the observation granularity based on information received from a variety of sources. For example, the high-level behavior detection module 708 may receive information from the throttle module 704, the observer mode module 706, and context information received from other components (e.g., sensors) of the mobile device. As an example, a high-level behavior detection module 708 performing temporal correlations might detect that a camera has been used and that the mobile device is attempting to upload the picture to a server. The high-level behavior detection module 708 may also perform spatial correlations to determine whether an application on the mobile device took the picture while the device was holstered and attached to the user' s belt. The high- level behavior detection module 708 may determine whether this detected high- level behavior (e.g., usage of the camera while holstered) is a behavior that is acceptable or common, which may be achieved by comparing the current behavior with past behaviors of the mobile device and/or accessing information collected from a plurality of devices (e.g., information received from a crowd- sourcing server). Since taking pictures and uploading them to a server while holstered is an unusual behavior (as may be determined from observed normal behaviors in the context of being holstered), in this situation the high-level behavior detection module 708 may recognize this as a potentially threatening behavior and initiate an appropriate response (e.g., shutting off the camera, sounding an alarm, etc.).
[00103] In an aspect, the behavior observer module 302 may be implemented in multiple parts.
[00104] FIG. 8 illustrates logical components and information flows in a computing system 800 implementing an aspect observer daemon. In the example illustrated in FIG. 8, the computing system 800 includes a behavior detector 802 module, a database engine 804 module, and a behavior analyzer module 306 in the user space, and a ring buffer 814, a filter rules 816 module, a throttling rules 818 module, and a secure buffer 820 in the kernel space. The computing system 800 may further include an observer daemon that includes the behavior detector 802 and the database engine 804 in the user space, and the secure buffer manager 806, the rules manager 808, and the system health monitor 810 in the kernel space.
[00105] The various aspects may provide cross-layer observations on mobile devices encompassing webkit, SDK, NDK, kernel, drivers, and hardware in order to characterize system behavior. The behavior observations may be made in real time.
[00106] The observer module may perform adaptive observation techniques and control the observation granularity. As discussed above, there are a large number (i.e., thousands) of factors that could contribute to the mobile device's degradation, and it may not be feasible to monitor/observe all of the different factors that may contribute to the degradation of the device's performance. To overcome this, the various aspects dynamically identify the relevant behaviors that are to be observed, and dynamically determine the level of detail at which the identified behaviors are to be observed.
[00107] FIG. 9 illustrates an example method 900 for performing dynamic and adaptive observations in accordance with an aspect. In block 902, the mobile device processor may perform coarse observations by monitoring/observing a subset of large number factors/behaviors that could contribute to the mobile device's degradation. In block 903, the mobile device processor may generate a behavior vector characterizing the coarse observations and/or the mobile device behavior based on the coarse observations. In block 904, the mobile device processor may identify subsystems, processes, and/or applications associated with the coarse observations that may potentially contribute to the mobile device's degradation. This may be achieved, for example, by comparing information received from multiple sources with contextual information received from sensors of the mobile device. In block 906, the mobile device processor may perform behavioral analysis operations based on the coarse observations. In determination block 908, the mobile device processor may determine whether suspicious behaviors or potential problems can be identified and corrected based on the results of the behavioral analysis. When the mobile device processor determines that the suspicious behaviors or potential problems can be identified and corrected based on the results of the behavioral analysis (i.e., determination block 908 = "Yes"), in block 918, the processor may initiate a process to correct the behavior and return to block 902 to perform additional coarse observations. [00108] When the mobile device processor determines that the suspicious behaviors or potential problems can not be identified and/or corrected based on the results of the behavioral analysis (i.e., determination block 908 = "No"), in determination block 909 the mobile device processor may determine whether there is a likelihood of a problem. In an embodiment, the mobile device processor may determine that there is a likelihood of a problem by computing a probability of the mobile device encountering potential problems and/or engaging in suspicious behaviors, and determining whether the computed probability is greater than a predetermined threshold. When the mobile device processor determines that the computed probability is not greater than the predetermined threshold and/or there is not a likelihood that suspicious behaviors or potential problems exist and/or are detectable (i.e., determination block 909 = "No"), the processor may return to block 902 to perform additional coarse observations.
[00109] When the mobile device processor determines that there is a likelihood that suspicious behaviors or potential problems exist and/or are detectable (i.e., determination block 909 = "Yes"), in block 910, the mobile device processor may perform deeper logging/observations or final logging on the identified subsystems, processes or applications. In block 912, the mobile device processor may perform deeper and more detailed observations on the identified subsystems, processes or applications. In block 914, the mobile device processor may perform further and/or deeper behavioral analysis based on the deeper and more detailed observations. In determination block 908, the mobile device processor may again determine whether the suspicious behaviors or potential problems can be identified and corrected based on the results of the deeper behavioral analysis. When the mobile device processor determines that the suspicious behaviors or potential problems can not be identified and corrected based on the results of the deeper behavioral analysis (i.e., determination block 908 = "No"), the processor may repeat the operations in blocks 910-914 until the level of detail is fine enough to identify the problem or until it is determined that the problem cannot be identified with additional detail or that no problem exists. [00110] When the mobile device processor determines that the suspicious behaviors or potential problems can be identified and corrected based on the results of the deeper behavioral analysis (i.e., determination block 908 = "Yes"), in block 918, the mobile device processor may perform operations to correct the problem/behavior, and the processor may return to block 902 to perform additional operations.
[00111] In an aspect, as part of blocks 902-918 of method 900, the mobile device processor may perform real-time behavior analysis of the system's behaviors to identify suspicious behavior from limited and coarse observations, to
dynamically determine the behaviors to observe in greater detail, and to dynamically determine the precise level of detail required for the observations. This enables the mobile device processor to efficiently identify and prevent problems from occurring, without requiring the use of a large amount of processor, memory, or battery resources on the device.
[00112] FIG. 10 illustrates an example master observer method 1000 for performing observations on a mobile device processor in accordance with an aspect. In blocks 1002-1018, slave observer modules in each of the slave or secondary processing cores (Core 1, Core 2, Core n) may repeatedly monitor mobile device activities in their respective cores, generate a behavior signature based on the monitored activities, and send the generated signature to the master processing core (Master Core).
[00113] In block 1020, a master observer module of the master or primary processing core may monitor calls to the transport layer and generate a task graph. In block 1022, the master observer module may receive behavior signatures from the slave/secondary processing cores (Core 1, Core 2, Core n). In block 1024, the master observer module may combine the received behavior signatures with behavior information collected on the master core to generate a global behavior vector. In block 1026, the master observer module may send the generated global behavior vector to an analyzer module for further analysis. [00114] FIG. 11 illustrates another example method 1100 for perform dynamic and adaptive observations by a mobile device processor in accordance with another aspect. In block 1102, the mobile device processor may dynamically identify the relevant behaviors that are to be observed on the mobile device. In block 1104, the mobile device processor may dynamically determine the level of detail at which the identified behaviors are to be observed. In optional block 1106, the mobile device processor may dynamically adapt to what is being observed. In optional block 1108, the mobile device processor may dynamically change or update the parameters, factors, behaviors, processes, applications, and/or subsystems that are to be observed. The operations of blocks 1102-1108 may be repeated continuously or as is necessary to improve the mobile device performance (e.g., battery power consumption, processing speed, network communication speeds, etc.).
[00115] Example components and modules of an exemplary, non-limiting aspect of such a mobile device are illustrated in FIG. 12. A mobile computing device 102 may include a circuit board 1202 of electronic components, some or all of which may be integrated into an on-chip system, that includes a control processor 1201 coupled to memory 1204. The control processor 1201 may further be coupled to a digital signal processor 1206 and/or an analog signal processor 1208, which also be coupled together. In some embodiments, the control processor 1201 and a digital signal processor 1206 may be the same component or may be integrated into the same processor chip. A display controller 1210 and a touchscreen controller 1212 may be coupled to the control processor 1201 and to a display/touchscreen 1214 within or connected to the mobile computing device 102.
[00116] The control processor 1201 may also be coupled to removable memory 1216 (e.g., an SD memory or SIM card in the case of mobile computing devices) and/or to external memory 1218, such as one or more of a disk drive, CD drive, and a DVD drive. The control processor 1201 may also be coupled to a
Universal Serial Bus (USB) controller 1220 which couples to a USB port 1222. In various aspects, a power supply 1221 may be coupled to the circuit board 1202 through the USB controller 1220 or through different electrical connections to provide power (e.g., DC power) to the various electronic components.
[00117] The control processor 1201 may also be coupled to a video encoder 1224, e.g., a phase alternating line (PAL) encoder, a sequential couleur a memoire (SECAM) encoder, or a national television system(s) committee (NTSC) encoder. Further, the video encoder 1224 may be coupled to a video amplifier 1226 which may be coupled to the video encoder 1224 and the
display /touchscreen 1214. Also, a video port 1228 may be coupled to the video amplifier 1226 to enable connecting the mobile computing device 102 to an external monitor, television or other display (not shown).
[00118] The control processor 1201 may be coupled to a radio frequency (RF) transceiver 1230, such as via an analog signal processor 1208. The RF transceiver 1230 may be coupled to an RF antenna 1218 for transmitting and receiving RF signals. The RF transceiver 1230 may be configured to transmit and receive communication signals of one or more different wireless
communication protocols including, for example, cellular telephone (e.g., G-3, UMTS, CDMA, etc.), WiFi, WiMax, and Bluetooth.
[00119] The control processor 1201 may further be coupled to a network card 1232 which may be coupled to a network connector 1231 and/or the RF transceiver 1230 and configured to enable communications via an external network (e.g., local area networks, the Internet, an intranet, WiFi networks, Bluetooth networks, personal area network (PAN) etc.) The network card 1232 may be in the form of a separate chip or card, or may be implemented as part of the control processor 1201 or the RF transceiver 1230 (or both) as a full solution communication chip.
[00120] A number of analog devices may be coupled to the control processor 1201 via the analog signal processor 1208, such as a keypad 1234. In other implementations, a keypad or keyboard may include its own processor so that the interface with the control processor 1201 may be via direct connection (not shown), via a network connection (e.g., via the network card), or via the USB port 1222.
[00121] In some implementations, a digital camera 1236 may be coupled to the control processor 1201. In an exemplary aspect, the digital camera 1236 may be a charge-coupled device (CCD) camera or a complementary metal-oxide semiconductor (CMOS) camera. The digital camera 1236 may be built into the mobile computing device 102 or coupled to the device by an external cable.
[00122] In some implementations, an audio CODEC 1238 (e.g., a stereo CODEC) may be coupled to the analog signal processor 1208 and configured to send sound signals to one or more speakers 1240 via an audio amplifier 1242. The audio CODEC 1238 may also be coupled to a microphone amplifier 1244 which may be coupled to a microphone 1246 (e.g., via a microphone jack). A headphone jack 1248 may also be coupled to the audio CODEC 1238 for outputting audio to headphones.
[00123] In some implementations, the mobile computing device 102 may include a separate RF receiver circuit 1250 which may be coupled to an antenna 1252 for receiving broadcast wireless communication signals. The receiver circuit 1250 may be configured to receive broadcast television signals (e.g., EBMS broadcasts), and provide received signals to the DSP 1206 for processing. In some implementations, the receiver circuit 1250 may be configured to receive FM radio signals, in which case the received signals may be passed to the Audio CODEC 1238 for processing.
[00124] In an aspect, processor-executable instructions for accomplishing one or more of the method operations described above may be stored in the internal memory 1204, removable memory 1216 and/or non-volatile memory 1218 (e.g., as on a hard drive, CD drive, or other storage accessible via a network). Such processor-executable instructions may be executed by the control processor 1201 in order to perform the methods described herein. [00125] The various aspects may be implemented on a variety of mobile computing devices, an example of which is illustrated in FIG. 13 in the form of a smartphone. A smartphone 1300 may include a processor 1301 coupled to internal memory 1302, a display 1303, and to a speaker. Additionally, the smartphone 1300 may include an antenna 1304 for sending and receiving electromagnetic radiation that may be connected to a wireless data link and/or cellular telephone transceiver 1305 coupled to the processor 1301. Smartphone 1300 typically also include menu selection buttons or rocker switches 1306 for receiving user inputs.
[00126] A typical smartphone 1300 also includes a sound encoding/decoding (CODEC) circuit 1312, which digitizes sound received from a microphone into data packets suitable for wireless transmission and decodes received sound data packets to generate analog signals that are provided to the speaker to generate sound. Also, one or more of the processor 1301, wireless transceiver 1305 and CODEC 1312 may include a digital signal processor (DSP) circuit (not shown separately).
[00127] Portions of the aspect methods may be accomplished in a client-server architecture with some of the processing occurring in a server, such as maintaining databases of normal operational behaviors, which may be accessed by a mobile device processor while executing the aspect methods. Such aspects may be implemented on any of a variety of commercially available server devices, such as the server 1400 illustrated in FIG. 14. Such a server 1400 typically includes a processor 1401 coupled to volatile memory 1402 and a large capacity nonvolatile memory, such as a disk drive 1403. The server 1400 may also include a floppy disc drive, compact disc (CD) or DVD disc drive 1411 coupled to the processor 1401. The server 1400 may also include network access ports 1404 coupled to the processor 1401 for establishing data connections with a network 1405, such as a local area network coupled to other broadcast system computers and servers. [00128] The processors 1301, 1401 may be any programmable microprocessor, microcomputer or multiple processor chip or chips that can be configured by software instructions (applications) to perform a variety of functions, including the functions of the various aspects described below. In some mobile devices, multiple processors 1301 may be provided, such as one processor dedicated to wireless communication functions and one processor dedicated to running other applications. Typically, software applications may be stored in the internal memory 1302, 1402, 1403 before they are accessed and loaded into the processor 1301, 1401. The processor 1301, 1401 may include internal memory sufficient to store the application software instructions.
[00129] Many mobile computing devices operating system kernels are organized into a user space (where non-privileged code runs) and a kernel space (where privileged code runs). This separation is of particular importance in Android® and other general public license (GPL) environments where code that is part of the kernel space must be GPL licensed, while code running in the user-space may not be GPL licensed. It should be understood that the various software components/modules discussed here may be implemented in either the kernel space or the user space, unless expressly stated otherwise.
[00130] As used in this application, the terms "component," "module," "system," "service," "engine," "listener," "manager," and the like are intended to include a computer-related entity, such as, but not limited to, hardware, firmware, a combination of hardware and software, software, or software in execution, which are configured to perform particular operations or functions. For example, a component may be, but is not limited to, a process running on a processor, a processor, an object, an executable, a thread of execution, a program, and/or a computer. By way of illustration, both an application running on a computing device and the computing device may be referred to as a component. One or more components may reside within a process and/or thread of execution and a component may be localized on one processor or core, and/or distributed between two or more processors or cores. In addition, these components may execute from various non-transitory computer readable media having various instructions and/or data structures stored thereon. Components may communicate by way of local and/or remote processes, function or procedure calls, electronic signals, data packets, memory read/writes, and other known computer, processor, and/or process related communication methodologies.
[00131] The foregoing method descriptions and the process flow diagrams are provided merely as illustrative examples and are not intended to require or imply that the steps of the various aspects must be performed in the order presented. As will be appreciated by one of skill in the art the order of steps in the foregoing aspects may be performed in any order. Words such as "thereafter," "then," "next," etc. are not intended to limit the order of the steps; these words are simply used to guide the reader through the description of the methods. Further, any reference to claim elements in the singular, for example, using the articles "a," "an" or "the" is not to be construed as limiting the element to the singular.
[00132] The various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the aspects disclosed herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
[00133] The hardware used to implement the various illustrative logics, logical blocks, modules, and circuits described in connection with the aspects disclosed herein may be implemented or performed with a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general-purpose processor may be a multiprocessor, but, in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a multiprocessor, a plurality of multiprocessors, one or more multiprocessors in conjunction with a DSP core, or any other such configuration. Alternatively, some steps or methods may be performed by circuitry that is specific to a given function.
[00134] In one or more exemplary aspects, the functions described may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored as one or more instructions or code on a non-transitory computer readable storage medium, non-transitory computer-readable medium or non-transitory processor-readable medium. The steps of a method or algorithm disclosed herein may be embodied in a processor- executable software module which may reside on a non-transitory computer- readable or processor-readable storage medium. Non-transitory computer- readable or processor-readable storage media may be any storage media that may be accessed by a computer or a processor. By way of example but not limitation, such non-transitory computer-readable or processor-readable media may include RAM, ROM, EEPROM, FLASH memory, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that may be used to store desired program code in the form of instructions or data structures and that may be accessed by a computer. Disk and disc, as used herein, includes compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk, and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above are also included within the scope of non-transitory computer- readable and processor-readable media. Additionally, the operations of a method or algorithm may reside as one or any combination or set of codes and/or instructions on a non-transitory processor-readable medium and/or computer- readable medium, which may be incorporated into a computer program product.
[00135] The preceding description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the following claims and the principles and novel features disclosed herein.

Claims

CLAIMS What is claimed is:
1. A method of monitoring behaviors of a mobile computing device, comprising: observing in a non-master processing core of the mobile computing device a portion of a mobile device behavior that is relevant to the non-master processing core;
generating in the non-master processing core a behavior signature that describes the observed portion of the mobile device behavior;
sending the generated behavior signature to a master processing core of the mobile computing device;
combining two or more behavior signatures received from non-master processing cores in the master processing core to generate a global behavior vector; and
providing the global behavior vector to an analyzer module for processing.
2. The method of claim 1, further comprising processing the global behavior vector by the analyzer module to determine whether a software application is benign or not benign based on the global behavior vector.
3. The method of claim 1, further comprising generating a task graph in the master processing core,
wherein combining two or more behavior signatures in the master processing core to generate the global behavior vector comprises combining the two or more behavior signatures based on the generated task graph.
4. The method of claim 1, further comprising:
monitoring in the master processing core a distribution of sub-tasks of a single application to a plurality of non-master processing cores of the mobile computing device.
5. The method of claim 4, wherein monitoring the distribution of sub-tasks comprises monitoring calls to a transport layer of the mobile device.
6. A mobile computing device, comprising:
a memory;
a master processor; and
one or more non-master processors coupled to the memory and the master processor,
wherein each of the one or more non-master processors are configured with processor-executable instructions to perform operation comprising:
observing a portion of a mobile device behavior that is relevant to the non-master processor;
generating a behavior signature that describes the observed portion of the mobile device behavior; and
sending the generated behavior signature to the master processor, and
wherein the master processor is configured with processor-executable instructions to perform operations comprising:
combining two or more behavior signatures received from the one or more non-master processors to generate a global behavior vector; and providing the global behavior vector to an analyzer module for processing.
7. The mobile computing device of claim 6, wherein the master processor is configured with processor-executable instructions to perform operations further comprising:
processing the global behavior vector by the analyzer module to determine whether a software application is benign or not benign based on the global behavior vector in the analyzer module.
8. The mobile computing device of claim 6, wherein the master processor is configured with processor-executable instructions to perform operations further comprising generating a task graph, and wherein the master processor is configured with processor-executable instructions to perform operations such that combining two or more behavior signatures to generate the global behavior vector comprises combining the two or more behavior signatures based on the generated task graph.
9. The mobile computing device of claim 6, wherein the master processor is configured with processor-executable instructions to perform operations further comprising:
monitoring a distribution of sub-tasks of a single application to the one or more non-master processors.
10. The mobile computing device of claim 9, wherein the master processor is configured with processor-executable instructions to perform operations such that monitoring the distribution of sub-tasks comprises monitoring calls to a transport layer of the mobile computing device.
11. A mobile computing device having multiple heterogeneous cores, comprising:
means for observing in a non-master processing core a portion of a mobile device behavior that is relevant to the non-master processing core;
means for generating in the non-master processing core a behavior signature that describes the observed portion of the mobile device behavior; means for sending the generated behavior signature to a master processing core;
means for combining two or more behavior signatures received from non- master processing cores in the master processing core to generate a global behavior vector; and means for providing the global behavior vector to an analyzer module for processing.
12. The mobile computing device of claim 11, further comprising means for processing the global behavior vector by the analyzer module to determine whether a software application is benign or not benign based on the global behavior vector.
13. The mobile computing device of claim 11, further comprising means for generating a task graph in the master processing core, wherein means for combining two or more behavior signatures in the master processing core to generate the global behavior vector comprises means for combining the two or more behavior signatures based on the generated task graph.
14. The mobile computing device of claim 11, further comprising:
means for monitoring in the master processing core a distribution of sub- tasks of a single application to one or more non-master processing cores.
15. The mobile computing device of claim 14, wherein means for monitoring the distribution of sub-tasks comprises means for monitoring calls to a transport layer of the mobile computing device.
16. A non-transitory computer readable storage medium having stored thereon processor-executable software instructions configured to cause a multiprocessor computing system to perform operations comprising:
observing in a non-master processor a portion of a mobile device behavior that is relevant to the non-master processor;
generating in the non-master processor a behavior signature that describes the observed portion of the mobile device behavior;
sending the generated behavior signature to a master processor; combining two or more behavior signatures received from two or more non-master processors in the master processor to generate a global behavior vector; and
providing the global behavior vector to an analyzer module for processing.
17. The non-transitory computer readable storage medium of claim 16, wherein the stored processor-executable software instructions are configured to cause the multiprocessor computing system to perform operations further comprising processing the global behavior vector by the analyzer module to determine whether a software application is benign or not benign based on the global behavior vector.
18. The non-transitory computer readable storage medium of claim 16, wherein: the stored processor-executable software instructions are configured to cause the multiprocessor computing system to perform operations further comprising generating a task graph in the master processor, and
the stored processor-executable software instructions are configured to cause the multiprocessor computing system to perform operations such that combining two or more behavior signatures in the master processor to generate the global behavior vector comprises combining the two or more behavior signatures based on the generated task graph.
19. The non-transitory computer readable storage medium of claim 16, wherein the stored processor-executable software instructions are configured to cause the multiprocessor computing system to perform operations further comprising: monitoring in the master processor a distribution of sub-tasks of a single application to one or more non-master processing cores.
20. The non-transitory computer readable storage medium of claim 19, wherein the stored processor-executable software instructions are configured to cause the multiprocessor computing system to perform operations such that monitoring the distribution of sub-tasks comprises monitoring calls to a transport layer of a mobile device.
PCT/US2013/035952 2012-05-14 2013-04-10 Monitoring behavioral features in a mobile multiprocessor platform WO2013173001A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN201380024849.6A CN104303156B (en) 2012-05-14 2013-04-10 Behavior characteristicss in the mobile multi processor platform of monitoring
JP2015512656A JP6110482B2 (en) 2012-05-14 2013-04-10 Behavioral feature monitoring on mobile multiprocessor platforms
EP13718700.1A EP2850524B1 (en) 2012-05-14 2013-04-10 Monitoring behavioural features in a mobile multiprocessor platform

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201261646590P 2012-05-14 2012-05-14
US61/646,590 2012-05-14
US201261683274P 2012-08-15 2012-08-15
US61/683,274 2012-08-15
US13/773,877 US9152787B2 (en) 2012-05-14 2013-02-22 Adaptive observation of behavioral features on a heterogeneous platform
US13/773,877 2013-02-22

Publications (1)

Publication Number Publication Date
WO2013173001A1 true WO2013173001A1 (en) 2013-11-21

Family

ID=49548974

Family Applications (4)

Application Number Title Priority Date Filing Date
PCT/US2012/067726 WO2013172865A1 (en) 2012-05-14 2012-12-04 System, apparatus, and method for adaptive observation of mobile device behavior
PCT/US2013/023246 WO2013172877A1 (en) 2012-05-14 2013-01-25 Techniques for autonomic reverting to behavioral checkpoints
PCT/US2013/023646 WO2013172881A1 (en) 2012-05-14 2013-01-29 Minimizing latency of behavioral analysis using signature caches
PCT/US2013/035952 WO2013173001A1 (en) 2012-05-14 2013-04-10 Monitoring behavioral features in a mobile multiprocessor platform

Family Applications Before (3)

Application Number Title Priority Date Filing Date
PCT/US2012/067726 WO2013172865A1 (en) 2012-05-14 2012-12-04 System, apparatus, and method for adaptive observation of mobile device behavior
PCT/US2013/023246 WO2013172877A1 (en) 2012-05-14 2013-01-25 Techniques for autonomic reverting to behavioral checkpoints
PCT/US2013/023646 WO2013172881A1 (en) 2012-05-14 2013-01-29 Minimizing latency of behavioral analysis using signature caches

Country Status (8)

Country Link
US (6) US9202047B2 (en)
EP (3) EP2850864B1 (en)
JP (1) JP6110482B2 (en)
KR (2) KR101626243B1 (en)
CN (4) CN104272786B (en)
IN (2) IN2014MN02172A (en)
TW (1) TW201407406A (en)
WO (4) WO2013172865A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015157108A1 (en) * 2014-04-08 2015-10-15 Qualcomm Incorporated Method and system for inferring application states by performing behavioral analysis operations in a mobile device
JP2017536594A (en) * 2014-09-11 2017-12-07 クアルコム,インコーポレイテッド Method and system for aggregate multi-application behavior analysis of mobile device behavior

Families Citing this family (136)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013006553A1 (en) * 2011-07-01 2013-01-10 Fiberlink Communications Corporation Rules based actions for mobile device management
US9916192B2 (en) * 2012-01-12 2018-03-13 International Business Machines Corporation Thread based dynamic data collection
US8973137B1 (en) * 2012-02-29 2015-03-03 Symantec Corporation Systems and methods for detecting illegitimate out-of-band authentication attempts
US9202047B2 (en) 2012-05-14 2015-12-01 Qualcomm Incorporated System, apparatus, and method for adaptive observation of mobile device behavior
US9298494B2 (en) 2012-05-14 2016-03-29 Qualcomm Incorporated Collaborative learning for efficient behavioral analysis in networked mobile device
US9690635B2 (en) 2012-05-14 2017-06-27 Qualcomm Incorporated Communicating behavior information in a mobile computing device
US9609456B2 (en) 2012-05-14 2017-03-28 Qualcomm Incorporated Methods, devices, and systems for communicating behavioral analysis information
US9324034B2 (en) 2012-05-14 2016-04-26 Qualcomm Incorporated On-device real-time behavior analyzer
US9407443B2 (en) 2012-06-05 2016-08-02 Lookout, Inc. Component analysis of software applications on computing devices
US9589129B2 (en) 2012-06-05 2017-03-07 Lookout, Inc. Determining source of side-loaded software
US9495537B2 (en) 2012-08-15 2016-11-15 Qualcomm Incorporated Adaptive observation of behavioral features on a mobile device
US9319897B2 (en) 2012-08-15 2016-04-19 Qualcomm Incorporated Secure behavior analysis over trusted execution environment
US9330257B2 (en) 2012-08-15 2016-05-03 Qualcomm Incorporated Adaptive observation of behavioral features on a mobile device
US9747440B2 (en) 2012-08-15 2017-08-29 Qualcomm Incorporated On-line behavioral analysis engine in mobile device with multiple analyzer model providers
US10162693B1 (en) * 2012-10-18 2018-12-25 Sprint Communications Company L.P. Evaluation of mobile device state and performance metrics for diagnosis and troubleshooting of performance issues
CN104662547A (en) * 2012-10-19 2015-05-27 迈克菲股份有限公司 Mobile application management
US9208215B2 (en) 2012-12-27 2015-12-08 Lookout, Inc. User classification based on data gathered from a computing device
US9659085B2 (en) * 2012-12-28 2017-05-23 Microsoft Technology Licensing, Llc Detecting anomalies in behavioral network with contextual side information
US10089582B2 (en) 2013-01-02 2018-10-02 Qualcomm Incorporated Using normalized confidence values for classifying mobile device behaviors
US9684870B2 (en) 2013-01-02 2017-06-20 Qualcomm Incorporated Methods and systems of using boosted decision stumps and joint feature selection and culling algorithms for the efficient classification of mobile device behaviors
US9686023B2 (en) 2013-01-02 2017-06-20 Qualcomm Incorporated Methods and systems of dynamically generating and using device-specific and device-state-specific classifier models for the efficient classification of mobile device behaviors
US9742559B2 (en) 2013-01-22 2017-08-22 Qualcomm Incorporated Inter-module authentication for securing application execution integrity within a computing device
TWI556098B (en) * 2013-01-25 2016-11-01 高通公司 Adaptive observation of behavioral features on a mobile device
US20160110551A1 (en) * 2013-02-14 2016-04-21 The United States Of America As Represented By The Secretary Of The Navy Computer System Anomaly Detection Using Human Responses to Ambient Representations of Hidden Computing System and Process Metadata
US9491187B2 (en) 2013-02-15 2016-11-08 Qualcomm Incorporated APIs for obtaining device-specific behavior classifier models from the cloud
US20140250049A1 (en) 2013-03-01 2014-09-04 RedOwl Analytics, Inc. Visualizing social behavior
WO2014134630A1 (en) 2013-03-01 2014-09-04 RedOwl Analytics, Inc. Modeling social behavior
US20140292998A1 (en) * 2013-04-02 2014-10-02 James Toga Managing Use of Resources in Mobile Devices
US9307374B2 (en) * 2013-06-19 2016-04-05 Globalfoundries Inc. Transferring information on a first mobile computing device to a peer mobile computing device
US9231921B2 (en) * 2013-08-20 2016-01-05 Janus Technologies, Inc. System and architecture for secure computer devices
US9826439B2 (en) 2013-09-30 2017-11-21 Elwha Llc Mobile device sharing facilitation methods and systems operable in network equipment
US9805208B2 (en) * 2013-09-30 2017-10-31 Elwha Llc Mobile device sharing facilitation methods and systems with recipient-dependent inclusion of a data selection
US20150095477A1 (en) * 2013-09-30 2015-04-02 Elwha LLC, a limited liability company of the State of Delaware Mobile device sharing facilitation methods and systems featuring party identifier inclusions that are conditional
US9740875B2 (en) * 2013-09-30 2017-08-22 Elwha Llc Mobile device sharing facilitation methods and systems featuring exclusive data presentation
US9774728B2 (en) 2013-09-30 2017-09-26 Elwha Llc Mobile device sharing facilitation methods and systems in a context of plural communication records
US9838536B2 (en) 2013-09-30 2017-12-05 Elwha, Llc Mobile device sharing facilitation methods and systems
TWI533159B (en) * 2013-10-18 2016-05-11 國立臺灣科技大學 A continuous identity authentication method for computer users
DE102013224702A1 (en) * 2013-12-03 2015-06-03 Robert Bosch Gmbh Control device for a motor vehicle
US9652362B2 (en) 2013-12-06 2017-05-16 Qualcomm Incorporated Methods and systems of using application-specific and application-type-specific models for the efficient classification of mobile device behaviors
US9813992B2 (en) 2013-12-06 2017-11-07 Mcp Llc Tracking systems and methods for remotely tracking a location of a person on a map of a monitored premise
EP3591552B1 (en) * 2013-12-19 2022-03-30 Intel Corporation Protection system including machine learning snapshot evaluation
CN103699208B (en) * 2013-12-31 2016-11-23 贝壳网际(北京)安全技术有限公司 Hardware setting method, mobile terminal and the server of a kind of mobile terminal
US9501346B2 (en) * 2014-01-21 2016-11-22 Oracle International Corporation Fine and coarse granularity logging handler
WO2015112760A1 (en) * 2014-01-23 2015-07-30 Qualcomm Incorporated Adaptive observation of determined behavioral features on a mobile device
US10313198B2 (en) * 2014-01-23 2019-06-04 Koninklijke Kpn N.V. Crash recovery for smart objects
US10176428B2 (en) 2014-03-13 2019-01-08 Qualcomm Incorporated Behavioral analysis for securing peripheral devices
US9559918B2 (en) * 2014-05-15 2017-01-31 Cisco Technology, Inc. Ground truth evaluation for voting optimization
US9672263B1 (en) 2014-06-23 2017-06-06 The United States Of America As Represented By The Secretary Of The Navy Reliability engineering data integration
US9357397B2 (en) 2014-07-23 2016-05-31 Qualcomm Incorporated Methods and systems for detecting malware and attacks that target behavioral security mechanisms of a mobile device
US10228751B2 (en) 2014-08-06 2019-03-12 Apple Inc. Low power mode
US9647489B2 (en) 2014-08-26 2017-05-09 Apple Inc. Brownout avoidance
US20170285722A1 (en) * 2014-08-27 2017-10-05 Samsung Electronics Co., Ltd. Method for reducing battery consumption in electronic device
FR3025627B1 (en) * 2014-09-10 2018-03-23 Bull Sas HIGH PERFORMANCE MECHANISM FOR GENERATING JOURNALIZATION INFORMATION OF A COMPUTER PROCESS
US20160078362A1 (en) * 2014-09-15 2016-03-17 Qualcomm Incorporated Methods and Systems of Dynamically Determining Feature Sets for the Efficient Classification of Mobile Device Behaviors
US20160125094A1 (en) * 2014-11-05 2016-05-05 Nec Laboratories America, Inc. Method and system for behavior query construction in temporal graphs using discriminative sub-trace mining
US9411363B2 (en) * 2014-12-10 2016-08-09 Intel Corporation Synchronization in a computing device
US10200866B1 (en) 2014-12-12 2019-02-05 Aeris Communications, Inc. Method and system for detecting and minimizing harmful network device and application behavior on cellular networks
US10275341B2 (en) * 2015-01-21 2019-04-30 Somo Innovations Ltd Mobile application usability testing
US10685142B2 (en) 2015-02-02 2020-06-16 Indiana University Research And Technology Corporation External resource control of mobile devices
US20160232353A1 (en) * 2015-02-09 2016-08-11 Qualcomm Incorporated Determining Model Protection Level On-Device based on Malware Detection in Similar Devices
US9910984B2 (en) * 2015-02-27 2018-03-06 Qualcomm Incorporated Methods and systems for on-device high-granularity classification of device behaviors using multi-label models
US9787695B2 (en) * 2015-03-24 2017-10-10 Qualcomm Incorporated Methods and systems for identifying malware through differences in cloud vs. client behavior
US10659479B2 (en) * 2015-03-27 2020-05-19 Mcafee, Llc Determination of sensor usage
WO2016178816A1 (en) 2015-05-01 2016-11-10 Lookout, Inc. Determining source of side-loaded software
US10104107B2 (en) * 2015-05-11 2018-10-16 Qualcomm Incorporated Methods and systems for behavior-specific actuation for real-time whitelisting
CN105049592B (en) * 2015-05-27 2020-02-14 中国科学院信息工程研究所 Mobile intelligent terminal voice safety protection method and system
KR102446325B1 (en) 2015-06-24 2022-09-22 삼성전자주식회사 Operating Method For Application Program and electronic device supporting the same
US9954873B2 (en) 2015-09-30 2018-04-24 The Mitre Corporation Mobile device-based intrusion prevention system
CN105426296B (en) * 2015-11-24 2018-04-10 无锡江南计算技术研究所 Internuclear collaboration multithreading PMU event monitoring methods based on inserting label
CN105653903B (en) * 2015-12-18 2019-10-08 小米科技有限责任公司 The management method and device of application program permission
US10064139B2 (en) * 2015-12-26 2018-08-28 Intel IP Corporation Context-assisted thermal management scheme in a portable device
US10133639B2 (en) 2016-02-10 2018-11-20 International Business Machines Corporation Privacy protection of media files for automatic cloud backup systems
US10552615B2 (en) 2016-02-18 2020-02-04 Swimlane Llc Threat response systems and methods
US10157134B2 (en) * 2016-04-11 2018-12-18 International Business Machines Corporation Decreasing the data handoff interval for a reserved cache line based on an early indication of a systemwide coherence response
CN106095593B (en) 2016-05-31 2019-04-16 Oppo广东移动通信有限公司 A kind of forward and backward scape application behavior synchronous method and device
CN106709342B (en) * 2016-07-01 2018-11-09 腾讯科技(深圳)有限公司 Malware detection methods and device
US10678921B2 (en) 2016-09-30 2020-06-09 AVAST Software s.r.o. Detecting malware with hash-based fingerprints
US10318723B1 (en) 2016-11-29 2019-06-11 Sprint Communications Company L.P. Hardware-trusted network-on-chip (NOC) and system-on-chip (SOC) network function virtualization (NFV) data communications
US10708282B2 (en) * 2017-03-27 2020-07-07 International Business Machines Corporation Unauthorized data access detection based on cyber security images
CA3062634A1 (en) 2017-05-10 2018-11-15 Embee Mobile, Inc. System and method for the capture of mobile behavior, usage, or content exposure
US10917423B2 (en) 2017-05-15 2021-02-09 Forcepoint, LLC Intelligently differentiating between different types of states and attributes when using an adaptive trust profile
US10999296B2 (en) 2017-05-15 2021-05-04 Forcepoint, LLC Generating adaptive trust profiles using information derived from similarly situated organizations
US10862927B2 (en) 2017-05-15 2020-12-08 Forcepoint, LLC Dividing events into sessions during adaptive trust profile operations
US10447718B2 (en) 2017-05-15 2019-10-15 Forcepoint Llc User profile definition and management
US9882918B1 (en) 2017-05-15 2018-01-30 Forcepoint, LLC User behavior profile in a blockchain
US10943019B2 (en) 2017-05-15 2021-03-09 Forcepoint, LLC Adaptive trust profile endpoint
US11888859B2 (en) 2017-05-15 2024-01-30 Forcepoint Llc Associating a security risk persona with a phase of a cyber kill chain
US10129269B1 (en) 2017-05-15 2018-11-13 Forcepoint, LLC Managing blockchain access to user profile information
US10999297B2 (en) 2017-05-15 2021-05-04 Forcepoint, LLC Using expected behavior of an entity when prepopulating an adaptive trust profile
JP6767924B2 (en) 2017-05-19 2020-10-14 東芝映像ソリューション株式会社 Systems, methods and programs
JP6767926B2 (en) 2017-05-23 2020-10-14 東芝映像ソリューション株式会社 Electronics, methods and programs
US10218697B2 (en) 2017-06-09 2019-02-26 Lookout, Inc. Use of device risk evaluation to manage access to services
US10305923B2 (en) * 2017-06-30 2019-05-28 SparkCognition, Inc. Server-supported malware detection and protection
US10318729B2 (en) 2017-07-26 2019-06-11 Forcepoint, LLC Privacy protection during insider threat monitoring
US20190141068A1 (en) * 2017-09-21 2019-05-09 Camp Mobile Corporation Online service abuser detection
US20190102543A1 (en) 2017-09-29 2019-04-04 AVAST Software s.r.o. Observation and classification of device events
US20190104141A1 (en) * 2017-10-02 2019-04-04 Zuk Avraham System and Method for Providing and Facilitating an Information Security Marketplace
US10803178B2 (en) 2017-10-31 2020-10-13 Forcepoint Llc Genericized data model to perform a security analytics operation
US10817307B1 (en) * 2017-12-20 2020-10-27 Apple Inc. API behavior modification based on power source health
US11363133B1 (en) 2017-12-20 2022-06-14 Apple Inc. Battery health-based power management
US10599199B1 (en) 2017-12-20 2020-03-24 Apple Inc. Systems and methods for power management at device shutdown
CN109471655B (en) * 2017-12-25 2021-08-13 北京安天网络安全技术有限公司 Business application updating method and system based on closed barrier model
US10311404B1 (en) 2018-01-05 2019-06-04 Accenture Global Solutions Limited Software product development defect and issue prediction and diagnosis
US11314787B2 (en) 2018-04-18 2022-04-26 Forcepoint, LLC Temporal resolution of an entity
US10949428B2 (en) 2018-07-12 2021-03-16 Forcepoint, LLC Constructing event distributions via a streaming scoring operation
US11755584B2 (en) 2018-07-12 2023-09-12 Forcepoint Llc Constructing distributions of interrelated event features
US11436512B2 (en) 2018-07-12 2022-09-06 Forcepoint, LLC Generating extracted features from an event
US11810012B2 (en) 2018-07-12 2023-11-07 Forcepoint Llc Identifying event distributions using interrelated events
US10776208B2 (en) * 2018-07-18 2020-09-15 EMC IP Holding Company LLC Distributed memory checkpointing using storage class memory systems
US11025638B2 (en) 2018-07-19 2021-06-01 Forcepoint, LLC System and method providing security friction for atypical resource access requests
US11811799B2 (en) 2018-08-31 2023-11-07 Forcepoint Llc Identifying security risks using distributions of characteristic features extracted from a plurality of events
US10248527B1 (en) * 2018-09-19 2019-04-02 Amplero, Inc Automated device-specific dynamic operation modifications
US10740656B2 (en) * 2018-09-19 2020-08-11 Hughes Network Systems, Llc Machine learning clustering models for determining the condition of a communication system
US11916953B2 (en) * 2018-09-24 2024-02-27 Cybereason, Inc. Method and mechanism for detection of pass-the-hash attacks
US11025659B2 (en) 2018-10-23 2021-06-01 Forcepoint, LLC Security system using pseudonyms to anonymously identify entities and corresponding security risk related behaviors
CN109302402A (en) * 2018-10-26 2019-02-01 北京芯盾时代科技有限公司 A kind of behavioral value method and device
US11171980B2 (en) 2018-11-02 2021-11-09 Forcepoint Llc Contagion risk detection, analysis and protection
CN111309402B (en) * 2018-12-11 2023-06-27 阿里巴巴集团控股有限公司 Data monitoring and application program processing method, device and equipment
US10853496B2 (en) 2019-04-26 2020-12-01 Forcepoint, LLC Adaptive trust profile behavioral fingerprint
US11256802B1 (en) * 2019-05-10 2022-02-22 Ca, Inc. Application behavioral fingerprints
CN110287023B (en) * 2019-06-11 2021-12-10 广州海格通信集团股份有限公司 Message processing method and device, computer equipment and readable storage medium
CN110990829B (en) * 2019-11-21 2021-09-28 支付宝(杭州)信息技术有限公司 Method, device and equipment for training GBDT model in trusted execution environment
CN111258824B (en) * 2020-01-18 2024-02-27 重庆宏帆动能科技有限公司 Incremental check point fault tolerance method based on artificial potential field in cloud computing
US11489862B2 (en) 2020-01-22 2022-11-01 Forcepoint Llc Anticipating future behavior using kill chains
US11630901B2 (en) 2020-02-03 2023-04-18 Forcepoint Llc External trigger induced behavioral analyses
US11080109B1 (en) 2020-02-27 2021-08-03 Forcepoint Llc Dynamically reweighting distributions of event observations
US11429697B2 (en) 2020-03-02 2022-08-30 Forcepoint, LLC Eventually consistent entity resolution
US11836265B2 (en) 2020-03-02 2023-12-05 Forcepoint Llc Type-dependent event deduplication
JP7280849B2 (en) * 2020-03-19 2023-05-24 株式会社日立製作所 Log integration device, log integration system, and log integration method
US11080032B1 (en) 2020-03-31 2021-08-03 Forcepoint Llc Containerized infrastructure for deployment of microservices
US11568136B2 (en) 2020-04-15 2023-01-31 Forcepoint Llc Automatically constructing lexicons from unlabeled datasets
US11516206B2 (en) 2020-05-01 2022-11-29 Forcepoint Llc Cybersecurity system having digital certificate reputation system
US11544390B2 (en) 2020-05-05 2023-01-03 Forcepoint Llc Method, system, and apparatus for probabilistic identification of encrypted files
US11895158B2 (en) 2020-05-19 2024-02-06 Forcepoint Llc Cybersecurity system having security policy visualization
US11704387B2 (en) 2020-08-28 2023-07-18 Forcepoint Llc Method and system for fuzzy matching and alias matching for streaming data sets
US11190589B1 (en) 2020-10-27 2021-11-30 Forcepoint, LLC System and method for efficient fingerprinting in cloud multitenant data loss prevention

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1182552A2 (en) * 2000-08-21 2002-02-27 Texas Instruments France Dynamic hardware configuration for energy management systems using task attributes
US6643802B1 (en) * 2000-04-27 2003-11-04 Ncr Corporation Coordinated multinode dump collection in response to a fault
WO2011147580A1 (en) * 2010-05-28 2011-12-01 Christmann Informationstechnik + Medien Gmbh & Co. Kg Multiprocessor computer system having a plurality of working processors and a plurality of monitoring processors for monitoring the working processors

Family Cites Families (206)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5870735A (en) 1996-05-01 1999-02-09 International Business Machines Corporation Method and system for generating a decision-tree classifier in parallel in a multi-processor system
US9195784B2 (en) 1998-08-31 2015-11-24 Cadence Design Systems, Inc. Common shared memory in a verification system
US6532541B1 (en) 1999-01-22 2003-03-11 The Trustees Of Columbia University In The City Of New York Method and apparatus for image authentication
US6647260B2 (en) 1999-04-09 2003-11-11 Openwave Systems Inc. Method and system facilitating web based provisioning of two-way mobile communications devices
US6681331B1 (en) 1999-05-11 2004-01-20 Cylant, Inc. Dynamic software system intrusion detection
JP2002033798A (en) * 2000-07-14 2002-01-31 Shinji Aoyama System and method for data backup for portable telephone set
US7234126B2 (en) 2000-08-23 2007-06-19 Interuniversitair Microelektronica Centrum Task concurrency management design method
US7600014B2 (en) 2000-11-16 2009-10-06 Symantec Corporation Method and system for monitoring the performance of a distributed application
US20040068721A1 (en) 2000-11-17 2004-04-08 O'neill Patrick Network for updating firmware and / or software in wireless communication devices
US20030037237A1 (en) 2001-04-09 2003-02-20 Jean-Paul Abgrall Systems and methods for computer device authentication
US7051327B1 (en) 2001-05-08 2006-05-23 Gateway Inc. System for providing data backup and restore with updated version by creating data package based upon configuration data application data and user response to suggestion
US7849360B2 (en) 2001-05-21 2010-12-07 Vir2Us, Inc. Computer system and method of controlling communication port to prevent computer contamination by virus or malicious code
US7401359B2 (en) 2001-12-21 2008-07-15 Mcafee, Inc. Generating malware definition data for mobile computing devices
US7290282B1 (en) 2002-04-08 2007-10-30 Symantec Corporation Reducing false positive computer virus detections
US7694139B2 (en) 2002-10-24 2010-04-06 Symantec Corporation Securing executable content using a trusted computing platform
US7103772B2 (en) 2003-05-02 2006-09-05 Giritech A/S Pervasive, user-centric network security enabled by dynamic datagram switch and an on-demand authentication and encryption scheme through mobile intelligent data carriers
US8201249B2 (en) 2003-05-14 2012-06-12 Northrop Grumman Systems Corporation Steady state computer intrusion and misuse detection
US8458805B2 (en) 2003-06-23 2013-06-04 Architecture Technology Corporation Digital forensic analysis using empirical privilege profiling (EPP) for filtering collected data
EP1668117A4 (en) 2003-08-18 2006-12-13 Gen Hospital Corp Nanotopographic compositions and methods for cellular organization in tissue engineered structures
KR100623552B1 (en) 2003-12-29 2006-09-18 한국정보보호진흥원 Method of risk analysis in automatic intrusion response system
US7694150B1 (en) 2004-06-22 2010-04-06 Cisco Technology, Inc System and methods for integration of behavioral and signature based security
CN101023662B (en) 2004-07-20 2010-08-04 高通股份有限公司 Method and apparatus for motion vector processing
US7793262B2 (en) 2004-07-29 2010-09-07 International Business Machines Corporation Method and apparatus for facilitating software testing and report generation with interactive graphical user interface
US7559053B2 (en) 2004-08-24 2009-07-07 Microsoft Corporation Program and system performance data correlation
US7877621B2 (en) 2004-09-03 2011-01-25 Virginia Tech Intellectual Properties, Inc. Detecting software attacks by monitoring electric power consumption patterns
KR100645735B1 (en) 2004-10-14 2006-11-15 주식회사 팬택 Apparatus And Method For Detecting Contents Bug Communication Of The Mobile Platform
US8108929B2 (en) 2004-10-19 2012-01-31 Reflex Systems, LLC Method and system for detecting intrusive anomalous use of a software system using multiple detection algorithms
US7561877B2 (en) 2005-03-18 2009-07-14 Qualcomm Incorporated Apparatus and methods for managing malfunctions on a wireless device
US7881291B2 (en) 2005-05-26 2011-02-01 Alcatel Lucent Packet classification acceleration using spectral analysis
US20060288209A1 (en) 2005-06-20 2006-12-21 Vogler Dean H Method and apparatus for secure inter-processor communications
US20070006304A1 (en) 2005-06-30 2007-01-04 Microsoft Corporation Optimizing malware recovery
US8161548B1 (en) 2005-08-15 2012-04-17 Trend Micro, Inc. Malware detection using pattern classification
US8045958B2 (en) 2005-11-21 2011-10-25 Research In Motion Limited System and method for application program operation on a wireless device
US7809670B2 (en) 2005-12-09 2010-10-05 Microsoft Corporation Classification of malware using clustering that orders events in accordance with the time of occurance
US8381297B2 (en) 2005-12-13 2013-02-19 Yoggie Security Systems Ltd. System and method for providing network security to mobile devices
US20070174490A1 (en) 2006-01-25 2007-07-26 Greystripe Inc. System and methods for managing content in pre-existing mobile applications
US8490194B2 (en) 2006-01-31 2013-07-16 Robert Moskovitch Method and system for detecting malicious behavioral patterns in a computer, using machine learning
IL181041A0 (en) 2007-01-29 2007-07-04 Deutsche Telekom Ag Improved method and system for detecting malicious behavioral patterns in a computer, using machine learning
US7831237B2 (en) * 2006-02-03 2010-11-09 Broadcom Corporation Authenticating mobile network provider equipment
KR100791290B1 (en) 2006-02-10 2008-01-04 삼성전자주식회사 Apparatus and method for using information of malicious application's behavior across devices
US20070220327A1 (en) 2006-02-23 2007-09-20 Evergrid, Inc., A Delaware Corporation Dynamically Controlled Checkpoint Timing
EP1999925B1 (en) 2006-03-27 2011-07-06 Telecom Italia S.p.A. A method and system for identifying malicious messages in mobile communication networks, related network and computer program product therefor
WO2007117636A2 (en) 2006-04-06 2007-10-18 Smobile Systems, Inc. Malware detection system and method for comprssed data on mobile platforms
US20070283170A1 (en) 2006-06-05 2007-12-06 Kabushiki Kaisha Toshiba System and method for secure inter-process data communication
KR101225374B1 (en) 2006-06-09 2013-01-22 삼성전자주식회사 Apparatus and method for device management in mobile communication terminal
US20080016339A1 (en) 2006-06-29 2008-01-17 Jayant Shukla Application Sandbox to Detect, Remove, and Prevent Malware
US20080047009A1 (en) 2006-07-20 2008-02-21 Kevin Overcash System and method of securing networks against applications threats
US8788829B2 (en) 2006-08-17 2014-07-22 Aol Inc. System and method for interapplication communications
US7774599B2 (en) 2006-09-15 2010-08-10 Panasonic Corporation Methodologies to secure inter-process communication based on trust
US8201244B2 (en) 2006-09-19 2012-06-12 Microsoft Corporation Automated malware signature generation
WO2008043109A2 (en) 2006-10-06 2008-04-10 Smobile Systems, Inc. System and method of reporting and visualizing malware on mobile networks
US7747575B2 (en) 2006-11-07 2010-06-29 Magix Ag Application-specific intelligent backup and restore system
WO2008067335A2 (en) 2006-11-27 2008-06-05 Smobile Systems, Inc. Wireless intrusion prevention system and method
US8225093B2 (en) 2006-12-05 2012-07-17 Qualcomm Incorporated Providing secure inter-application communication for a mobile operating environment
US7650317B2 (en) 2006-12-06 2010-01-19 Microsoft Corporation Active learning framework for automatic field extraction from network traffic
US7778792B2 (en) 2006-12-08 2010-08-17 Chumby Industries, Inc. Systems and methods for location, motion, and contact detection and tracking in a networked audiovisual device
JP4805116B2 (en) 2006-12-11 2011-11-02 株式会社日立製作所 Information processing system, information processing system control method, service using device, and service providing device
US7945955B2 (en) 2006-12-18 2011-05-17 Quick Heal Technologies Private Limited Virus detection in mobile devices having insufficient resources to execute virus detection software
US8769099B2 (en) 2006-12-28 2014-07-01 Yahoo! Inc. Methods and systems for pre-caching information on a mobile computing device
US9021605B2 (en) 2007-01-03 2015-04-28 International Business Machines Corporation Method and system for protecting sensitive data in a program
US7996005B2 (en) * 2007-01-17 2011-08-09 Eagency, Inc. Mobile communication device monitoring systems and methods
CA2680231A1 (en) 2007-03-05 2009-05-14 Yoggie Security Systems Ltd. System and method for providing data and device security between external and host devices
JP4618263B2 (en) 2007-03-23 2011-01-26 株式会社豊田中央研究所 Software behavior monitoring apparatus and software behavior monitoring system
US8331987B2 (en) * 2007-04-19 2012-12-11 Apple Inc. Personal area network systems and devices and methods for use thereof
JP2008271126A (en) * 2007-04-19 2008-11-06 Ntt Docomo Inc Mobile terminal apparatus and diagnosis method for mobile terminal apparatus
US20080301796A1 (en) 2007-05-31 2008-12-04 Microsoft Corporation Adjusting the Levels of Anti-Malware Protection
JP4956292B2 (en) 2007-06-25 2012-06-20 パナソニック株式会社 Information security apparatus and counter control method
US8239505B2 (en) 2007-06-29 2012-08-07 Microsoft Corporation Progressively implementing declarative models in distributed systems
US8713680B2 (en) 2007-07-10 2014-04-29 Samsung Electronics Co., Ltd. Method and apparatus for modeling computer program behaviour for behavioural detection of malicious program
US8245295B2 (en) 2007-07-10 2012-08-14 Samsung Electronics Co., Ltd. Apparatus and method for detection of malicious program using program behavior
US7890443B2 (en) 2007-07-13 2011-02-15 Microsoft Corporation Learning classifiers using combined boosting and weight trimming
US20100199264A1 (en) * 2007-08-02 2010-08-05 Naoto Maeda Pattern inspection system, pattern inspection device, method and pattern inspection program
CN101350054B (en) 2007-10-15 2011-05-25 北京瑞星信息技术有限公司 Method and apparatus for automatically protecting computer noxious program
JP2011513804A (en) 2008-01-02 2011-04-28 サンディスク アイエル リミテッド Storage devices that receive direct user access
US8160975B2 (en) 2008-01-25 2012-04-17 Mcafee, Inc. Granular support vector machine with random granularity
US8719936B2 (en) 2008-02-01 2014-05-06 Northeastern University VMM-based intrusion detection system
US8595834B2 (en) 2008-02-04 2013-11-26 Samsung Electronics Co., Ltd Detecting unauthorized use of computing devices based on behavioral patterns
US7676573B2 (en) 2008-02-08 2010-03-09 Microsoft Corporation Node monitor client cache synchronization for mobile device management
US8320329B2 (en) 2008-03-24 2012-11-27 Cisco Technology, Inc. Policy for a roaming terminal based on a home internet protocol (IP) address
US20090288080A1 (en) 2008-05-13 2009-11-19 Partridge Lucas W Method of Delivering Software Over a Network
US8108323B2 (en) 2008-05-19 2012-01-31 Yahoo! Inc. Distributed spam filtering utilizing a plurality of global classifiers and a local classifier
US20090293121A1 (en) 2008-05-21 2009-11-26 Bigus Joseph P Deviation detection of usage patterns of computer resources
IL191744A0 (en) 2008-05-27 2009-02-11 Yuval Elovici Unknown malcode detection using classifiers with optimal training sets
US20090327168A1 (en) 2008-06-26 2009-12-31 Yahoo! Inc. Playful incentive for labeling content
JP2010016443A (en) 2008-07-01 2010-01-21 Toshiba Corp Situation recognizing apparatus, situation recognizing method, and radio terminal apparatus
JP4710933B2 (en) 2008-07-09 2011-06-29 ソニー株式会社 Learning device, learning method, and program
GB2461870B (en) 2008-07-14 2012-02-29 F Secure Oyj Malware detection
US8069128B2 (en) 2008-08-08 2011-11-29 Yahoo! Inc. Real-time ad-hoc spam filtering of email
US8775333B1 (en) 2008-08-20 2014-07-08 Symantec Corporation Systems and methods for generating a threat classifier to determine a malicious process
US8095964B1 (en) 2008-08-29 2012-01-10 Symantec Corporation Peer computer based threat detection
US8245315B2 (en) 2008-09-10 2012-08-14 Qualcomm Incorporated Remote diagnosis of unauthorized hardware change
US8504504B2 (en) 2008-09-26 2013-08-06 Oracle America, Inc. System and method for distributed denial of service identification and prevention
US8490188B2 (en) 2008-10-16 2013-07-16 Qualys, Inc. Systems and methods for assessing the compliance of a computer across a network
US8087067B2 (en) 2008-10-21 2011-12-27 Lookout, Inc. Secure mobile platform system
US9235704B2 (en) 2008-10-21 2016-01-12 Lookout, Inc. System and method for a scanning API
US8984628B2 (en) 2008-10-21 2015-03-17 Lookout, Inc. System and method for adverse mobile application identification
US8533844B2 (en) 2008-10-21 2013-09-10 Lookout, Inc. System and method for security data collection and analysis
US8347386B2 (en) 2008-10-21 2013-01-01 Lookout, Inc. System and method for server-coupled malware prevention
US9537613B2 (en) 2008-10-24 2017-01-03 Qualcomm Incorporated Acknowledgment based on short cell radio network temporary identifier
US20100107257A1 (en) 2008-10-29 2010-04-29 International Business Machines Corporation System, method and program product for detecting presence of malicious software running on a computer system
IL195081A0 (en) 2008-11-03 2011-08-01 Deutche Telekom Ag Acquisition of malicious code using active learning
JP4576452B2 (en) * 2008-11-06 2010-11-10 イーソル株式会社 Operating system and information processing apparatus
DE102008043954A1 (en) 2008-11-21 2010-05-27 Robert Bosch Gmbh Sensor network system, transmission protocol, method for recognizing an object and computer program
US8549625B2 (en) 2008-12-12 2013-10-01 International Business Machines Corporation Classification of unwanted or malicious software through the identification of encrypted data communication
US20100153371A1 (en) 2008-12-16 2010-06-17 Yahoo! Inc. Method and apparatus for blending search results
CN101770453A (en) 2008-12-31 2010-07-07 华建机器翻译有限公司 Chinese text coreference resolution method based on domain ontology through being combined with machine learning model
US20100192222A1 (en) 2009-01-23 2010-07-29 Microsoft Corporation Malware detection using multiple classifiers
US8793758B2 (en) 2009-01-28 2014-07-29 Headwater Partners I Llc Security, fraud detection, and fraud mitigation in device-assisted services systems
US20100192201A1 (en) 2009-01-29 2010-07-29 Breach Security, Inc. Method and Apparatus for Excessive Access Rate Detection
EP2222048A1 (en) * 2009-02-24 2010-08-25 BRITISH TELECOMMUNICATIONS public limited company Detecting malicious behaviour on a computer network
US8266698B1 (en) 2009-03-09 2012-09-11 Symantec Corporation Using machine infection characteristics for behavior-based detection of malware
CA2789243A1 (en) 2009-03-13 2010-09-16 Rutgers, The State University Of New Jersey Systems and methods for the detection of malware
US8490187B2 (en) 2009-03-20 2013-07-16 Microsoft Corporation Controlling malicious activity detection using behavioral models
US8683554B2 (en) 2009-03-27 2014-03-25 Wavemarket, Inc. System and method for managing third party application program access to user information via a native application program interface (API)
US8161130B2 (en) 2009-04-10 2012-04-17 Microsoft Corporation Bottom-up analysis of network sites
JP5244686B2 (en) 2009-04-24 2013-07-24 株式会社東芝 Monitoring device and server
US8918876B2 (en) 2009-04-30 2014-12-23 Telefonaktiebolaget L M Ericsson (Publ) Deviating behaviour of a user terminal
US8694624B2 (en) 2009-05-19 2014-04-08 Symbol Technologies, Inc. Systems and methods for concurrent wireless local area network access and sensing
US8356001B2 (en) 2009-05-19 2013-01-15 Xybersecure, Inc. Systems and methods for application-level security
US8332945B2 (en) 2009-06-05 2012-12-11 The Regents Of The University Of Michigan System and method for detecting energy consumption anomalies and mobile malware variants
US9074897B2 (en) 2009-06-15 2015-07-07 Qualcomm Incorporated Real-time data with post-processing
US8701192B1 (en) 2009-06-30 2014-04-15 Symantec Corporation Behavior based signatures
US20110013528A1 (en) 2009-07-16 2011-01-20 Chen Byron H Method for providing presence and location information of mobiles in a wireless network
US8776218B2 (en) * 2009-07-21 2014-07-08 Sophos Limited Behavioral-based host intrusion prevention system
US8311956B2 (en) 2009-08-11 2012-11-13 At&T Intellectual Property I, L.P. Scalable traffic classifier and classifier training system
US8953472B2 (en) * 2009-09-01 2015-02-10 Nec Europe Ltd. Method for monitoring a network and network including a monitoring functionality
CA2712002C (en) 2009-09-09 2016-08-30 Aastra Technologies Limited Diagnostics methods for a communications device
US8509755B2 (en) 2009-10-30 2013-08-13 Research In Motion Limited System and method for activating a component on an electronic device
US8397301B2 (en) 2009-11-18 2013-03-12 Lookout, Inc. System and method for identifying and assessing vulnerabilities on a mobile communication device
EP2326057A1 (en) 2009-11-20 2011-05-25 British Telecommunications public limited company Detecting malicious behaviour on a network
US20110161452A1 (en) 2009-12-24 2011-06-30 Rajesh Poornachandran Collaborative malware detection and prevention on mobile devices
JP2011138219A (en) * 2009-12-25 2011-07-14 Toshiba Corp Device and method for displaying result of parallel program analysis
US8806620B2 (en) 2009-12-26 2014-08-12 Intel Corporation Method and device for managing security events
US20120254333A1 (en) 2010-01-07 2012-10-04 Rajarathnam Chandramouli Automated detection of deception in short and multilingual electronic messages
US8458809B2 (en) 2010-01-20 2013-06-04 Research In Motion Limited Apparatus, and an associated method, for facilitating secure operations of a wireless device
US20120331137A1 (en) 2010-03-01 2012-12-27 Nokia Corporation Method and apparatus for estimating user characteristics based on user interaction data
US20110219449A1 (en) * 2010-03-04 2011-09-08 St Neitzel Michael Malware detection method, system and computer program product
KR101051641B1 (en) 2010-03-30 2011-07-26 주식회사 안철수연구소 Mobile communication terminal and behavior based checking virus program method using the same
US8694744B1 (en) 2010-03-31 2014-04-08 Emc Corporation Mobile device snapshot backup
US9043254B2 (en) 2010-04-12 2015-05-26 Siemens Aktiengesellschaft Method for computer-aided closed-loop and/or open-loop control of a technical system
EP3242465B1 (en) 2010-04-26 2020-01-01 BlackBerry Limited Mobile wireless communications device providing enhanced file transfer management features and related methods
US8570993B2 (en) 2010-05-20 2013-10-29 At&T Mobility Ii Llc Wi-Fi intelligent selection engine
US9449175B2 (en) 2010-06-03 2016-09-20 Nokia Technologies Oy Method and apparatus for analyzing and detecting malicious software
CN101882000B (en) 2010-06-18 2012-08-22 华南理工大学 Gesture identification method based on acceleration sensor
US20120180126A1 (en) 2010-07-13 2012-07-12 Lei Liu Probable Computing Attack Detector
US20120016633A1 (en) 2010-07-16 2012-01-19 Andreas Wittenstein System and method for automatic detection of anomalous recurrent behavior
US9294946B2 (en) 2010-08-27 2016-03-22 Qualcomm Incorporated Adaptive automatic detail diagnostic log collection in a wireless communication system
US8424093B2 (en) 2010-11-01 2013-04-16 Kaspersky Lab Zao System and method for updating antivirus cache
US8683591B2 (en) 2010-11-18 2014-03-25 Nant Holdings Ip, Llc Vector-based anomaly detection
US8875286B2 (en) 2010-12-01 2014-10-28 Cisco Technology, Inc. Method and apparatus for detecting malicious software using machine learning techniques
US20120151479A1 (en) 2010-12-10 2012-06-14 Salesforce.Com, Inc. Horizontal splitting of tasks within a homogenous pool of virtual machines
US9710645B2 (en) 2010-12-23 2017-07-18 Ebay Inc. Systems and methods to detect and neutralize malware infected electronic communications
US20120167218A1 (en) 2010-12-23 2012-06-28 Rajesh Poornachandran Signature-independent, system behavior-based malware detection
US8640245B2 (en) 2010-12-24 2014-01-28 Kaspersky Lab, Zao Optimization of anti-malware processing by automated correction of detection rules
US8762298B1 (en) 2011-01-05 2014-06-24 Narus, Inc. Machine learning based botnet detection using real-time connectivity graph based traffic features
CN102591696A (en) 2011-01-14 2012-07-18 中国科学院软件研究所 Method and system for extracting behavioral data of mobile phone software
US9326698B2 (en) 2011-02-18 2016-05-03 The Trustees Of The University Of Pennsylvania Method for automatic, unsupervised classification of high-frequency oscillations in physiological recordings
US8695095B2 (en) 2011-03-11 2014-04-08 At&T Intellectual Property I, L.P. Mobile malicious software mitigation
US8554912B1 (en) * 2011-03-14 2013-10-08 Sprint Communications Company L.P. Access management for wireless communication devices failing authentication for a communication network
JP5665188B2 (en) * 2011-03-31 2015-02-04 インターナショナル・ビジネス・マシーンズ・コーポレーションInternational Business Machines Corporation System for inspecting information processing equipment to which software update is applied
US8533857B2 (en) 2011-04-12 2013-09-10 Teletech Holdings, Inc. Methods for providing cross-vendor support services
RU2454705C1 (en) 2011-04-19 2012-06-27 Закрытое акционерное общество "Лаборатория Касперского" System and method of protecting computing device from malicious objects using complex infection schemes
KR101906834B1 (en) 2011-04-19 2018-10-11 삼성전자주식회사 Device and method for selecting resource of application in wireless terminal
CN102790758B (en) 2011-05-18 2017-08-18 海尔集团公司 Firewall system and its processing method
US9323928B2 (en) 2011-06-01 2016-04-26 Mcafee, Inc. System and method for non-signature based detection of malicious processes
US8819471B2 (en) 2011-06-03 2014-08-26 Apple Inc. Methods and apparatus for power state based backup
US20120317306A1 (en) 2011-06-10 2012-12-13 Microsoft Corporation Statistical Network Traffic Signature Analyzer
US9152882B2 (en) 2011-06-17 2015-10-06 Microsoft Technology Licensing, Llc. Location-aided recognition
US9286182B2 (en) 2011-06-17 2016-03-15 Microsoft Technology Licensing, Llc Virtual machine snapshotting and analysis
CN102202102B (en) * 2011-07-05 2014-08-13 施昊 Network service polymerization system and polymerization method thereof based on cloud computing configuration
US20130203440A1 (en) 2011-07-27 2013-08-08 Qualcomm Labs, Inc. Selectively performing a positioning procedure at an access terminal based on a behavior model
US8984581B2 (en) 2011-07-27 2015-03-17 Seven Networks, Inc. Monitoring mobile application activities for malicious traffic on a mobile device
CN102369514B (en) * 2011-08-31 2013-09-11 华为技术有限公司 Method and system for establishing detection points
US8782412B2 (en) 2011-08-31 2014-07-15 AstherPal Inc. Secured privileged access to an embedded client on a mobile device
US20130066815A1 (en) 2011-09-13 2013-03-14 Research In Motion Limited System and method for mobile context determination
EP2610776B1 (en) 2011-09-16 2019-08-21 Veracode, Inc. Automated behavioural and static analysis using an instrumented sandbox and machine learning classification for mobile security
US8793593B2 (en) 2011-09-21 2014-07-29 Facebook, Inc. Integrating structured objects and actions generated on external systems into a social networking system
US9143529B2 (en) 2011-10-11 2015-09-22 Citrix Systems, Inc. Modifying pre-existing mobile applications to implement enterprise security policies
CN104205114B (en) 2011-11-29 2018-08-07 索尼移动通信公司 System and method for providing safe interprocess communication
US9413538B2 (en) 2011-12-12 2016-08-09 Microsoft Technology Licensing, Llc Cryptographic certification of secure hosted execution environments
US9071636B2 (en) 2011-12-21 2015-06-30 Verizon Patent And Licensing Inc. Predictive scoring management system for application behavior
US9712530B2 (en) 2012-01-06 2017-07-18 Optio Labs, Inc. Systems and methods for enforcing security in mobile computing
US8943204B2 (en) 2012-01-23 2015-01-27 Cellco Partnership Method and system for conserving network resources when sending information to mobile devices
US9832211B2 (en) 2012-03-19 2017-11-28 Qualcomm, Incorporated Computing device to detect malware
US9439077B2 (en) 2012-04-10 2016-09-06 Qualcomm Incorporated Method for malicious activity detection in a mobile station
US20130304677A1 (en) 2012-05-14 2013-11-14 Qualcomm Incorporated Architecture for Client-Cloud Behavior Analyzer
US9298494B2 (en) 2012-05-14 2016-03-29 Qualcomm Incorporated Collaborative learning for efficient behavioral analysis in networked mobile device
US9690635B2 (en) 2012-05-14 2017-06-27 Qualcomm Incorporated Communicating behavior information in a mobile computing device
US9609456B2 (en) 2012-05-14 2017-03-28 Qualcomm Incorporated Methods, devices, and systems for communicating behavioral analysis information
US9324034B2 (en) 2012-05-14 2016-04-26 Qualcomm Incorporated On-device real-time behavior analyzer
US9202047B2 (en) 2012-05-14 2015-12-01 Qualcomm Incorporated System, apparatus, and method for adaptive observation of mobile device behavior
EP2680182B1 (en) 2012-06-29 2016-03-16 GSMK Gesellschaft für sichere Mobile Kommunikation mbH Mobile device and method to monitor a baseband processor in relation to the actions on an application processor
US20140032358A1 (en) 2012-07-25 2014-01-30 Aro, Inc. Sharing Recommendation Agents
US20140150100A1 (en) 2012-08-15 2014-05-29 Qualcomm Incorporated Adaptive Observation of Driver and Hardware Level Behavioral Features on a Mobile Device
US9495537B2 (en) 2012-08-15 2016-11-15 Qualcomm Incorporated Adaptive observation of behavioral features on a mobile device
US9747440B2 (en) 2012-08-15 2017-08-29 Qualcomm Incorporated On-line behavioral analysis engine in mobile device with multiple analyzer model providers
US9330257B2 (en) * 2012-08-15 2016-05-03 Qualcomm Incorporated Adaptive observation of behavioral features on a mobile device
US9319897B2 (en) 2012-08-15 2016-04-19 Qualcomm Incorporated Secure behavior analysis over trusted execution environment
US20140096246A1 (en) 2012-10-01 2014-04-03 Google Inc. Protecting users from undesirable content
US9684870B2 (en) 2013-01-02 2017-06-20 Qualcomm Incorporated Methods and systems of using boosted decision stumps and joint feature selection and culling algorithms for the efficient classification of mobile device behaviors
US10089582B2 (en) 2013-01-02 2018-10-02 Qualcomm Incorporated Using normalized confidence values for classifying mobile device behaviors
US9686023B2 (en) 2013-01-02 2017-06-20 Qualcomm Incorporated Methods and systems of dynamically generating and using device-specific and device-state-specific classifier models for the efficient classification of mobile device behaviors
US9742559B2 (en) 2013-01-22 2017-08-22 Qualcomm Incorporated Inter-module authentication for securing application execution integrity within a computing device
US9491187B2 (en) 2013-02-15 2016-11-08 Qualcomm Incorporated APIs for obtaining device-specific behavior classifier models from the cloud
WO2014165230A1 (en) 2013-03-13 2014-10-09 Lookout, Inc. System and method for changing security behavior of a device based on proximity to another device
US20140279745A1 (en) 2013-03-14 2014-09-18 Sm4rt Predictive Systems Classification based on prediction of accuracy of multiple data models

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6643802B1 (en) * 2000-04-27 2003-11-04 Ncr Corporation Coordinated multinode dump collection in response to a fault
EP1182552A2 (en) * 2000-08-21 2002-02-27 Texas Instruments France Dynamic hardware configuration for energy management systems using task attributes
WO2011147580A1 (en) * 2010-05-28 2011-12-01 Christmann Informationstechnik + Medien Gmbh & Co. Kg Multiprocessor computer system having a plurality of working processors and a plurality of monitoring processors for monitoring the working processors

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015157108A1 (en) * 2014-04-08 2015-10-15 Qualcomm Incorporated Method and system for inferring application states by performing behavioral analysis operations in a mobile device
CN106133642A (en) * 2014-04-08 2016-11-16 高通股份有限公司 The method and system of application state is inferred in a mobile device by performing behavior analysis operation
US9684787B2 (en) 2014-04-08 2017-06-20 Qualcomm Incorporated Method and system for inferring application states by performing behavioral analysis operations in a mobile device
JP2017517796A (en) * 2014-04-08 2017-06-29 クアルコム,インコーポレイテッド Method and system for inferring application state by performing behavior analysis operations on a mobile device
JP2017536594A (en) * 2014-09-11 2017-12-07 クアルコム,インコーポレイテッド Method and system for aggregate multi-application behavior analysis of mobile device behavior

Also Published As

Publication number Publication date
IN2014MN02172A (en) 2015-08-28
WO2013172881A1 (en) 2013-11-21
TW201407406A (en) 2014-02-16
US9152787B2 (en) 2015-10-06
CN104272787A (en) 2015-01-07
EP2850524A1 (en) 2015-03-25
US9292685B2 (en) 2016-03-22
KR20150013298A (en) 2015-02-04
EP2850865A1 (en) 2015-03-25
CN104272786A (en) 2015-01-07
US9202047B2 (en) 2015-12-01
WO2013172865A1 (en) 2013-11-21
WO2013172877A1 (en) 2013-11-21
US20130305101A1 (en) 2013-11-14
CN104272786B (en) 2018-06-12
CN104303538A (en) 2015-01-21
US20130305358A1 (en) 2013-11-14
JP6110482B2 (en) 2017-04-05
CN104303156A (en) 2015-01-21
KR20150008493A (en) 2015-01-22
US20130305359A1 (en) 2013-11-14
KR101626243B1 (en) 2016-05-31
EP2850865B1 (en) 2018-09-19
US20150148109A1 (en) 2015-05-28
US20140245306A1 (en) 2014-08-28
EP2850524B1 (en) 2019-10-02
US9898602B2 (en) 2018-02-20
KR102103613B1 (en) 2020-04-22
CN104272787B (en) 2018-08-24
EP2850864A1 (en) 2015-03-25
IN2014MN02026A (en) 2015-08-14
US9349001B2 (en) 2016-05-24
JP2015520452A (en) 2015-07-16
US20130303154A1 (en) 2013-11-14
US9189624B2 (en) 2015-11-17
CN104303156B (en) 2017-03-01
CN104303538B (en) 2018-06-15
EP2850864B1 (en) 2017-09-13

Similar Documents

Publication Publication Date Title
US9189624B2 (en) Adaptive observation of behavioral features on a heterogeneous platform
US9448859B2 (en) Exploiting hot application programming interfaces (APIs) and action patterns for efficient storage of API logs on mobile devices for behavioral analysis
US9607146B2 (en) Data flow based behavioral analysis on mobile devices
US9495537B2 (en) Adaptive observation of behavioral features on a mobile device
EP2949144B1 (en) Adaptive observation of behavioral features on a mobile device
US9158604B1 (en) Lightweight data-flow tracker for realtime behavioral analysis using control flow
EP3485415B1 (en) Devices and methods for classifying an execution session
US9330257B2 (en) Adaptive observation of behavioral features on a mobile device
US9147072B2 (en) Method and system for performing behavioral analysis operations in a mobile device based on application state
US9519533B2 (en) Data flow tracking via memory monitoring
US20140150100A1 (en) Adaptive Observation of Driver and Hardware Level Behavioral Features on a Mobile Device
WO2015112760A1 (en) Adaptive observation of determined behavioral features on a mobile device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13718700

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2013718700

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2015512656

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE