WO2017112126A1 - Starting application processors of a virtual machine - Google Patents

Starting application processors of a virtual machine Download PDF

Info

Publication number
WO2017112126A1
WO2017112126A1 PCT/US2016/061846 US2016061846W WO2017112126A1 WO 2017112126 A1 WO2017112126 A1 WO 2017112126A1 US 2016061846 W US2016061846 W US 2016061846W WO 2017112126 A1 WO2017112126 A1 WO 2017112126A1
Authority
WO
WIPO (PCT)
Prior art keywords
processor
virtual machine
application processor
execution
start state
Prior art date
Application number
PCT/US2016/061846
Other languages
French (fr)
Inventor
Arumugam Thiyagarajah
Gaurav Khanna
Stalinselvaraj Jeyasingh
Sohil Mehta
Mukesh J. Jagasia
Original Assignee
Intel Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intel Corporation filed Critical Intel Corporation
Priority to DE112016005868.3T priority Critical patent/DE112016005868T5/en
Priority to CN201680067913.2A priority patent/CN108292233B/en
Publication of WO2017112126A1 publication Critical patent/WO2017112126A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/4401Bootstrapping
    • G06F9/4406Loading of operating system
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/4401Bootstrapping
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/4401Bootstrapping
    • G06F9/4403Processor initialisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • G06F2009/45575Starting, stopping, suspending or resuming virtual machine instances
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • G06F2009/45579I/O management, e.g. providing access to device drivers or storage

Definitions

  • the present disclosure relates to the field of computing. More particularly, the present disclosure relates to the starting of application processors of a virtual machine.
  • the guest operating system (OS) of the VM first boots the virtual Boot Strapping Processor (BSP) of the VM, which in turn, sequentially boots all virtual Application Processors (AP) of the VM in a specified order.
  • BSP Boot Strapping Processor
  • AP Application Processors
  • the virtual BSP sends an INIT-SIPI-SIPI IPI sequence to start the virtual AP (hereinafter, simply AP).
  • VMM virtual machine monitor
  • Figure 1 illustrates a computing device having the virtual machine application processor startup technology of the present disclosure, according to various embodiments.
  • FIG. 2 illustrates an example process of the BSP startup module, according to various embodiments.
  • FIG. 3 illustrates an example process of the VMM, according to the various embodiments.
  • Figure 4 illustrates an example process of the AP startup module, according to various embodiments.
  • FIG. 5 illustrates an example computer system suitable for use to practice aspects of the present disclosure, according to various embodiments.
  • Figure 6 illustrates a storage medium having instructions for practicing methods described with references to Figures 2-4, according to various embodiments.
  • an apparatus for computing may include a plurality of processor cores; and a plurality of operating system modules of an operating system.
  • the operating system modules may include a BSP startup module to be operated by a first of the plurality of processor cores selected to be a BSP of a VM while the VM is being started up, to write into a storage area a start state of an AP of the VM; and an AP startup module to be operated by a second of the plurality of processor cores selected to be the AP, to start the AP at the start state, directly in a protected mode of execution without first going through a real mode of execution.
  • phrase “A and/or B” means (A), (B), or (A and B).
  • phrase “A, B, and/or C” means (A), (B), (C), (A and B), (A and C), (B and C), or (A, B and C).
  • module may refer to, be part of, or include an
  • ASIC Application Specific Integrated Circuit
  • an electronic circuit a processor (shared, dedicated, or group) and/or memory (shared, dedicated, or group) that execute one or more software or firmware programs, a combinational logic circuit, and/or other suitable components that provide the described functionality.
  • processor shared, dedicated, or group
  • memory shared, dedicated, or group
  • computing device 100 may include hardware 101, firmware (FW)/basic input/output services (BIOS) 106, VMM 120 and one or more VMs 122, operatively coupled with each other as shown.
  • Hardware 101 may include one or more processors 102 with multiple processor cores.
  • VM 122 may include a virtual BSP 111 mapped to a selected one of the processors cores of processor 102, and a number of virtual APs 110 mapped to selected corresponding ones of the processor cores of processor 102.
  • VM 122 may further include OS 112 and a number of applications 114.
  • OS 112 may include a number of services and/or utilities 130, which may include a BSP startup module 132 and an AP startup module 134.
  • Applications 114 may be any application known in the art.
  • BSP startup module 132, AP startup module 134 and VMM 130 may be incorporated with the virtual machine AP startup technology of the present disclosure to directly start APs 110 in a protected mode of execution without first going through a real mode of execution.
  • Processor(s) 102 may be any one of a number of processors known in the art, having one or more processor cores.
  • hardware 101 may further include memory 104, I/O devices 108, or other elements (not shown).
  • Memory 104 may be any known volatile or non-volatile memory in the art, suitable for storing data.
  • Memory 104 may include a hierarchy of cache memory and system memory. Both the cache and system memory may be respectively organized into cache pages and memory pages.
  • I/O devices 108 may include communication or networking interfaces, such as Ethernet, WiFi, 3G/4G, Bluetooth®, Near Field Communication, Universal Serial Bus (USB) and so forth, storage devices, such as solid state, magnetic and/or optical drives, input devices, such as keyboard, mouse, touch sensitive screen, and so forth, and output devices, such as, display devices, printers, and so forth.
  • communication or networking interfaces such as Ethernet, WiFi, 3G/4G, Bluetooth®, Near Field Communication, Universal Serial Bus (USB) and so forth
  • storage devices such as solid state, magnetic and/or optical drives
  • input devices such as keyboard, mouse, touch sensitive screen, and so forth
  • output devices such as, display devices, printers, and so forth.
  • FW/BIOS 106 may be any one of a number FW/BIOS known in the art. Except for virtual machine application processor startup technology, OS 112 may likewise be any one of a number of OS known in the art, e.g., the Windows OS from Microsoft®
  • Applications 114 may likewise be any one of a number of applications known in the art.
  • process 200 may include the operations performed at blocks 202-208.
  • the operations at blocks 202-208 may be performed e.g., by BSP module 132 of Figure 1, operated by virtual BSP 111 mapped to a selected one of the processor cores of processor 102.
  • Process 200 may start at block 202.
  • a determination may be made on whether there are still more AP to be started for a VM being started. The determination may be performed e.g., by BSP module 132 on bootup by OS 112 at startup of VM 122.
  • the startup state of the next AP to be started may be set up.
  • the startup state of the next AP to be started may be set up in a general purpose register of the BSP of the VM.
  • the startup state may include various execution control values at startup, e.g., the next instruction pointer, stack pointer values, memory parameters, and so forth.
  • the startup state may include the value of the (extended) instruction pointer (IP or EIP) register, the values of the various segmentation registers (i.e., the global descriptor table (GDT), and the CS, DS, ES, FS registers), and so forth.
  • the control register may be the model specific register (MSR) of the BSP of the VM.
  • execution control may be transferred to the VMM.
  • the transfer of the execution control may explicitly or implicitly include the location of the data of the startup state.
  • writing into the control register (e.g., the MSR) of the BSP may result in a trap from the control register to the VMM.
  • process 200 may wait for a startup completion signal or message from the AP being started. Eventually, on receipt of the startup completion signal or message from the AP being started, process 200 may return to block 202, and continue therefrom, as earlier described.
  • process 200 may end (as opposed to proceed to block 204).
  • FIG. 3 illustrates an example process of the VMM, according to the various embodiments.
  • process 300 may include the operations performed at blocks 302-306.
  • the operations at blocks 302-306 may be performed e.g., by VMM 120 of Figure 1, operated by one or more of the processor cores of processor 102.
  • Process 300 may start at block 302.
  • the startup state of the next AP to be started for a VM being started (as set up by the BSP module of the VM) may be retrieved.
  • VMM 120 may retrieve the startup state of the next AP to be started from the general purpose register of the corresponding BSP (where the trap came from).
  • the retrieved startup state of the next AP to be started may be programmed into a control structure of the VM, accessible to the AP to be started.
  • the AP may be started (e.g., by the VMM) to execute at the start state programmed into the control structure of the VM.
  • Figure 4 illustrates an example process of the application processor startup module, according to various embodiments.
  • process 400 may include the operations performed at blocks 402-406.
  • the operations at blocks 402-406 may be performed e.g., by AP module 134 of Figure 1, operated by one of the virtual APs 110 mapped to a selected one of the processor cores of processor 102.
  • Process 400 may start at block 402.
  • execution of AP may start directly at a protected mode, without first going through a real mode of execution, at the start state as programmed in the control structure of the VM.
  • the protected mode of execution may be started with memory paging.
  • the AP may be initialized.
  • the BSP may be signaled to notify the BSP of initialization complete, or a completion message may be sent. Accordingly, an improved approach to starting APs of a VM has been described.
  • the advantage of the virtual machine AP startup technology of the present disclosure may include speeding up the virtual machine AP startup process, and/or reduces the complexity of the VMM, by not requiring the VMM to support real-mode execution during AP startup. The advantage may be significant, especially when a VM is configured with multiple APs to be started.
  • FIG. 5 illustrates an example computer system that may be suitable for use to practice selected aspects of the present disclosure.
  • computer 500 may include one or more processors with multiple processor cores 502, read-only memory (ROM) 503, and system memory 504. Additionally, computer system 500 may include mass storage devices 506.
  • mass storage devices 506 may include, but are not limited to, tape drives, hard drives, compact disc read-only memory (CD-ROM) and so forth).
  • computer system 500 may include input/output devices 508 (such as display, keyboard, cursor control and so forth) and communication interfaces 510 (such as network interface cards, modems and so forth).
  • input/output devices 508 such as display, keyboard, cursor control and so forth
  • communication interfaces 510 such as network interface cards, modems and so forth.
  • the elements may be coupled to each other via system bus 512, which may represent one or more buses. In the case of multiple buses, they may be bridged by one or more bus bridges (not shown).
  • ROM 503 may include basic input/output system services (BIOS) 505.
  • BIOS basic input/output system services
  • System memory 504 and mass storage devices 506 may be employed to store a working copy and a permanent copy of the programming instructions implementing the operations associated with BSP startup module 132, AP startup module 134, and/or VMM 120 as earlier described, collectively referred to as computational logic 522.
  • the various elements may be implemented by assembler instructions supported by processor(s) 502 or high-level languages, such as, for example, C, that can be compiled into such instructions.
  • the number, capability and/or capacity of these elements 510 - 512 may vary, depending on whether computer system 500 is used as a mobile device, such as a wearable device, a smartphone, a computer tablet, a laptop and so forth, or a stationary device, such as a desktop computer, a server, a game console, a set-top box, an infotainment console, and so forth. Otherwise, the constitutions of elements 510-512 are known, and accordingly will not be further described.
  • the present disclosure may be embodied as methods or computer program products. Accordingly, the present disclosure, in addition to being embodied in hardware as earlier described, may take the form of an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to as a "circuit," "module” or “system.” Furthermore, the present disclosure may take the form of a computer program product embodied in any tangible or non-transitory medium of expression having computer-usable program code embodied in the medium.
  • Non-transitory computer-readable storage medium 602 may include a number of programming instructions 604.
  • Programming instructions 604 may be configured to enable a device, e.g., computer 500, in response to execution of the programming instructions, to implement (aspects of) BSP startup module 132, AP startup module 134 and/or VMM 120.
  • programming instructions 604 may be disposed on multiple computer-readable non-transitory storage media 602 instead.
  • programming instructions 604 may be disposed on computer-readable transitory storage media 602, such as, signals.
  • the computer-usable or computer-readable medium may be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium. More specific examples (a non- exhaustive list) of the computer-readable medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a transmission media such as those supporting the Internet or an intranet, or a magnetic storage device.
  • the computer- usable or computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted, or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory.
  • a computer-usable or computer- readable medium may be any medium that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
  • the computer- usable medium may include a propagated data signal with the computer-usable program code embodied therewith, either in baseband or as part of a carrier wave.
  • the computer usable program code may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc.
  • Computer program code for carrying out operations of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages.
  • the program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
  • the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
  • LAN local area network
  • WAN wide area network
  • Internet Service Provider for example, AT&T, MCI, Sprint, EarthLink, MSN, GTE, etc.
  • These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
  • These computer program instructions may also be stored in a computer-readable medium that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable medium produce an article of manufacture including instruction means which implement the function/act specified in the flowchart and/or block diagram block or blocks.
  • the computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
  • each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s).
  • the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
  • Embodiments may be implemented as a computer process, a computing system or as an article of manufacture such as a computer program product of computer readable media.
  • the computer program product may be a computer storage medium readable by a computer system and encoding a computer program instructions for executing a computer process.
  • processors 602 may be packaged together with memory having aspects of BSP startup module 132, AP startup module 134 and/or VMM 120.
  • processors 602 may be packaged together with memory having aspects of BSP startup module 132, AP startup module 134 and/or VMM 120, to form a System in Package (SiP).
  • SiP System in Package
  • processors 602 may be integrated on the same die with memory having aspects of BSP startup module 132, AP startup module 134 and/or VMM 120.
  • processors 602 may be packaged together with memory having aspects of BSP startup module 132, AP startup module 134 and/or VMM 120, to form a System on Chip (SoC).
  • SoC System on Chip
  • the SoC may be utilized in, e.g., but not limited to, a wearable device, a smartphone or a computing tablet.
  • Example 1 may be an apparatus for computing, comprising: a plurality of processor cores; and a plurality of operating system modules of an operating system, including: a bootstrap processor startup module to be operated by a first of the plurality of processor cores selected to be a bootstrap processor of a virtual machine while the virtual machine is being started up, to write into a storage area a start state of an application processor of the virtual machine; and an application processor startup module to be operated by a second of the plurality of processor cores selected to be the application processor, to start the application processor at the start state, directly in a protected mode of execution without first going through a real mode of execution.
  • a bootstrap processor startup module to be operated by a first of the plurality of processor cores selected to be a bootstrap processor of a virtual machine while the virtual machine is being started up, to write into a storage area a start state of an application processor of the virtual machine
  • an application processor startup module to be operated by a second of the plurality of processor cores selected to be the application processor, to start
  • Example 2 may be example 1, wherein the bootstrap processor startup module, on writing the start state of the application processor into the storage area, may further transfer execution control to a virtual machine manager of the apparatus.
  • Example 3 may be example 2, wherein the transfer of execution control may include explicit or implicit provision of the location of the storage area to the virtual machine manager.
  • Example 4 may be example 2, wherein the storage area may be a control register of the bootstrap processor, and the execution control may be transferred to the virtual machine manager via a trap from the control register.
  • Example 5 may be any one of examples 2-4, further comprising the virtual machine manager, wherein the virtual machine manager may be operated by the one or more processor cores to retrieve the start state of the application from the storage area, program the start state of the application processor into a control structure of the virtual machine accessible to the application processor, and set the application processor to start execution at the start state programmed in the control structure, on receipt of the execution control.
  • the virtual machine manager may be operated by the one or more processor cores to retrieve the start state of the application from the storage area, program the start state of the application processor into a control structure of the virtual machine accessible to the application processor, and set the application processor to start execution at the start state programmed in the control structure, on receipt of the execution control.
  • Example 6 may be example 5, wherein the application processor startup module may further start the application processor directly in the protected mode of execution with memory paging.
  • Example 7 may be example 5, wherein the application processor startup module may further initialize the application processor, and signal the boostrap processor startup module on completion of the initialization.
  • Example 8 may be example 7, wherein the bootstrap processor startup module may further await for the completion signal prior to perform another write into the storage area of another start state of another application processor of the virtual machine.
  • Example 9 may be a method for computing, comprising: writing into a storage area of an apparatus, by a bootstrap processor startup module operated by a first of a plurality of processor cores of the apparatus selected to be a bootstrap processor of a virtual machine, a start state of an application processor of the virtual machine, while the virtual machine may be being started up; and starting, by an application processor startup module to be operated by a second of the plurality of processor cores selected to be the application processor, the application processor at the start state, directly in a protected mode of execution without first going through a real mode of execution.
  • Example 10 may be example 9, further comprising transferring execution control, by the bootstrap processor startup module, to a virtual machine manager of the apparatus, on writing the start state of the application processor into the storage area.
  • Example 11 may be example 10, wherein transferring execution control may include explicitly or implicitly providing the location of the storage area to the virtual machine manager.
  • Example 12 may be example 10, wherein the storage area may be a control register of the bootstrap processor, and transferring of the execution control comprises trapping to the virtual machine manager from the control register.
  • Example 13 may be any one of examples 10-12, further comprising retrieving, by the virtual machine manager, the start state of the application from the storage area, programming the start state of the application processor into a control structure of the virtual machine accessible to the application processor, and setting the application processor to start execution at the start state programmed in the control structure, on receipt of the execution control.
  • Example 14 may be example 13, further comprising starting, by the application processor startup module, the application processor directly in the protected mode of execution with memory paging.
  • Example 15 may be example 13, further comprising initializing, by the application processor startup module, the application processor, and signaling the boostrap processor startup module on completion of the initialization.
  • Example 16 may be example 15, further comprising awaiting, by the bootstrap processor startup module, the completion signal prior to perform another write into the storage area of another start state of another application processor of the virtual machine.
  • Example 17 may be one or more computer-readable media comprising instructions that cause a computing device, in response to execution of the instructions by a plurality of processor cores of the computing device, to provide: a bootstrap processor startup module to be operated by a first of the plurality of processor cores selected to be a bootstrap processor of a virtual machine while the virtual machine may be being started up, to write into a storage area of the computing device a start state of an application processor of the virtual machine; and an application processor startup module to be operated by a second of the plurality of processor cores selected to be the application processor, to start the application processor at the start state, directly in a protected mode of execution without first going through a real mode of execution.
  • a bootstrap processor startup module to be operated by a first of the plurality of processor cores selected to be a bootstrap processor of a virtual machine while the virtual machine may be being started up, to write into a storage area of the computing device a start state of an application processor of the virtual machine
  • an application processor startup module to be operated by a
  • Example 18 may be example 17, wherein the bootstrap processor startup module, on writing the start state of the application processor into the storage area, may further transfer execution control to a virtual machine manager of the apparatus.
  • Example 19 may be example 18, wherein the transfer of execution control may include explicit or implicit provision of the location of the storage area to the virtual machine manager.
  • Example 20 may be example 18, wherein the storage area may be a control register of the bootstrap processor, and the execution control may be transferred to the virtual machine manager via a trap from the control register.
  • Example 21 may be any one of examples 18-20, further comprising the virtual machine manager, wherein the virtual machine manager may be operated by the one or more processor cores to retrieve the start state of the application from the storage area, program the start state of the application processor into a control structure of the virtual machine accessible to the application processor, and set the application processor to start execution at the start state programmed in the control structure, on receipt of the execution control.
  • the virtual machine manager may be operated by the one or more processor cores to retrieve the start state of the application from the storage area, program the start state of the application processor into a control structure of the virtual machine accessible to the application processor, and set the application processor to start execution at the start state programmed in the control structure, on receipt of the execution control.
  • Example 22 may be example 21, wherein the application processor startup module may further start the application processor directly in the protected mode of execution with memory paging.
  • Example 23 may be example 21, wherein the application processor startup module may further initialize the application processor, and signal the boostrap processor startup module on completion of the initialization.
  • Example 24 may be example 23, wherein the bootstrap processor startup module may further await for the completion signal prior to perform another write into the storage area of another start state of another application processor of the virtual machine.
  • Example 25 may be an apparatus for computing, comprising: bootstrap processor means for writing into a storage area of a bootstrap processor of a virtual machine of the apparatus, a start state of an application processor of the virtual machine, while the virtual machine may be being started up; and application processor means for starting the application processor at the start state, directly in a protected mode of execution without first going through a real mode of execution.
  • Example 26 may be example 25, wherein the bootstrap processor means may comprise means for transferring execution control to a virtual machine manager of the apparatus, on writing the start state of the application processor into the storage area.
  • Example 27 may be example 26, wherein transferring execution control may include explicitly or implicitly providing the location of the storage area to the virtual machine manager.
  • Example 28 may be example 26, wherein the storage area may be a control register of the bootstrap processor, and transferring of the execution control comprises trapping to the virtual machine manager from the control register.
  • Example 29 may be example 26-28, wherein the virtual machine manager may comprise means for retrieving the start state of the application from the storage area, means for programming the start state of the application processor into a control structure of the virtual machine accessible to the application processor, and means for setting the application processor to start execution at the start state programmed in the control structure, on receipt of the execution control.
  • Example 30 may be example 29, wherein the application processor means comprises means for starting the application processor directly in the protected mode of execution with memory paging.
  • Example 31 may be example 29, the application processor means may comprise means for initializing the application processor, and means for signaling the boostrap processor startup module on completion of the initialization.
  • Example 32 may be example 31 , wherein the bootstrap processor means may comprise means for awaiting the completion signal prior to perform another write into the storage area of another start state of another application processor of the virtual machine.

Abstract

Apparatuses, methods and storage medium associated with virtual machine application processor startup, are disclosed herein. In embodiments, an apparatus for computing may include a plurality of processor cores; and a plurality of OS modules of an OS. The OS modules may include a BSP module and an AP module. The BSP module may be configured to write into a storage area a start state of an AP of a VM, while the VM is being started up; and the AP module may be configured to start the AP at the start state, directly in a protected mode of execution without first going through a real mode of execution. Other embodiments may be described and/or claimed.

Description

STARTING APPLICATION PROCESSORS OF A VIRTUAL
MACHINE
Related Application
This application claims priority to U.S. Patent Application 14/976,990, entitled
"STARTING APPLICATION PROCESSORS OF A VIRTUAL MACHINE," filed December 21, 2015.
Technical Field
The present disclosure relates to the field of computing. More particularly, the present disclosure relates to the starting of application processors of a virtual machine.
Background
The background description provided herein is for the purpose of generally presenting the context of the disclosure. Unless otherwise indicated herein, the materials described in this section are not prior art to the claims in this application and are not admitted to be prior art by inclusion in this section.
Typically, during the startup of a virtual machine (VM), the guest operating system (OS) of the VM first boots the virtual Boot Strapping Processor (BSP) of the VM, which in turn, sequentially boots all virtual Application Processors (AP) of the VM in a specified order. For Intel x86 execution environment, the virtual BSP (hereinafter, simply BSP) sends an INIT-SIPI-SIPI IPI sequence to start the virtual AP (hereinafter, simply AP).
Each woken AP will begin execution in x86 real mode, and later switches into a protected mode, e.g., a 32-bit protected mode. Accordingly, the virtual machine monitor (VMM) (also referred to as hypervisor) is required to support real mode execution during AP startup, which increases the complexity of the VMM. (INIT = Initialization, IPI = Inter- Processor Interrupt, SIPI = Startup IPI.)
Brief Description of the Drawings
Embodiments will be readily understood by the following detailed description in conjunction with the accompanying drawings. To facilitate this description, like reference numerals designate like structural elements. Embodiments are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings.
Figure 1 illustrates a computing device having the virtual machine application processor startup technology of the present disclosure, according to various embodiments.
Figure 2 illustrates an example process of the BSP startup module, according to various embodiments.
Figure 3 illustrates an example process of the VMM, according to the various embodiments.
Figure 4 illustrates an example process of the AP startup module, according to various embodiments.
Figure 5 illustrates an example computer system suitable for use to practice aspects of the present disclosure, according to various embodiments.
Figure 6 illustrates a storage medium having instructions for practicing methods described with references to Figures 2-4, according to various embodiments.
Detailed Description
Apparatuses, methods and storage medium associated with virtual machine application processor startup, are disclosed herein. In embodiments, an apparatus for computing may include a plurality of processor cores; and a plurality of operating system modules of an operating system. The operating system modules may include a BSP startup module to be operated by a first of the plurality of processor cores selected to be a BSP of a VM while the VM is being started up, to write into a storage area a start state of an AP of the VM; and an AP startup module to be operated by a second of the plurality of processor cores selected to be the AP, to start the AP at the start state, directly in a protected mode of execution without first going through a real mode of execution.
In the following detailed description, reference is made to the accompanying drawings which form a part hereof wherein like numerals designate like parts throughout, and in which is shown by way of illustration embodiments that may be practiced. It is to be understood that other embodiments may be utilized and structural or logical changes may be made without departing from the scope of the present disclosure. Therefore, the following detailed description is not to be taken in a limiting sense, and the scope of embodiments is defined by the appended claims and their equivalents.
Aspects of the disclosure are disclosed in the accompanying description. Alternate embodiments of the present disclosure and their equivalents may be devised without parting from the spirit or scope of the present disclosure. It should be noted that like elements disclosed below are indicated by like reference numbers in the drawings.
Various operations may be described as multiple discrete actions or operations in turn, in a manner that is most helpful in understanding the claimed subject matter.
However, the order of description should not be construed as to imply that these operations are necessarily order dependent. In particular, these operations may not be performed in the order of presentation. Operations described may be performed in a different order than the described embodiment. Various additional operations may be performed and/or described operations may be omitted in additional embodiments.
For the purposes of the present disclosure, the phrase "A and/or B" means (A), (B), or (A and B). For the purposes of the present disclosure, the phrase "A, B, and/or C" means (A), (B), (C), (A and B), (A and C), (B and C), or (A, B and C).
The description may use the phrases "in an embodiment," or "in embodiments," which may each refer to one or more of the same or different embodiments. Furthermore, the terms "comprising," "including," "having," and the like, as used with respect to embodiments of the present disclosure, are synonymous.
As used herein, the term "module" may refer to, be part of, or include an
Application Specific Integrated Circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group) and/or memory (shared, dedicated, or group) that execute one or more software or firmware programs, a combinational logic circuit, and/or other suitable components that provide the described functionality.
Referring now to Figure 1, wherein a computing device having the virtual machine application processor startup technology of the present disclosure, according to various embodiments, is shown. As illustrated, in embodiments, computing device 100 may include hardware 101, firmware (FW)/basic input/output services (BIOS) 106, VMM 120 and one or more VMs 122, operatively coupled with each other as shown. Hardware 101 may include one or more processors 102 with multiple processor cores. VM 122 may include a virtual BSP 111 mapped to a selected one of the processors cores of processor 102, and a number of virtual APs 110 mapped to selected corresponding ones of the processor cores of processor 102. VM 122 may further include OS 112 and a number of applications 114. OS 112 may include a number of services and/or utilities 130, which may include a BSP startup module 132 and an AP startup module 134. Applications 114 may be any application known in the art. As will be described in more detail below, BSP startup module 132, AP startup module 134 and VMM 130 may be incorporated with the virtual machine AP startup technology of the present disclosure to directly start APs 110 in a protected mode of execution without first going through a real mode of execution. These and other aspects related to application execution enclave management will be further described below with references to Figures 2-4.
Processor(s) 102 may be any one of a number of processors known in the art, having one or more processor cores. In embodiments, hardware 101 may further include memory 104, I/O devices 108, or other elements (not shown). Memory 104 may be any known volatile or non-volatile memory in the art, suitable for storing data. Memory 104 may include a hierarchy of cache memory and system memory. Both the cache and system memory may be respectively organized into cache pages and memory pages. Examples of I/O devices 108 may include communication or networking interfaces, such as Ethernet, WiFi, 3G/4G, Bluetooth®, Near Field Communication, Universal Serial Bus (USB) and so forth, storage devices, such as solid state, magnetic and/or optical drives, input devices, such as keyboard, mouse, touch sensitive screen, and so forth, and output devices, such as, display devices, printers, and so forth.
FW/BIOS 106 may be any one of a number FW/BIOS known in the art. Except for virtual machine application processor startup technology, OS 112 may likewise be any one of a number of OS known in the art, e.g., the Windows OS from Microsoft®
Corporation. Applications 114 may likewise be any one of a number of applications known in the art.
Referring now to Figure 2, wherein an example process of the BSP module, according to various embodiments, is shown. As illustrated, process 200 may include the operations performed at blocks 202-208. The operations at blocks 202-208 may be performed e.g., by BSP module 132 of Figure 1, operated by virtual BSP 111 mapped to a selected one of the processor cores of processor 102.
Process 200 may start at block 202. At block 202, a determination may be made on whether there are still more AP to be started for a VM being started. The determination may be performed e.g., by BSP module 132 on bootup by OS 112 at startup of VM 122.
If there are still more AP to be started, at block 204, the startup state of the next AP to be started may be set up. In embodiments, the startup state of the next AP to be started may be set up in a general purpose register of the BSP of the VM. The startup state may include various execution control values at startup, e.g., the next instruction pointer, stack pointer values, memory parameters, and so forth. In embodiments, e.g., in X86 execution environments, the startup state may include the value of the (extended) instruction pointer (IP or EIP) register, the values of the various segmentation registers (i.e., the global descriptor table (GDT), and the CS, DS, ES, FS registers), and so forth. In embodiments, the control register may be the model specific register (MSR) of the BSP of the VM.
Next, at block 206, on setting up of the startup state of the next AP to be started, execution control may be transferred to the VMM. The transfer of the execution control may explicitly or implicitly include the location of the data of the startup state. In embodiments, writing into the control register (e.g., the MSR) of the BSP may result in a trap from the control register to the VMM.
Next at block 208, process 200 may wait for a startup completion signal or message from the AP being started. Eventually, on receipt of the startup completion signal or message from the AP being started, process 200 may return to block 202, and continue therefrom, as earlier described.
Eventually, when all APs of the VM being started has been started, from block 202, process 200 may end (as opposed to proceed to block 204).
Figure 3 illustrates an example process of the VMM, according to the various embodiments. As illustrated, process 300 may include the operations performed at blocks 302-306. The operations at blocks 302-306 may be performed e.g., by VMM 120 of Figure 1, operated by one or more of the processor cores of processor 102.
Process 300 may start at block 302. At block 302, the startup state of the next AP to be started for a VM being started (as set up by the BSP module of the VM) may be retrieved. For example, on receipt of execution control (as trapped from the control register of the VM), VMM 120 may retrieve the startup state of the next AP to be started from the general purpose register of the corresponding BSP (where the trap came from).
Next, at block 304, the retrieved startup state of the next AP to be started may be programmed into a control structure of the VM, accessible to the AP to be started.
Next, at block 306, the AP may be started (e.g., by the VMM) to execute at the start state programmed into the control structure of the VM.
Figure 4 illustrates an example process of the application processor startup module, according to various embodiments. As illustrated, process 400 may include the operations performed at blocks 402-406. The operations at blocks 402-406 may be performed e.g., by AP module 134 of Figure 1, operated by one of the virtual APs 110 mapped to a selected one of the processor cores of processor 102.
Process 400 may start at block 402. At 402, execution of AP may start directly at a protected mode, without first going through a real mode of execution, at the start state as programmed in the control structure of the VM. In embodiments, the protected mode of execution may be started with memory paging.
At block 404, on retrieval of the start state as programmed in the control structure of the VM, the AP may be initialized.
At block 406, on completion of initialization, the BSP may be signaled to notify the BSP of initialization complete, or a completion message may be sent. Accordingly, an improved approach to starting APs of a VM has been described. The advantage of the virtual machine AP startup technology of the present disclosure may include speeding up the virtual machine AP startup process, and/or reduces the complexity of the VMM, by not requiring the VMM to support real-mode execution during AP startup. The advantage may be significant, especially when a VM is configured with multiple APs to be started.
Figure 5 illustrates an example computer system that may be suitable for use to practice selected aspects of the present disclosure. As shown, computer 500 may include one or more processors with multiple processor cores 502, read-only memory (ROM) 503, and system memory 504. Additionally, computer system 500 may include mass storage devices 506. Example of mass storage devices 506 may include, but are not limited to, tape drives, hard drives, compact disc read-only memory (CD-ROM) and so forth).
Further, computer system 500 may include input/output devices 508 (such as display, keyboard, cursor control and so forth) and communication interfaces 510 (such as network interface cards, modems and so forth). The elements may be coupled to each other via system bus 512, which may represent one or more buses. In the case of multiple buses, they may be bridged by one or more bus bridges (not shown).
Each of these elements may perform its conventional functions known in the art. In particular, ROM 503 may include basic input/output system services (BIOS) 505. System memory 504 and mass storage devices 506 may be employed to store a working copy and a permanent copy of the programming instructions implementing the operations associated with BSP startup module 132, AP startup module 134, and/or VMM 120 as earlier described, collectively referred to as computational logic 522. The various elements may be implemented by assembler instructions supported by processor(s) 502 or high-level languages, such as, for example, C, that can be compiled into such instructions.
The number, capability and/or capacity of these elements 510 - 512 may vary, depending on whether computer system 500 is used as a mobile device, such as a wearable device, a smartphone, a computer tablet, a laptop and so forth, or a stationary device, such as a desktop computer, a server, a game console, a set-top box, an infotainment console, and so forth. Otherwise, the constitutions of elements 510-512 are known, and accordingly will not be further described.
As will be appreciated by one skilled in the art, the present disclosure may be embodied as methods or computer program products. Accordingly, the present disclosure, in addition to being embodied in hardware as earlier described, may take the form of an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to as a "circuit," "module" or "system." Furthermore, the present disclosure may take the form of a computer program product embodied in any tangible or non-transitory medium of expression having computer-usable program code embodied in the medium. Figure 6 illustrates an example computer-readable non-transitory storage medium that may be suitable for use to store instructions that cause an apparatus, in response to execution of the instructions by the apparatus, to practice selected aspects of the present disclosure. As shown, non-transitory computer-readable storage medium 602 may include a number of programming instructions 604. Programming instructions 604 may be configured to enable a device, e.g., computer 500, in response to execution of the programming instructions, to implement (aspects of) BSP startup module 132, AP startup module 134 and/or VMM 120. In alternate embodiments, programming instructions 604 may be disposed on multiple computer-readable non-transitory storage media 602 instead. In still other embodiments, programming instructions 604 may be disposed on computer-readable transitory storage media 602, such as, signals.
Any combination of one or more computer usable or computer readable medium(s) may be utilized. The computer-usable or computer-readable medium may be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium. More specific examples (a non- exhaustive list) of the computer-readable medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a transmission media such as those supporting the Internet or an intranet, or a magnetic storage device. Note that the computer- usable or computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted, or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory. In the context of this document, a computer-usable or computer- readable medium may be any medium that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The computer- usable medium may include a propagated data signal with the computer-usable program code embodied therewith, either in baseband or as part of a carrier wave. The computer usable program code may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc.
Computer program code for carrying out operations of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
The present disclosure is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program
instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable medium that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable medium produce an article of manufacture including instruction means which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used herein, the singular forms "a," "an" and "the" are intended to include plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms
"comprises" and/or "comprising," when used in this specification, specific the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operation, elements, components, and/or groups thereof.
Embodiments may be implemented as a computer process, a computing system or as an article of manufacture such as a computer program product of computer readable media. The computer program product may be a computer storage medium readable by a computer system and encoding a computer program instructions for executing a computer process.
The corresponding structures, material, acts, and equivalents of all means or steps plus function elements in the claims below are intended to include any structure, material or act for performing the function in combination with other claimed elements are specifically claimed. The description of the present disclosure has been presented for purposes of illustration and description, but is not intended to be exhaustive or limited to the disclosure in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill without departing from the scope and spirit of the disclosure. The embodiment was chosen and described in order to best explain the principles of the disclosure and the practical application, and to enable others of ordinary skill in the art to understand the disclosure for embodiments with various modifications as are suited to the particular use contemplated.
Referring back to Figure 5, for one embodiment, at least one of processors 602 may be packaged together with memory having aspects of BSP startup module 132, AP startup module 134 and/or VMM 120. For one embodiment, at least one of processors 602 may be packaged together with memory having aspects of BSP startup module 132, AP startup module 134 and/or VMM 120, to form a System in Package (SiP). For one embodiment, at least one of processors 602 may be integrated on the same die with memory having aspects of BSP startup module 132, AP startup module 134 and/or VMM 120. For one embodiment, at least one of processors 602 may be packaged together with memory having aspects of BSP startup module 132, AP startup module 134 and/or VMM 120, to form a System on Chip (SoC). For at least one embodiment, the SoC may be utilized in, e.g., but not limited to, a wearable device, a smartphone or a computing tablet.
Thus various example embodiments of the present disclosure have been described including, but are not limited to:
Example 1 may be an apparatus for computing, comprising: a plurality of processor cores; and a plurality of operating system modules of an operating system, including: a bootstrap processor startup module to be operated by a first of the plurality of processor cores selected to be a bootstrap processor of a virtual machine while the virtual machine is being started up, to write into a storage area a start state of an application processor of the virtual machine; and an application processor startup module to be operated by a second of the plurality of processor cores selected to be the application processor, to start the application processor at the start state, directly in a protected mode of execution without first going through a real mode of execution.
Example 2 may be example 1, wherein the bootstrap processor startup module, on writing the start state of the application processor into the storage area, may further transfer execution control to a virtual machine manager of the apparatus.
Example 3 may be example 2, wherein the transfer of execution control may include explicit or implicit provision of the location of the storage area to the virtual machine manager.
Example 4 may be example 2, wherein the storage area may be a control register of the bootstrap processor, and the execution control may be transferred to the virtual machine manager via a trap from the control register.
Example 5 may be any one of examples 2-4, further comprising the virtual machine manager, wherein the virtual machine manager may be operated by the one or more processor cores to retrieve the start state of the application from the storage area, program the start state of the application processor into a control structure of the virtual machine accessible to the application processor, and set the application processor to start execution at the start state programmed in the control structure, on receipt of the execution control.
Example 6 may be example 5, wherein the application processor startup module may further start the application processor directly in the protected mode of execution with memory paging.
Example 7 may be example 5, wherein the application processor startup module may further initialize the application processor, and signal the boostrap processor startup module on completion of the initialization.
Example 8 may be example 7, wherein the bootstrap processor startup module may further await for the completion signal prior to perform another write into the storage area of another start state of another application processor of the virtual machine.
Example 9 may be a method for computing, comprising: writing into a storage area of an apparatus, by a bootstrap processor startup module operated by a first of a plurality of processor cores of the apparatus selected to be a bootstrap processor of a virtual machine, a start state of an application processor of the virtual machine, while the virtual machine may be being started up; and starting, by an application processor startup module to be operated by a second of the plurality of processor cores selected to be the application processor, the application processor at the start state, directly in a protected mode of execution without first going through a real mode of execution.
Example 10 may be example 9, further comprising transferring execution control, by the bootstrap processor startup module, to a virtual machine manager of the apparatus, on writing the start state of the application processor into the storage area.
Example 11 may be example 10, wherein transferring execution control may include explicitly or implicitly providing the location of the storage area to the virtual machine manager. Example 12 may be example 10, wherein the storage area may be a control register of the bootstrap processor, and transferring of the execution control comprises trapping to the virtual machine manager from the control register.
Example 13 may be any one of examples 10-12, further comprising retrieving, by the virtual machine manager, the start state of the application from the storage area, programming the start state of the application processor into a control structure of the virtual machine accessible to the application processor, and setting the application processor to start execution at the start state programmed in the control structure, on receipt of the execution control.
Example 14 may be example 13, further comprising starting, by the application processor startup module, the application processor directly in the protected mode of execution with memory paging.
Example 15 may be example 13, further comprising initializing, by the application processor startup module, the application processor, and signaling the boostrap processor startup module on completion of the initialization.
Example 16 may be example 15, further comprising awaiting, by the bootstrap processor startup module, the completion signal prior to perform another write into the storage area of another start state of another application processor of the virtual machine.
Example 17 may be one or more computer-readable media comprising instructions that cause a computing device, in response to execution of the instructions by a plurality of processor cores of the computing device, to provide: a bootstrap processor startup module to be operated by a first of the plurality of processor cores selected to be a bootstrap processor of a virtual machine while the virtual machine may be being started up, to write into a storage area of the computing device a start state of an application processor of the virtual machine; and an application processor startup module to be operated by a second of the plurality of processor cores selected to be the application processor, to start the application processor at the start state, directly in a protected mode of execution without first going through a real mode of execution.
Example 18 may be example 17, wherein the bootstrap processor startup module, on writing the start state of the application processor into the storage area, may further transfer execution control to a virtual machine manager of the apparatus.
Example 19 may be example 18, wherein the transfer of execution control may include explicit or implicit provision of the location of the storage area to the virtual machine manager. Example 20 may be example 18, wherein the storage area may be a control register of the bootstrap processor, and the execution control may be transferred to the virtual machine manager via a trap from the control register.
Example 21 may be any one of examples 18-20, further comprising the virtual machine manager, wherein the virtual machine manager may be operated by the one or more processor cores to retrieve the start state of the application from the storage area, program the start state of the application processor into a control structure of the virtual machine accessible to the application processor, and set the application processor to start execution at the start state programmed in the control structure, on receipt of the execution control.
Example 22 may be example 21, wherein the application processor startup module may further start the application processor directly in the protected mode of execution with memory paging.
Example 23 may be example 21, wherein the application processor startup module may further initialize the application processor, and signal the boostrap processor startup module on completion of the initialization.
Example 24 may be example 23, wherein the bootstrap processor startup module may further await for the completion signal prior to perform another write into the storage area of another start state of another application processor of the virtual machine.
Example 25 may be an apparatus for computing, comprising: bootstrap processor means for writing into a storage area of a bootstrap processor of a virtual machine of the apparatus, a start state of an application processor of the virtual machine, while the virtual machine may be being started up; and application processor means for starting the application processor at the start state, directly in a protected mode of execution without first going through a real mode of execution.
Example 26 may be example 25, wherein the bootstrap processor means may comprise means for transferring execution control to a virtual machine manager of the apparatus, on writing the start state of the application processor into the storage area.
Example 27 may be example 26, wherein transferring execution control may include explicitly or implicitly providing the location of the storage area to the virtual machine manager.
Example 28 may be example 26, wherein the storage area may be a control register of the bootstrap processor, and transferring of the execution control comprises trapping to the virtual machine manager from the control register. Example 29 may be example 26-28, wherein the virtual machine manager may comprise means for retrieving the start state of the application from the storage area, means for programming the start state of the application processor into a control structure of the virtual machine accessible to the application processor, and means for setting the application processor to start execution at the start state programmed in the control structure, on receipt of the execution control.
Example 30 may be example 29, wherein the application processor means comprises means for starting the application processor directly in the protected mode of execution with memory paging.
Example 31 may be example 29, the application processor means may comprise means for initializing the application processor, and means for signaling the boostrap processor startup module on completion of the initialization.
Example 32 may be example 31 , wherein the bootstrap processor means may comprise means for awaiting the completion signal prior to perform another write into the storage area of another start state of another application processor of the virtual machine.
It will be apparent to those skilled in the art that various modifications and variations can be made in the disclosed embodiments of the disclosed device and associated methods without departing from the spirit or scope of the disclosure. Thus, it is intended that the present disclosure covers the modifications and variations of the embodiments disclosed above provided that the modifications and variations come within the scope of any claims and their equivalents.

Claims

Claims What is claimed is:
1. An apparatus for computing, comprising:
a plurality of processor cores; and
a plurality of operating system modules of an operating system, including:
a bootstrap processor startup module to be operated by a first of the plurality of processor cores selected to be a bootstrap processor of a virtual machine while the virtual machine is being started up, to write into a storage area a start state of an application processor of the virtual machine; and
an application processor startup module to be operated by a second of the plurality of processor cores selected to be the application processor, to start the application processor at the start state, directly in a protected mode of execution without first going through a real mode of execution.
2. The apparatus of claim 1 , wherein the bootstrap processor startup module, on writing the start state of the application processor into the storage area, is to further transfer execution control to a virtual machine manager of the apparatus.
3. The apparatus of claim 2, wherein the transfer of execution control includes explicit or implicit provision of the location of the storage area to the virtual machine manager.
4. The apparatus of claim 2, wherein the storage area is a control register of the bootstrap processor, and the execution control is transferred to the virtual machine manager via a trap from the control register.
5. The apparatus of any one of claims 2-4, further comprising the virtual machine manager, wherein the virtual machine manager is to be operated by the one or more processor cores to retrieve the start state of the application from the storage area, program the start state of the application processor into a control structure of the virtual machine accessible to the application processor, and set the application processor to start execution at the start state programmed in the control structure, on receipt of the execution control.
6. The apparatus of claim 5, wherein the application processor startup module is to further start the application processor directly in the protected mode of execution with memory paging.
7. The apparatus of claim 5, wherein the application processor startup module is to further initialize the application processor, and signal the boostrap processor startup module on completion of the initialization.
8. The apparatus of claim 7, wherein the bootstrap processor startup module is to further await for the completion signal prior to perform another write into the storage area of another start state of another application processor of the virtual machine.
9. A method for computing, comprising:
writing into a storage area of an apparatus, by a bootstrap processor startup module operated by a first of a plurality of processor cores of the apparatus selected to be a bootstrap processor of a virtual machine, a start state of an application processor of the virtual machine, while the virtual machine is being started up; and
starting, by an application processor startup module to be operated by a second of the plurality of processor cores selected to be the application processor, the application processor at the start state, directly in a protected mode of execution without first going through a real mode of execution.
10. The method of claim 9, further comprising transferring execution control, by the bootstrap processor startup module, to a virtual machine manager of the apparatus, on writing the start state of the application processor into the storage area.
11. The method of claim 10, wherein transferring execution control includes explicitly or implicitly providing the location of the storage area to the virtual machine manager.
12. The method of claim 10, wherein the storage area is a control register of the bootstrap processor, and transferring of the execution control comprises trapping to the virtual machine manager from the control register.
13. The method of claim 10, further comprising retrieving, by the virtual machine manager, the start state of the application from the storage area, programming the start state of the application processor into a control structure of the virtual machine accessible to the application processor, and setting the application processor to start execution at the start state programmed in the control structure, on receipt of the execution control.
14. The method of claim 13, further comprising starting, by the application processor startup module, the application processor directly in the protected mode of execution with memory paging.
15. The method of claim 13, further comprising initializing, by the application processor startup module, the application processor, and signaling the boostrap processor startup module on completion of the initialization.
16. The method of claim 15, further comprising awaiting, by the bootstrap processor startup module, the completion signal prior to perform another write into the storage area of another start state of another application processor of the virtual machine.
17. One or more computer-readable media comprising instructions that cause a computing device, in response to execution of the instructions by a plurality of processor cores of the computing device, to practice any one of the methods of claims 9 - 16.
18. An apparatus for computing, comprising:
bootstrap processor means for writing into a storage area of a bootstrap processor of a virtual machine of the apparatus, a start state of an application processor of the virtual machine, while the virtual machine is being started up; and
application processor means for starting the application processor at the start state, directly in a protected mode of execution without first going through a real mode of execution.
19. The apparatus of claim 18, wherein the bootstrap processor means comprises means for transferring execution control to a virtual machine manager of the apparatus, on writing the start state of the application processor into the storage area.
20. The apparatus of claim 19, wherein transferring execution control includes explicitly or implicitly providing the location of the storage area to the virtual machine manager.
21. The apparatus of claim 19, wherein the storage area is a control register of the bootstrap processor, and transferring of the execution control comprises trapping to the virtual machine manager from the control register.
22. The apparatus of any one of claims 19-21, wherein the virtual machine manager comprises means for retrieving the start state of the application from the storage area, means for programming the start state of the application processor into a control structure of the virtual machine accessible to the application processor, and means for setting the application processor to start execution at the start state programmed in the control structure, on receipt of the execution control.
23. The apparatus of claim 22, wherein the application processor means comprises means for starting the application processor directly in the protected mode of execution with memory paging.
24. The apparatus of claim 22, the application processor means comprises means for initializing the application processor, and means for signaling the boostrap processor startup module on completion of the initialization.
25. The apparatus of claim 24, wherein the bootstrap processor means comprises means for awaiting the completion signal prior to perform another write into the storage area of another start state of another application processor of the virtual machine.
PCT/US2016/061846 2015-12-21 2016-11-14 Starting application processors of a virtual machine WO2017112126A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
DE112016005868.3T DE112016005868T5 (en) 2015-12-21 2016-11-14 Start application processors of a virtual machine
CN201680067913.2A CN108292233B (en) 2015-12-21 2016-11-14 Application processor for starting virtual machine

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US14/976,990 US9898307B2 (en) 2015-12-21 2015-12-21 Starting application processors of a virtual machine
US14/976,990 2015-12-21

Publications (1)

Publication Number Publication Date
WO2017112126A1 true WO2017112126A1 (en) 2017-06-29

Family

ID=59066291

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2016/061846 WO2017112126A1 (en) 2015-12-21 2016-11-14 Starting application processors of a virtual machine

Country Status (4)

Country Link
US (1) US9898307B2 (en)
CN (1) CN108292233B (en)
DE (1) DE112016005868T5 (en)
WO (1) WO2017112126A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210026950A1 (en) * 2016-03-07 2021-01-28 Crowdstrike, Inc. Hypervisor-based redirection of system calls and interrupt-based task offloading
US11829517B2 (en) * 2018-12-20 2023-11-28 Intel Corporation Method and apparatus for trust domain creation and destruction
US10924429B1 (en) * 2019-11-29 2021-02-16 Amazon Technologies, Inc. Using edge-optimized compute instances to execute user workloads at provider substrate extensions
US11915024B2 (en) 2020-07-16 2024-02-27 International Business Machines Corporation Pool management for in-vehicle device application startup
CN112099914B (en) * 2020-09-03 2023-07-21 海光信息技术股份有限公司 Virtual machine multi-core starting method, virtual machine and processor chip

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5255379A (en) * 1990-12-28 1993-10-19 Sun Microsystems, Inc. Method for automatically transitioning from V86 mode to protected mode in a computer system using an Intel 80386 or 80486 processor
US5694606A (en) * 1992-11-03 1997-12-02 Microsoft Corporation Mechanism for using common code to handle hardware interrupts in multiple processor modes
US20040210764A1 (en) * 2003-04-18 2004-10-21 Advanced Micro Devices, Inc. Initialization of a computer system including a secure execution mode-capable processor
US20060005200A1 (en) * 2004-06-30 2006-01-05 Microsoft Corporation Systems and methods for running a legacy 32-bit x86 virtual machine on a 64-bit x86 processor
US20140149992A1 (en) * 2007-12-31 2014-05-29 Vincet J. Zimmer System and method for supporting metered clients with manycore

Family Cites Families (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4928237A (en) * 1987-03-27 1990-05-22 International Business Machines Corp. Computer system having mode independent addressing
US5764956A (en) * 1994-11-07 1998-06-09 Seiko Epson Conporation Computer peripheral function emulator
JPH08147173A (en) * 1994-11-18 1996-06-07 Seiko Epson Corp Emulator
US5710941A (en) * 1995-02-28 1998-01-20 Microsoft Corporation System for substituting protected mode hard disk driver for real mode driver by trapping test transfers to verify matching geometric translation
US5937185A (en) * 1996-09-11 1999-08-10 Creative Technology, Inc. Method and system for device virtualization based on an interrupt request in a DOS-based environment
US6397242B1 (en) * 1998-05-15 2002-05-28 Vmware, Inc. Virtualization system including a virtual machine monitor for a computer with a segmented architecture
US6842898B1 (en) * 1999-06-10 2005-01-11 International Business Machines Corporation Method and apparatus for monitoring and handling events for a collection of related threads in a data processing system
US7380095B2 (en) * 2004-06-30 2008-05-27 Intel Corporation System and method for simulating real-mode memory access with access to extended memory
US20060070065A1 (en) * 2004-09-29 2006-03-30 Zimmer Vincent J Memory support for heterogeneous virtual machine guests
US8627315B2 (en) * 2004-12-31 2014-01-07 Intel Corporation Apparatus and method for cooperative guest firmware
US7747847B2 (en) * 2005-03-25 2010-06-29 Broadcom Corporation Method and system for iSCSI boot in which an iSCSI client loads boot code from a host bus adapter and/or network interface card
CN100464314C (en) * 2006-03-23 2009-02-25 联想(北京)有限公司 Digital data transparency protected safety read-write system and method
CN100489782C (en) * 2006-06-29 2009-05-20 联想(北京)有限公司 Virtual machine system and accessing control method of hardware equipment
US7441113B2 (en) * 2006-07-10 2008-10-21 Devicevm, Inc. Method and apparatus for virtualization of appliances
US8151277B2 (en) * 2007-05-15 2012-04-03 Dynatrace Software Gmbh Method and system for dynamic remote injection of in-process agents into virtual machine based applications
CN101145684A (en) * 2006-09-15 2008-03-19 乐金电子(天津)电器有限公司 Three-phase compressor phase reversal and loss protection device and method
US7673126B2 (en) * 2006-09-19 2010-03-02 Intel Corporation Methods and apparatus to self-initialize a processor
US8082431B2 (en) * 2006-09-29 2011-12-20 Intel Corporation System and method for increasing platform boot efficiency
US8291410B2 (en) * 2006-12-29 2012-10-16 Intel Corporation Controlling virtual machines based on activity state
CN100568181C (en) * 2007-06-22 2009-12-09 浙江大学 Dummy machine system and its implementation based on virtualizing technique of processor
US8156211B2 (en) * 2008-02-26 2012-04-10 Sap Ag Transitioning from dynamic cluster management to virtualized cluster management
CN101430649B (en) * 2008-11-19 2011-09-14 北京航空航天大学 Virtual computation environmental system based on virtual machine
CN101770396B (en) * 2008-12-29 2012-12-19 鸿富锦精密工业(深圳)有限公司 Method and device for erasing DMI data under Linux system
US8533712B2 (en) * 2010-10-01 2013-09-10 International Business Machines Corporation Virtual machine stage detection
US8677187B2 (en) * 2011-04-01 2014-03-18 Vmware, Inc. Performing network core dump without drivers
US20140059552A1 (en) * 2012-08-24 2014-02-27 International Business Machines Corporation Transparent efficiency for in-memory execution of map reduce job sequences
CN103092710A (en) * 2013-02-06 2013-05-08 浪潮电子信息产业股份有限公司 High available virtual machine running method in cloud computing operating system
CN103729233A (en) * 2013-12-20 2014-04-16 中电长城网际系统应用有限公司 Multiple virtual machines management method and device
CN103744725B (en) * 2013-12-24 2017-01-25 杭州华为数字技术有限公司 Virtual machine management method and device
CN104298472A (en) * 2014-10-12 2015-01-21 张维加 Layered computing virtualization implementing method and device
CN104484231A (en) * 2014-12-31 2015-04-01 武汉邮电科学研究院 Virtual machine switching system and method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5255379A (en) * 1990-12-28 1993-10-19 Sun Microsystems, Inc. Method for automatically transitioning from V86 mode to protected mode in a computer system using an Intel 80386 or 80486 processor
US5694606A (en) * 1992-11-03 1997-12-02 Microsoft Corporation Mechanism for using common code to handle hardware interrupts in multiple processor modes
US20040210764A1 (en) * 2003-04-18 2004-10-21 Advanced Micro Devices, Inc. Initialization of a computer system including a secure execution mode-capable processor
US20060005200A1 (en) * 2004-06-30 2006-01-05 Microsoft Corporation Systems and methods for running a legacy 32-bit x86 virtual machine on a 64-bit x86 processor
US20140149992A1 (en) * 2007-12-31 2014-05-29 Vincet J. Zimmer System and method for supporting metered clients with manycore

Also Published As

Publication number Publication date
CN108292233A (en) 2018-07-17
CN108292233B (en) 2021-11-09
US20170177377A1 (en) 2017-06-22
US9898307B2 (en) 2018-02-20
DE112016005868T5 (en) 2018-10-11

Similar Documents

Publication Publication Date Title
US20230161615A1 (en) Techniques for virtual machine transfer and resource management
US8966477B2 (en) Combined virtual graphics device
CN107015862B (en) Thread and/or virtual machine scheduling for cores with different capabilities
CN108292233B (en) Application processor for starting virtual machine
US9946870B2 (en) Apparatus and method thereof for efficient execution of a guest in a virtualized enviroment
CN107924325B (en) Apparatus and method for multi-level virtualization
Goto Kernel-based virtual machine technology
JP6458959B2 (en) Co-designed dynamic language accelerator for processors
US10416890B2 (en) Application execution enclave memory page cache management method and apparatus
US9740519B2 (en) Cross hypervisor migration of virtual machines with VM functions
US10162657B2 (en) Device and method for address translation setting in nested virtualization environment
WO2011047906A1 (en) Assigning a portion of physical computing resources to a logical partition
US9977690B2 (en) Hypervisor-visible guest thread management
TW201120752A (en) Improving nested virtualization performance in a computer system
JP2023538093A (en) Computer device, exception handling method and interrupt handling method
US9983893B2 (en) Handling memory-mapped input-output (MMIO) based instructions using fast access addresses
US9684529B2 (en) Firmware and metadata migration across hypervisors based on supported capabilities
US11748136B2 (en) Event notification support for nested virtual machines
US10318278B2 (en) Power management data package provision method and apparatus
US10671425B2 (en) Lazy timer programming for virtual machines
US20160246633A1 (en) Read-only vm function chaining for secure hypervisor access
US10241821B2 (en) Interrupt generated random number generator states

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16879621

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 112016005868

Country of ref document: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16879621

Country of ref document: EP

Kind code of ref document: A1