WO2014081698A2 - Delegate authorization in cloud-based storage system - Google Patents

Delegate authorization in cloud-based storage system Download PDF

Info

Publication number
WO2014081698A2
WO2014081698A2 PCT/US2013/070733 US2013070733W WO2014081698A2 WO 2014081698 A2 WO2014081698 A2 WO 2014081698A2 US 2013070733 W US2013070733 W US 2013070733W WO 2014081698 A2 WO2014081698 A2 WO 2014081698A2
Authority
WO
WIPO (PCT)
Prior art keywords
access
resource
service
hosted storage
access control
Prior art date
Application number
PCT/US2013/070733
Other languages
French (fr)
Other versions
WO2014081698A3 (en
Inventor
Erkki Ville Juhani Aikas
David Erb
Original Assignee
Google Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Google Inc. filed Critical Google Inc.
Publication of WO2014081698A2 publication Critical patent/WO2014081698A2/en
Publication of WO2014081698A3 publication Critical patent/WO2014081698A3/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/10Network architectures or network communication protocols for network security for controlling access to devices or network resources
    • H04L63/101Access control lists [ACL]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/252Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/62Protecting access to data via a platform, e.g. using keys or access control rules
    • G06F21/6209Protecting access to data via a platform, e.g. using keys or access control rules to a single file or object, e.g. in a secure envelope, encrypted and accessed using a key, or with access control rules appended to the object itself
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/08Key distribution or management, e.g. generation, sharing or updating, of cryptographic keys or passwords
    • H04L9/0816Key establishment, i.e. cryptographic processes or cryptographic protocols whereby a shared secret becomes available to two or more parties, for subsequent use
    • H04L9/0819Key transport or distribution, i.e. key establishment techniques where one party creates or otherwise obtains a secret value, and securely transfers it to the other(s)
    • H04L9/0822Key transport or distribution, i.e. key establishment techniques where one party creates or otherwise obtains a secret value, and securely transfers it to the other(s) using key encryption key
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/08Key distribution or management, e.g. generation, sharing or updating, of cryptographic keys or passwords
    • H04L9/0894Escrow, recovery or storing of secret information, e.g. secret key escrow or cryptographic key storage
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2221/00Indexing scheme relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F2221/21Indexing scheme relating to G06F21/00 and subgroups addressing additional information or applications relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F2221/2141Access rights, e.g. capability lists, access control lists, access tables, access matrices

Definitions

  • This document relates to hosted storage.
  • Hosted, or cloud-based storage refers to off-site or remote data storage that is typically provided by a third party.
  • the third party may implement the hosted storage in a data center, and provide access to the hosted storage over a network, such as the Internet.
  • a method is performed by one or more processors.
  • the method includes receiving, at a hosted storage service, a resource and a request to store the resource, the request includes a location of an access control service.
  • the access control service is separate from the hosted storage service and controls access permissions for the resource.
  • the method further includes storing, at the hosted storage service, the resource in association with metadata that indicates the location of the access control service.
  • the method further includes receiving, at the hosted storage service and from a client system, a request to access the stored resource.
  • the method further includes accessing, at the hosted storage service, the metadata stored in association with the resource.
  • the method further includes determining, at the hosted storage service and based on the metadata, that access permissions for the resource are controlled by the access control service.
  • the method further includes in response to determining that access permissions for the resource are controlled by the access control service, sending an access request from the hosted storage service to the access control service, the access request identifying the resource and a user of the client system.
  • the method further includes receiving, at the hosted storage service and from the access control service, an access response that indicates the user is permitted to access the resource.
  • the method further includes in response to receiving the access response, sending the resource from the hosted storage service to the client system.
  • Implementations can include any, all, or none of the following features.
  • the access control service can maintain an access control list that defines who is authorized to perform actions on resources, and the nature of the permitted actions.
  • the access control service may be subject to a different administrative control than the hosted storage service.
  • the resource may be encrypted by a content provider with a first key before the resource is received at the hosted storage service.
  • the method may includs receiving, at the hosted storage service, the first key encrypted with a client key; and sending, by the hosted storage service and to the client system, the first key encrypted with the client key for decryption by the client using the client key.
  • the first key encrypted with a client key may be received from an access keystore that is subject to a different administrative control than the hosted storage service and subject to a different administrative control than the access control service.
  • the first key may be provided to the client system from the content provider.
  • the first key may be encrypted with a provider key and wherein the method further includes receiving, at the hosted storage service, the encrypted first key; and storing, at the hosted storage service and in association with the resource, the encrypted first key.
  • the method may include; in response to receiving the access response, sending the encrypted first key from the hosted storage service to the client system.
  • the metadata stored in association with the resource may include an access control list.
  • the access control list may identify a user and access permission for the associated resource for the user.
  • the hosted storage service may store a second resource in association with a second access control list which identifies a second user and a second access permission for the associated second resource for the second user.
  • the method may include receiving, at the hosted storage service, a validation of the access control service indicating that the access control service may be used for authorizing access to the resource.
  • Receiving a request to access the stored resource may include receiving authentication information agreed upon by client system and the access control service; and wherein sending an access request to the access control service may include sending the authentication information.
  • a computer system includes a hosted storage service configured to receive a resource and a request to store the resource, the request includes a location of an access control service.
  • the access control service is separate from the hosted storage service and controls access permissions for the resource.
  • the hosted storage service is further configured to store the resource in association with metadata that indicates the location of the access control service.
  • the hosted storage service is further configured to receive a request to access the stored resource.
  • the hosted storage service is further configured to access the metadata stored in association with the resource.
  • the hosted storage service is further configured to determine, based on the metadata, that access permissions for the resource are controlled by the access control service.
  • the hosted storage service is further configured to, in response to determining that access permissions for the resource are controlled by the access control service, send an access request to the access control service, the access request identifying the resource and a user of the client system.
  • the hosted storage service is further configured to receive, from the access control service, an access response that indicates the user is permitted to access the resource.
  • the system further includes in response to receiving the access response, send the resource from the hosted storage service to the client system.
  • the system further includes a client system configured to send, to the hosted storage service, the request to access the stored resource.
  • the client system is further configured to receive from the hosted storage service, the resource.
  • the system further includes an access control service configured to receive, from the hosted storage service, the access request.
  • the access control service is further configured to send, in response to receiving the access request, the access response.
  • Implementations can include any, all, or none of the following features.
  • the access control service can maintain an access control list that defines who is authorized to perform actions on resources, and the nature of the permitted actions.
  • the access control service may be subject to a different administrative control than the hosted storage service.
  • the system may further include a content provider configured to encrypt the resource with a first key; and send, after encrypting the resource, the resource to the hosted storage service.
  • the system may be configured to encrypt the first key with a client key; and send, to the hosted storage service, the first key encrypted with the client key; the hosted storage service further configured to: receive the first key encrypted with the client key; and send, to the client system, the first key encrypted with the client key; and the client system further configured to receive the first key encrypted with the client key.
  • the system may further include an access keystore that is subject to a different administrative control than the hosted storage service and subject to a different administrative control than the access control service, the access keystore configured to send, to the hosted storage service, the first key encrypted with a client key to the hosted storage system; and the hosted storage service further configured to receive the first key encrypted with a client key.
  • the system may be configured to send, to the client system, the first key; and the client system is further configured to receive the first key.
  • the first key may be encrypted with a provider key and wherein the hosted storage service is further configured to receive the encrypted first key; and store the encrypted first key in association with the resource.
  • the hosted storage service may be further configured to send the encrypted first key to the client system in response to receiving the access response.
  • the metadata may be stored in association with the resource includes an access control list.
  • the access control list may identify a user and access permission for the associated resource for the user.
  • the system may be configured to store a second resource in association with a second access control list which identifies a second user and a second access permission for the associated second resource for the second user.
  • the hosted storage service may be further configured to receive a validation of the access control service indicating that the access control service may be used for authorizing access to the resource.
  • the system may be configured to receive authentication information agreed upon by client system and the access control service; and wherein to send an access request to the access control service, the hosted storage service is configured to send the authentication information.
  • Implementations may include one or more of the following advantages.
  • Delegating authorization to another system can enable a hosted storage system to provide flexible and extensible data service models.
  • the hosted storage system can serve resources to users based on secret or unknown factors. That is, a user's financial information does not need to be provided to the hosted storage system for a resource purchased by the user. Only a message from a resource owner that indicates the user is authorized to receive the resource may be needed.
  • a third party authorization service can be used to ensure trusted data escrow. Encrypted resources and encryption keys can be used to ensure that a content provider and client have access to the resource in plaintext form, but the hosted storage system does not.
  • FIG. 1 is a block diagram showing an example of a system for providing hosted storage, authorizing access, and accessing the hosted storage from a client device.
  • FIG. 2 is a flow chart showing an example of a process for storing data in a hosted storage service.
  • FIG. 3 is a flow chart showing an example of a process for providing data in a hosted storage service.
  • FIG. 4 is a flow chart showing an example lifecycle of an access control list.
  • FIG. 5 is a swim lane diagram showing an example of a process for authorizing access to a resource.
  • FIG. 6 is a block diagram showing an example of hosted storage metadata and access control lists.
  • FIG. 7 shows an example of a computing device and a mobile computing device.
  • a hosted storage system can specify a pre-response callout for authentication and/or authorization of an access request.
  • Metadata associated with a resource can specify an access control service and a collection of parameters to be used to determine whether a user is authorized to access the resource.
  • the access control service is separate from the hosted storage service and may be subject to a different administrative control than the hosted storage service.
  • the access control service may determine authorization based on information or logic that is unavailable to the hosted storage service.
  • FIG. 1 is a block diagram showing an example of a system 100 for providing hosted storage, authorizing access, and accessing the hosted storage from a client device 102.
  • a hosted storage service 120 can provide access to stored data by applications running on computing devices geographically separate from each other, provide offsite data backup and restore functionality, provide data storage to a computing device with limited storage capabilities, and/or provide storage functionality not implemented on a computing device.
  • the hosted storage service 120 can use an access control service 104 to authenticate and/or authorize requests to access resources stored in the hosted storage service 120
  • the system 100 can provide scalable stores for storing data objects.
  • the client device 102 can upload data objects to the hosted storage service 120 and specify access to the uploaded data objects. Access control can include a range of security levels, from keeping data securely confidential to publishing it without restrictions. Data stored in hosted storage service 120 can be secured from unauthorized access.
  • the hosted storage service 120 can use a simple and consistent application programming interface, or API, which can allow arbitrary quantities of structured or unstructured data to be kept private or shared between individuals, organizations, or with the world at large.
  • the client device 102 can store data in the hosted storage service 120 for mutual business reasons (e.g., submission of work product ordered by the owner of the hosted storage service 120), or for use in data processing by other services (e.g., images uploaded are used to automatically and dynamically create a photo gallery web page.)
  • mutual business reasons e.g., submission of work product ordered by the owner of the hosted storage service 120
  • other services e.g., images uploaded are used to automatically and dynamically create a photo gallery web page.
  • the client device 102 can be implemented using a computing device, such as the computing device 700 or the mobile device 750 described with respect to FIG. 7.
  • the client device 102 can communicate with the hosted storage service 120 via a network 104, such as the Internet.
  • the client device 102 can communicate across the network using
  • TCP/IP Transmission Control Protocol/Internet Protocol
  • HTTP Hypertext Transfer Protocol
  • SSH Secure Shell Remote Protocol
  • API Application Program Interfaces
  • the hosted storage service 120 can be implemented such that client applications such as a client application 103 can store, retrieve, or otherwise manipulate data objects in the hosted storage service 120.
  • the hosted storage service 120 can be implemented by one or more server devices, which can be implemented using a computing device, such as the computing device 700 or mobile device 750 described with respect to FIG. 7.
  • the hosted storage service 120 can be implemented by multiple server devices operating in the same, or different, data centers.
  • the hosted storage service 120 generally includes an interface frontend 106, an interface backend 108, a storage backend 110, metadata 1 16 for objects stored in the storage backend 110, and a keystore 109.
  • the interface frontend 106 may receive requests from and send responses to the client device 102.
  • the hosted storage service 120 can be implemented as a Web Service with a corresponding set of Web Service
  • the Web Service APIs may be implemented, for example, as a Representational State Transfer (REST)-based HTTP interface or a Simple Object Access Protocol (SOAP)-based interface.
  • REST Representational State Transfer
  • SOAP Simple Object Access Protocol
  • An interface frontend 106 can receive messages from the client 102 and parse the request into a format usable by the hosted storage service 120, such as a remote procedure call (RPC) to an interface backend 108.
  • the interface frontend 106 writes responses generated by the hosted storage service 120 for transmission to the client 102.
  • multiple interface frontends 106 are implemented, for example to support multiple access protocols.
  • the interface frontend 106 can include a graphical front end, for example to display on a web browser for data access.
  • the interface frontend 106 can include a subsystem to enable managed uploads and downloads of large files (e.g., for functionality such as pause, resume, and recover from time-out).
  • the interface frontend 106 can monitor load information and update logs, for example to track and protect against denial of service (DOS) attacks.
  • DOS denial of service
  • the Web Service API may be a REST-based HTTP interface.
  • a data object is accessed as a resource, uniquely named using a URI, and the client application 103 and service 120 exchange representations of resource state using a defined set of operations.
  • requested actions can be represented as verbs, such as by HTTP GET, PUT, POST, HEAD, and DELETE verbs.
  • the GET verb may be used to retrieve an object
  • the HEAD verb may be used to retrieve information about an object without retrieving the object itself.
  • the DELETE verb may be used to delete an object from the hosted storage service 120.
  • the PUT and POST verbs may be used to upload an object to the service 120.
  • PUT requests can come from the client 102 and contain authentication and authorization credentials and object metadata in a header, such as an HTTP header.
  • POST requests can be received when a client 102 wants to upload from a web browser form.
  • the form POST upload protocol for the hosted storage service 120 can involve multiple required form fields to provide authentication, authorization and object metadata.
  • any of the API requests may include credentials for authentication and authorization, for example, in a header of the request.
  • an authorization header may be included in the REST requests, which includes an access key to identify the entity sending the request.
  • a user can be authenticated based on credentials stored in a browser cookie, which gets appended to the API requests.
  • a redirect to an authentication frontend can be generated, and the authentication frontend can be used to generate the browser cookie.
  • the authentication frontend can be used by systems and services in addition to the hosted storage service 120 (e.g., if the organization operating the hosted storage service 120 also operates other web services such as email service.)
  • a user can also or alternatively be authenticated based on authentication credentials from an external credentialing service or an external service that includes credentialing functionally. User or group identifier information can be calculated from the external service's credential information. Requests sent by the client 102 to the interface frontend 106 can be translated and forwarded to the external service for authentication.
  • objects stored in the hosted storage service 120 can be referenced by object identifiers.
  • the hosted storage service 120 can define namespaces to which a valid object identifier must conform.
  • the namespace may require that object identifiers be a sequence of Unicode characters whose UTF-8 encoding is at most 1024 bytes long.
  • the namespace may require that object identifiers be globally unique identifiers (GUIDs), which may be 128-bit integers.
  • GUIDs globally unique identifiers
  • Objects can be stored in hosted storage service 120 in buckets.
  • each bucket is uniquely named in the hosted storage service 120
  • each object is uniquely named in a bucket
  • every bucket and object combination is unique.
  • Objects may be uniquely identified by a URI that includes the bucket name and the object name, and identifies the hosted storage service 120. For example, an object named "long/song.mp3" in a bucket named "music" could be specified using a URI pattern such as
  • the interface backend 108 can handle or pass request authentication and authorization, can manage data and metadata, and can track activity such as for billing.
  • the interface backend 108 can provide functionality for independent frontend / backend scaling for resource utilization and responsiveness under localized heavy loads. Data management can be encapsulated in the interface backend 108 while communication serving can be encapsulated in the interface frontend 106.
  • the interface backend 108 can isolate security mechanisms from the client- facing interface frontend 106.
  • the interface backend 108 can expose an interface usable by both the interface frontend 106 and other systems.
  • some features of the interface backend 108 are accessible only by an interface frontend (not shown) used by the owners of the hosted storage service 120 (internal users). Such features can include those needed for
  • the interface backend 108 can handle request authentication (e.g., ensuring a user's credentials are valid) and authorization (e.g., verifying that a requested operation is permitted) or can pass authentication and/or authorization to an access control service 124.
  • the interface backend can also provide encryption and decryption services to prevent unauthorized access to data, even by internal users.
  • a keystore 109 can store encryption keys for data objects, where the encryption keys have themselves been encrypted by the interface backend 108.
  • the encrypted keys can carry associated metadata that is cryptographically bound to the key itself, and are referred here to as wrapped keys.
  • the wrapped keys can be opaque objects.
  • the interface backend 108 can provide the wrapped key and client authentication credentials to the keystore 109.
  • the keystore 109 can verify, based in part on the wrapped key's metadata, that the provided authentication credential is sufficient to authorize release of the key, and if so, can return the unwrapped key to the interface backend 108.
  • the interface backend 108 can use the key to encrypt or decrypt the data object and then can discard the key.
  • the encryption key is a symmetric key that can be used to both encrypt and decrypt an object.
  • a wrapped key can have associated metadata indicating multiple users or groups authorized to access the cleartext key.
  • the keystore 109 can copy a wrapped key and rewrap the key for a different principle (e.g., containing different metadata).
  • the interface backend 108 can manage metadata 1 16 associated with data objects, for example in a structured data format such as a database (e.g., MySQL). User-specified names labeling the buckets can be completely defined within the metadata 1 16, and object metadata 1 16 can map a resource name to one or more data shares 1 12 storing the resource.
  • the metadata 116 can also contain bucket and object creation times, object sizes, hashes, and access control lists 1 18 (ACL 118) for both buckets and objects.
  • the interface backend 108 can log activity and track storage consumption to support accounting for billing and chargebacks. In some examples, this includes quota monitoring in each dimension in which customers are charged (e.g., reads, writes, network transfers, total storage in use.)
  • the ACLs 1 18 define who is authorized to perform actions on corresponding buckets or objects, and the nature of the permitted actions.
  • the ACLs 1 18 can be an unordered list of ⁇ scope, role ⁇ pairs, plus Boolean flags.
  • the scope may define a user or group of users, and the role may define the access permissions for the user or group.
  • the union of all ⁇ scope, role ⁇ pairs can define access rights.
  • more specific ⁇ scope, role ⁇ pairs override more general ones.
  • Bucket Roles below shows a list of example roles that can be included in ACLs 1 18 for buckets.
  • Table 2 Object Roles below shows a list of example roles that can be included in ACLs 118 for data objects.
  • Scopes can be defined to a single user or a group of users.
  • those users with a FULL_CONTROL role may define a group of users, and then provide a role for the group.
  • a group of users may be managed by the hosted storage service 120 (or, more generally, by the service provider that provides the hosted storage service 120) for reasons other than storage permissions (for example, for a message board or other service that employs groups) and those groups may be identified by a single username or other identifier associated with the group of users, an e-mail address associated with the group of users (which may or may not also correspond to an identifier of the group), or a domain name associated with a group. This may allow a user to specify a preexisting group managed by the service provider that is already defined by the identifier, e-mail address, or domain name.
  • users may be able to specify a group of users (for example, by user id or e-mail address) and associate an access key with the group. This may allow for the formation of ad- hoc groups for the management of storage permissions, rather than groups already managed by the service provider.
  • Table 3 Scopes below shows a list of example scopes that can be included in ACLs 118 for buckets and/or data objects.
  • the FULL CONTROL role can represent all possible capabilities, such as those assigned to an object or bucket owner connected to a financially responsible party.
  • the bucket owner can be configured to always have FULL CONTROL for the bucket.
  • the bucket and/or object owner can create or modify scopes and roles in the corresponding ACLs, but in some implementations the pair ⁇ bucket owner,
  • FULL_CONTROL ⁇ may be prevented from being removed from the bucket ACL 1 18 (or the object ACL).
  • a user can have write permission on the bucket, which can be granted by WRITE and FULL CONTROL.
  • WRITE permission on the bucket can imply permission to delete or overwrite an object in the bucket. Additional constraints can disallow certain modifications to ACLs 1 18. In some examples, it is possible to create an object that the bucket owner cannot read.
  • role ⁇ format ACLs 1 18, some ACLs 118 can reference one or more access control services 124 that can determine a user's authorization to perform actions on corresponding buckets or objects.
  • These remote- authorization ACLs 1 18 can contain a reference, such as a URI, to an access control service 124.
  • the interface backend 108 encounters a remote-authorization ACL 118 while attempting to authorize an access to a data object, the interface backend 108 can pass an authorization request to the access control service 124 referenced in the remote-authorization ACL 1 18.
  • Parameters that need to be sent to the access control service 124 for the service 124 to perform authorization, as well as the possible parameters that may be received in response, can be specified in metadata 1 16 associated with the requested object. In some cases, these parameters may be included in the remote-authorization ACLs 118. Listed below is one example set of parameters that can be stored in the metadata 116 and/or remote- authorization ACLs 118.
  • bucket "mybucket”
  • the access control service 124 can receive and examine the authorization request, and return a message to the interface backend 108 indicating permission or denial of the access attempt. Some access control services 124 can maintain an ACL list that is formatted similar to the ⁇ scope, role ⁇ ACLs 1 18.
  • the access control service 124 can be implemented using a computing device, such as the computing device 700 or the mobile device 750 described with respect to FIG. 7.
  • the access control service 124 can communicate with the hosted storage service 120 via a network 104, such as the Internet.
  • the access control service 124 can communicate across the network using communication protocols such as, for example, one or more of
  • TCP/IP Transmission Control Protocol/Internet Protocol
  • HTTP Hypertext Transfer Protocol
  • SSH Secure Shell Remote Protocol
  • API Application Program Interfaces
  • the access control service 124 is separate from the hosted storage service 120 and may be subject to a different administrative control than the hosted storage service 120.
  • the access control service 124 may be owned and operated from an entity (such as a company) that is different than the one that owns and operates the hosted storage system 120.
  • the hosted storage system 120 and access control service 124 may be owned by the same entity, but be controlled by two separate parts of the entity (such as different business units) such that the hosted storage system 120 and access control service are under different administrative controls.
  • the access control service 124 may be associated with a content provider 122 that generates data objects and uploads them to the hosted storage service 120.
  • One example content provider 122 is a musician or record label using an access control service 124 to process sales and authorization of access to music files stored in the hosted storage service 120.
  • the access control service 124 is shown here as a component of a content provider 122, the access control service 122, and the hosted storage service 120 may be separate logically, communicably, and/or administratively.
  • An access keystore 126 can store encryption keys to be used in conjunction with the access authorization provided by the access control service 124.
  • the access control keystore 126 may store one or more data object encryption keys for use in decrypting data objects whose authorization has been granted by the access control service 124.
  • the access keystore does not store any data object encryption keys, but instead unwrapped data object encryption keys.
  • the access keystore 126 can be implemented using a computing device, such as the computing device 700 or the mobile device 750 described with respect to FIG. 7.
  • the access keystore 126 can communicate with the hosted storage service 120 and/or the access control service 124 via a network 104, such as the Internet.
  • the access keystore 126 can communicate across the network using communication protocols such as, for example, one or more of Transmission Control Protocol/Internet Protocol (TCP/IP), Hypertext Transfer Protocol (HTTP), Secure Shell Remote Protocol (SSH), or Application Program Interfaces (API). While only a single access keystore 126 is shown, there can be multiple access keystores 126 communicating across the network 104 with the hosted storage service 120 and/or other services and devices.
  • TCP/IP Transmission Control Protocol/Internet Protocol
  • HTTP Hypertext Transfer Protocol
  • SSH Secure Shell Remote Protocol
  • API Application Program Interfaces
  • access keystore 126 may be a component of the access control service 124.
  • the access control service 124 may be separate from the access keystore 126 and may be subject to a different administrative control than the access keystore 126. This may be desirable, for example, to prevent access to the data objects in the event that one of the access control service 124 or the access keystore 126 is compromised.
  • the storage backend 110 can contain multiple datastores 1 12a-l 12c. Although three datastores 1 12 are shown, more or fewer are possible. Each of the datastores 1 12a-l 12c can store data objects 114a-l 14c in a particular format.
  • data store 112a can store a data object 1 14a as a Binary Large Object (BLOB)
  • data store 112b can store a data object 1 14b in a distributed file system (e.g., Network File System)
  • data store 112c can store a data object 1 14c in a structured data format such as a database (e.g., MySQL.)
  • FIG. 2 is a flow chart showing an example of a process 200 for storing data in a hosted storage service.
  • the process 200 can be performed by, for example, the interface frontend 106 and the interface backend 1 10, and for clarity of presentation, the description that follows uses the system 100 as the basis for describing the process. However, another system, or combination of systems, may be used to perform the process 200.
  • a request is received by the interface frontend 106 from the client application 103 to store an object (202).
  • the request can include a HTTP PUT or POST request, an authentication credential that authenticates the principal (entity) making the request, a data object, and a target for the object consisting of a bucket and data object name.
  • the authentication credentials can include an interoperable authentication header, token, or cookie.
  • the interface frontend can make a RPC to the backend 108 including the request headers.
  • the interface backend 108 can examine and validate the authentication credentials (204). For example, native credentials (e.g., user ID, token) can be validated using internal validation features of the hosted storage service 120. External credentials (e.g., user names and passwords for another system) can be sent to the associated external system for validation.
  • native credentials e.g., user ID, token
  • External credentials e.g., user names and passwords for another system
  • the interface backend 108 can query the request's target bucket's ACL 1 18 to determine if the authenticated principal is permitted to create an object in the bucket (206). For example, the principal or a group the principal is a member of can have the WRITE or FULL CONTROL role assigned in the bucket's ACL 1 18, which would allow the principal to create an object in the bucket. If the principal is not authorized to create an object, the request is denied.
  • the interface backend 108 uploads the object to the target bucket with the target data object name to a datastore 112 (208).
  • each bucket is associated with only a single datastore 1 12, and specifying a target bucket specifies a datastore 1 12.
  • the interface backend 108 can examine the data object or use a parameter in the RPC from the interface frontend 106 to determine which datastore 1 12 to store the object in, with associated metadata 116 indicating the location of the object (that is, the particular datastore the object is stored in and the object's location in that datastore).
  • the interface backend 108 re-validates the principal's authentication and authorization (210). To support long-running uploads, expiry times of authentication credentials can be temporarily ignored.
  • the interface backend 108 generates a new document key request to the keystore 109 for a wrapped key for the newly-uploaded object (212).
  • the new wrapped key is tied to the authentication credentials of the principal of the request.
  • the keystore 109 can also supply an encryption key to encrypt the wrapped key.
  • the interface backend 108 encrypts the wrapped key (214).
  • the interface backend 108 creates an ACL 118 representing the access control list for the newly created object (216).
  • ACL 118 representing the access control list for the newly created object (216).
  • a default ACL 1 18 is used or an ACL 118 can be specified by the request from the client 102.
  • the interface backend 108 generates a new document key request to the keystore 109 for a wrapped key for every principal (user or group) in the ACL 118 with permissions to read the object or modify the object's ACL 1 18. Each new wrapped key is tied to a single principal.
  • the keystore 109 can also supply an encryption key to encrypt the wrapped keys, or the interface backend 108 can reuse the encryption key from the step 108.
  • the interface backend 108 stores the object's ACL 1 18 and wrapped keys in the object's metadata 1 16.
  • the encryption key or keys can be discarded by the interface backend 108.
  • FIG. 3 is a flow chart showing an example of a process for providing data in a hosted storage service.
  • the process 300 can be performed by, for example, the interface frontend 106 and the interface backend 1 10, and for clarity of presentation, the description that follows uses the system 100 as the basis for describing the process. However, another system, or combination of systems, may be used to perform the process 300.
  • a request is received by the interface frontend 106 from the client application 103 to download an object (302).
  • the request can include a HTTP GET request, an
  • the authentication credential that authenticates the principal (entity) making the request, and a target consisting of a bucket (and optionally data object) name.
  • the authentication credentials can include an interoperable authentication header, token, or cookie.
  • the interface frontend can make a RPC to the backend 108 including the request headers.
  • the interface backend 108 examines and validates the authentication credentials included in the request (304). For example, native credentials (e.g., user ID, token) can be validated using internal validation features of the hosted storage service 120. External credentials (e.g., user names and passwords for another system) can be sent to the associated external system for validation.
  • the interface backend 108 queries the request's bucket or object ACL 1 18 to determine if the authenticated principal is permitted to read the target (306). For example, the principal or a group the principal is a member of can have the READ, WRITE or FULL_CONTROL role assigned, which would allow the principal to read or otherwise access the target. If the principal is not authorized to read or access the object, the request is denied.
  • the interface backend 108 determines if the request is for a bucket or for an object (308). If the request is for a bucket, the interface backend 108 queries for a list of the bucket's contents (310) and the listing is returned to the client application 103 (312).
  • the interface backend 108 looks up the appropriate wrapped key for the given authenticated requestor from the object's metadata 116 (314). The interface backend 108 sends the wrapped key and the authentication credentials to the keystore 109, which can return the decrypted object encryption key to the interface backend 108 (316). The interface backend 108 can fetch and decrypt the target object (318) to be returned to the client application 103 (320).
  • FIG. 4 is a flow chart showing an example lifecycle 400 of an ACL 118.
  • steps of the lifecycle 400 show an order of steps, it is not implied that each step leads directly to another.
  • the steps shown are a listing of possible steps that may be performed on an ACL 1 18 in roughly chronological order. The actual order, number, and kind of steps will be dependent on implementation details and usage of the hosted storage system 120.
  • a bucket or object is created by the backend interface 108 based on requests from the client application 103 (402).
  • the client request can include a bucket name, an object name, and/or an ACL 118.
  • the principal requesting the new bucket or object is authenticated and made the owner of the bucket or object.
  • a local ACL 118 is specified in the request (404), the specified local ACL 1 18 is associated with the bucket or object (406). If the specified ACL 1 18 does not include a ⁇ scope, role ⁇ pair specifying the principal having FULL_CONTROL, one such ⁇ scope, role ⁇ pair can be added to the ACL 118.
  • an ACL may be specified in a request by enumerating each scope and role pair to be included in the ACL, or may be specified by reference to the name of a pre-specified or "canned" local ACL.
  • a list of pre- specified or 'canned' local ACLs 118 is shown in Table 4 Canned ACLs below.
  • the canned local ACLs 118 can be cataloged by the hosted storage system 120 and referenced by the client application 103 by name, rather than requiring the request enumerate each scope and role pair.
  • a remote ACL 118 is specified in the request (404), the specified remote ACL 118 is associated with the bucket or object (407).
  • an ACL may be specified in a request by listing the network location of the access control service 124, or may be specified by reference to the name of a pre-specified or "canned" remote ACL.
  • the canned remote ACLs may each contain the network location of access control services 124 that are trusted, canonical, or otherwise known to many potential resource uploaders.
  • a default local ACL 118 can be used (408).
  • bucket and object creation can default to the "private" local canned ACL 118 for authenticated users.
  • object creation by unauthenticated users such as for new objects created in a "public-read-write” bucket, a default of "bucket-owner- full- control" can be used.
  • An ACL 1 18 can be served, for example, to a principal with READ, WRITE, or FULL CONTROL of the associated bucket or object, or to a principal that has been authorized by the access control service 124 (410).
  • a client application 103 can perform a HTTP GET to a target's URI with the query string ?acl to retrieve the ACL associated with the target.
  • the ACL 118 can be serialized and returned to the client application 103.
  • the serialization of a local ACL may be defined, for example, by the following extended Backus-Naur form. Nonterminals appear in sans serif italics, terminals appear in Courier Bold, ⁇ ⁇ denote zero or more repetitions, [ ] enclose optional entities,
  • the terminal symbols canonical-id, email-address, and domain are defined in English below: access-control-list: ⁇ AccessControlList> owner entries ⁇ /AccessControlList>
  • canonical-id 64 hex digits
  • a canonical-id or an email-address can identify a user or a group.
  • a canonical-id is the encrypted service id for the user or group.
  • Email addresses are a convenience for specifying canonical ids.
  • the ACLs returned from the system always contain canonical ids.
  • the ⁇ Name> iexi ⁇ /Name> element may be used for information purposes only such that it is otherwise ignored by the system, and the system does not return it if there is no public name associated with the user or group.
  • An ACL 1 18 can be updated, for example by a principal with FULL CONTROL of the associated bucket or object (412).
  • a client must read, modify, and write an ACL 1 18 in order to update an ACL 1 18.
  • the ACL 1 18 is served (410) as part of modification (412).
  • a client application 103 can send ACL update requests to the hosted storage system 120.
  • FIG. 5 is a swim lane diagram showing an example of a process 500 for authorizing access to a data object.
  • the process 500 can be performed by, for example, the system 100, and for clarity of presentation, the description that follows uses the system 100 as the basis for describing the process. However, another system, or combination of systems, may be used to perform the process 500.
  • Message passing between networked computers, as described here and elsewhere, may be over a secure socket layer (SSL) channel or another format that can protect the messages from tampering and inspection by third parties.
  • SSL secure socket layer
  • the content provider 122 can encrypt a data object with an encryption key (502).
  • the content provider 122 may generate, purchase, or otherwise acquire a data object that is to be shared, rented, or sold to users or customers.
  • Data objects of this type can include, but are not limited to, media files, scientific data-sets, personal communications, medical records, and business records.
  • this encryption key will be referred to as the data object encryption key.
  • the data object encryption key described here is a symmetric encryption key. That is, a data object encrypted with the data object encryption key may be decrypted by anyone that knows the data object encryption key.
  • other encryption schemes are possible, such as a public/private key system where a public key is used to encrypt a data object, but only a private can decrypt the data object.
  • the hosted storage system 120 can receive, from the content provider 122, a request to store the data object (504).
  • the request includes a location of an access control service that is separate from the hosted storage service and that controls access permissions for the data object.
  • the location can specify, for example, a URI for the access control service 124, a protocol to use when communicating with the control service 124, and parameters to send to the access control service 124.
  • These parameters can include information such as information about a user requesting access authorization (e.g. user ID), the state of the hosted storage service 120 (e.g. timestamp of last request), and/or other information that may be used to determine authorization.
  • the access keystore 126 is either not used, or is a component of the access control service 124. For clarity, communications between the access control service 124 and a keystore 126 are not shown. Other examples in which the access control service 124 and the access keystore 126 are separate entities are discussed below.
  • the hosted storage service 120 can store the data object in association with metadata that indicates the location of the access control service (506).
  • the hosted storage service 120 can store this data in metadata 1 16.
  • An example scheme for this storage is discussed with respect to Fig 6, below.
  • the client 102 can identify a data object in the hosted storage system 120 to access (508). For example, the client 102 can receive information about the data object from the content provider 122. A web browser on the client 102 may be browsing the content provider's 122 website and select a link that has an embedded reference to the hosted data object. As a result, the client 102 can send a request to the hosted storage service 120 to access the object.
  • the hosted storage service 120 can receive, from the client 102, the request to access the stored data object (510). For example, the client 102 can send a HTTP GET or HEAD message referencing the data object to the hosted storage service 120, as previously described. The hosted storage service 120 can parse the request and identify the referenced data object.
  • the hosted storage service 120 can access the metadata stored in association with the data object (512).
  • the metadata can store, among other information, information about the authentication and/or authorization scheme used for the associated data object.
  • the hosted storage service 120 can determine, from the metadata, that a remote access control service determines access authorization for the data object (514).
  • the hosted storage service 120 can also identify information in the metadata about the authorization request to send to the access control service 124, including but not limited to, the location of the access control service 124.
  • the hosted storage service 120 can receive a validation of the access control service 124 that indicates that the access control service may be used for authorizing access to the data object. This validation may be received as part of determining the access control service 514, or at some previous point. Some schemes for validation of the access control service 124 are described later in this document.
  • the hosted storage service 120 can send an access request to the access control service 124.
  • the access request can include identifying information about the data object requested, and about the user of the client 102 that requested access. Some or all of this information may be specified by the parameters listed in the location information, and/or some or all of this information may be provided in all access requests generated by the hosted storage service 120.
  • the information that identifies the user of the client 102 may be an authentication token created by the hosted storage service 120, or by a system used by the hosted storage service 120 for user authentication.
  • the user would have been authenticated and known by the hosted storage service 120 prior to, or as part of, the request to access the data object.
  • the authentication token, or other data if a different authentication scheme is used, is provided by the hosted storage service 120 to the access control service 124 as an indication that the request is originating a user that has been authenticated by the hosted storage service 120.
  • the information that identifies the user of the client 102 may be copied from the request to access the stored resource.
  • the request to access the stored resource may include a header with authentication information (e.g. user name and password) used by the access control service 124.
  • This authentication information may be hashed, encrypted, or otherwise obfuscated to be hidden from the hosted storage service 120.
  • the access control service 124 can receive the access request from the hosted storage service 120 and can authorize the access (518).
  • the authorization process used by the access control service 124 may be unknown by the hosted storage service 120. That is, the access control service 124 need not report or register the logic or process used to determine authorization. This can permit, for example, the access control service to change, extend, add, and/or terminate authentication processes without reporting to the hosted storage service 120.
  • the access control service 124 may also use information for authorization that is not available to the hosted storage service 120. For example, the access control service 124 may process billing of the user for authorization without passing any user financial information through the hosted storage service 120.
  • the access control service 124 can receive a validation of the hosted storage service 120 that indicates that the hosted storage service 120 may be used for serving the data object to the client 102. This validation may be received as part of authorizing the access to the data object 518, or at some previous point. Some schemes for validation of the hosted storage service 120 are described later in this document.
  • the hosted storage service 120 can receive, from the access control service 124, an access response that indicates that the user is permitted to access the resource (520).
  • the access response can include a bucket or object role, as previously described with regards to ACL 118 ⁇ scope, role ⁇ pairs.
  • the access response can include a duration and/or access count that indicates that the user is authorized for a particular period of time and/or number of access.
  • An access response may authorize a user for one logical operation, as determined by the access control service. For example, an access response may authorize a user for one GET and one PUT message, permitting one logical edit to the data object. In some implementations, this duration or count may reduce the number of access request sent from the hosted storage service 120 to the access control service 124.
  • the hosted storage service 120 can send the data object to the client 102 (522).
  • the hosted storage service 120 may transmit the data object to the client 102, as previously described.
  • the client 102 can receive the data object from the hosted storage service 120 (524).
  • the client 102 can decrypt the data object to access the data object's plaintext.
  • the hosted storage service 120 can receive, from the access control service 124, an access response that indicates that the user is not permitted to access the resource.
  • this type of access response may include a text string or denial code indicating the reason that the access control service 124 denied access (e.g. unrecognized user, failed billing attempt).
  • the hosted storage service 120 may use this information in future processes, and/or may pass this information back to the client 102.
  • the access response may not contain this type of information.
  • the access control service 124 may communicate a reason for denial directly to the client 102.
  • the content provider 122 and the client 102 may both have copies of the data object encryption key used to encrypt and decrypt the data object.
  • a number of schemes for key management are possible that ensure that both the client 102 and the content provider 122 have access to the data object encryption key while the hosted storage service 120 does not.
  • a feature of such key management schemes is that the content provider and the client 102 can use the hosted storage service 120 for hosted storage without exposing the plain text of the data object to the hosted storage service 120.
  • the encryption and key management need not be used. Described here are two key management schemes, but others are possible.
  • the content provider 122 can send the data object encryption key to the client 102 through a side channel, that is, through a communication channel that does not include the hosted storage service.
  • the content provider 122 may transmit the data object encryption key directly through the network 104, through email, parcel mail, verbally in person or telephonically.
  • This scheme may be useful for situations in which the content provider 122 wishes to make all of its content, or all content within a particular category, available to the user of the client 102.
  • One such example includes a personal accountant preparing reports and statements for a customer. The accountant is unlikely to charge per report, instead wishing the customer to be able to access any of the customer's documents if the customer has paid for the accountant's services.
  • the content provider 122 can provide to the user of the client 102, through a side channel, a client encryption key. This key is a symmetric encryption key unique to the user. Later, when the content provider 122 receives the access request identifying the user, the content provider 122 can encrypt the data object encryption key with the client encryption key. In this encrypted state, the data object encryption key cannot be used to decrypt the data object. In the access response from the access control service 124, the access control service 124 can include the encrypted data object encryption key. The hosted storage service 120 can pass this encrypted data object encryption key to the client 102, which can decrypt the encrypted data object encryption key with the client encryption key.
  • This scheme may be useful for situation in which the content provider 122 wishes to encrypt each data object with a different data object encryption key. That is, the content provider 122 does not wish to make all data objects available to the client 102.
  • One such example includes a movie distributor selling access to movies to customers. A customer that purchases access to one movie in this scheme would not have access to the data object encryption keys for movies they did not purchase.
  • the access keystore 126 is either not used, or is a component of the access control service 124. In other example processes, the access keystore 126 may be used and may be a separate entity from the access control service 124.
  • the client 102 may request the data object encryption key from the access keystore 126 after receiving the encrypted data object from the hosted storage service 120.
  • the user may be authenticated by the access keystore 126, or a user's request may include information proving that the user was granted authorization to access the data object. This information may include, for example, a token provided to the client 102 by the access control service 124 or the hosted storage service 120, a cryptographic hash of the encrypted data object, and/or any other sort of appropriate information.
  • the hosted storage system 120 may request the data object encryption key from the access keystore 126.
  • the hosted storage service can request the data object encryption key from the access keystore 126.
  • the keystore 126 may return the data object encryption key in encrypted form, for example encrypted with the client key, to the hosted storage service 120.
  • the hosted storage service serves 120 the data object to the client, the hosted storage service can also provide the encrypted data object encryption key.
  • the content provider 122 can encrypt a data object with a data object encryption key before storing the data objects in the hosted storage service 120.
  • the content provider 122 can encrypt the data object encryption key with a provider key and store the encrypted data object encryption key with the encrypted data object.
  • This provider key may be used by the content provider 122 to encrypt all data object encryption keys, or all data object encryption keys of a particular class (e.g. one key per copyright holder for a movie distributor).
  • the content provider 122 can then provide the content key(s) to the access control service 124 or the access keystore 126 through a side-channel that does not include the client 102 or the hosted storage service 120.
  • the hosted storage service 120 can store the encrypted data object encryption key in association with the data object, for example in the metadata 116.
  • the access control service 124 or the access keystore 126 can be sent the encrypted data object encryption key by the hosted storage service 120, the client 102, or the access control service 124. Additional authorization or authentication information may also be provided to show that the requesting party authorized to access the data object in decrypted form.
  • the access control service 124 or the access keystore 126 can decrypt the data object encryption key and return it to the requestor.
  • the scheme also permits the use of different data object encryption keys for every data object. As such, access one data object of the content provider 122 (e.g. one movie) need not permit or enable access to anther data object of the content provider 122 (e.g. a different movie).
  • Described here are schemes for validation of the hosted storage service 120 and the access control services 124. These schemes may be used to ensure that only hosted storage services 120 and access control services 124 specified by the content provider 122 and/or client 102 are used for storage and access control, respectively. They may prevent, for example, use of a rogue access control service that is configured to grant any authorization request, or denial of service attacks to the access control service 124.
  • the content provider 122 registers the hosted storage service 120 with the access control service 124.
  • This registration may include, for example, a listing or classification of data objects that the content provider 122 will store in the hosted storage service 120. Then, any request to the access control service 124 will be compared with this validation information. If the hosted storage service 120, and any other information, of an access request matches the validation information, the access control service 124 can process the access authorization 518.
  • the content provider 122 can register the access control service 124 with the hosted storage service 120. This registration may include, for example, a listing or classification of data objects that the access control service 124 can authorize access to. If the access control service 124, and any other information, matches the access metadata of a data object being request, the hosted storage service 120 can send the access request 216.
  • the validation process can include certificates that define the valid endpoints.
  • the hosted storage service 120 and/or the access control service 124 may require that communication be over SSL.
  • the registration of the hosted storage service 120 by the client 102 in the access control service 124 may include the creation of a secret. This secret can be used by the client 102 as authentication information when requesting a data object from the hosted storage service 120, and the hosted storage service 120 can pass this secret to the access control service 124 with the authorization request to show that the authorization request is on behalf of the client 102.
  • the client 102 can authenticate itself to the access control service 124 using any appropriate client-server authentication mechanisms (e.g. user name and password, client certificate, one time password, hardware tokens). Once authenticated, the client 102 and the access control service 102 can create and agree on a symmetric encryption key that will be referred to as a session key. The client may then generate a tag, sometimes called a message authentication code or MAC secret, for a request sent to the hosted storage service 120 for a data object that is authorized by the access control service. This tag may be created via a cryptographic hashing function that takes the session key and the message as input and returns the tag as output.
  • the hosted storage service 120 can include the tag in the authorization request to the access control service 124.
  • the access control service which has a copy of the session key, may verify that the request originated with the client 102.
  • the access control service 124 can use the session key, or a key derived from the session key, to encrypt the data object or data object encryption keys before they pass back through the hosted storage system 120 to the client 102.
  • the hosted storage service 120 may be independently authenticated by access control service 124, and/or the access control service 124 may be independently authenticated by the hosted storage service 120. That is, the hosted storage service 120 and the access control service 124 may have an authentication relationship that is independent of the client 102. This may permit, for example, the hosted storage service 120 and the access control service 124 to expose their authorization endpoints to the Internet without accepting traffic from valid hosted storage services and access control services.
  • the process 500 can be used to facilitate a number of uses. Described below are a number of example uses, although others are possible.
  • the process 500 can be used to assure compliance with a regulatory, contractual, or insurance mandate.
  • a business may be required to maintain records for inspection by compliance officers.
  • the business may store the records in the hosted storage service 120 and assign a trusted access control service 124 to permit access by the compliance officer and reject attempts by the business to alter the records.
  • An administrator of the data objects may use the process 500 to facilitate fail-safe auditing of access requests. That is, the administrator may log, in the access control server 124, authorization requests to the data object. Using behavior heuristics, the administrator may determine, before granting access to the data object, that a new access request is malicious or from an untrusted party (e.g. from a computer system with a virus). The administrator may deny access or contact the user that apparently generated the access request, as appropriate.
  • the process 500 may be used when the hosted storage service 120 does not or cannot have access to all information needed to authorize access to a data object.
  • the access control service 124 may be a component of another computer system such as a corporate network. This corporate network may use information to authorize access that is secret or constantly changing. For example, the location of an employee, as determined by key-card swipes, can be used to ensure that an employee is in the corporation's building before authorizing access to sensitive documents.
  • Some authentication processes require interactions between the client 102 and the access control service 124 during authorization.
  • a request to access downloadable content by a video game client may require the user of the video game to process a real or in-game financial transaction or to complete and in-game challenge.
  • Collaborative software development projects can use the process 500 for code management.
  • any user may be permitted to read a data object, as defined by a ⁇ role, scope ⁇ ACL 118 for the project's bucket, but any edits or uploads must be reviewed by a code maintenance team, as defined by a remote authorization ACL 118.
  • FIG. 6 is a block diagram showing an example of hosted storage metadata 116 and access control lists 118.
  • the hosted storage service 120 is storing at least two data objects, data object A and data object B, though more, fewer, and different data objects may be stored in other examples. Different configurations of the hosted storage service 120 may use some, all, or none of the metadata 118 and ACLs 1 16 shown.
  • Data object A is stored, in this example, in association with the ACL 602.
  • the ACL 602 is formatted as a ⁇ scope, role ⁇ tuple that defines the authorization permission available to User 1 for data object A. Although only a single user is shown in ACL 602, other ⁇ scope, role ⁇ ACLs can define permissions for multiple users, user groups, etc.
  • the ACL 602 is used, for example by the interface backend 108, to determine if the access is permitted or not.
  • Data object B is stored, in this example, with some or all of the ACLs 604 and 606 and the metadata 608. Although only a single user is shown in each of the ACLs 604 and 606, other ACLs can define permissions for multiple users, user groups, etc.
  • the ACL 604 is a ⁇ scope, role ⁇ formatted ACL which defines the authorization permission available to User 2.
  • the ACL 606 is a remote access formatted ACL that lists an access control address.
  • the access control address references a remote access control service, such as the remote access control service 124, which determines authorization access of data object B for User 3.
  • the metadata 608 can specify access parameters and the format of those access parameters in access request messages from the hosted storage service 120 to the access control service.
  • a single ACL 1 18 can have entries of both ⁇ scope, role ⁇ format and remote access format. That is, a single ACL 1 18 may contain the ACLs 604 and 606.
  • the interface backend 108 can check for ⁇ scope, role ⁇ formatted ACLs 1 18 first, and fall back on remote access formatted ACLs 1 18.
  • a user entry in the ACL 604 would effectively supersede a user entry in the ACL 606.
  • User 2 ID and User 3 ID as Service Group ID, to which any particular user may or may not be a member. If a user requests access to the data object B and is a member of the User 2 service group, the permission field of the ACL 604 is used to determine access authorization. If the user is not a member of the User 2 service group but is a member of the User 3 service group, the ACL 606 is used to determine access authorization.
  • the interface backend 108 can check for remote access formatted ACLs 1 18 first, and fall back on ⁇ scope, role ⁇ formatted ACLs 118.
  • a user entry in the ACL 606 would effectively supersede a user entry in the ACL 604.
  • the ACL 606 would be used, even if the user is also a member of the User 2 service group.
  • the hosted storage service 120 can be configured to ensure that the owner of a data object, or the owner of the bucket containing the data object, is always given the FULL_CONTROL role. For example, this can ensure that, even if an access control service is misconfigured and erroneously rejecting all access request or is off-line, the owner of the data object is able to access the data object.
  • FIG. 7 shows an example of a computing device 700 and a mobile computing device 750 that can be used to implement the techniques described here.
  • the computing device 700 is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers.
  • the mobile computing device 750 is intended to represent various forms of mobile devices, such as personal digital assistants, cellular telephones, smart-phones, and other similar computing devices.
  • the components shown here, their connections and relationships, and their functions, are meant to be examples only, and are not meant to be limiting.
  • the computing device 700 includes a processor 702, a memory 704, a storage device 706, a high-speed interface 708 connecting to the memory 704 and multiple highspeed expansion ports 710, and a low-speed interface 712 connecting to a low-speed expansion port 714 and the storage device 706.
  • Each of the processor 702, the memory 704, the storage device 706, the high-speed interface 708, the high-speed expansion ports 710, and the low-speed interface 712 are interconnected using various busses, and may be mounted on a common motherboard or in other manners as appropriate.
  • the processor 702 can process instructions for execution within the computing device 700, including instructions stored in the memory 704 or on the storage device 706 to display graphical information for a GUI on an external input/output device, such as a display 716 coupled to the high-speed interface 708.
  • an external input/output device such as a display 716 coupled to the high-speed interface 708.
  • multiple processors and/or multiple buses may be used, as appropriate, along with multiple memories and types of memory.
  • multiple computing devices may be connected, with each device providing portions of the necessary operations (e.g., as a server bank, a group of blade servers, or a multi-processor system).
  • the memory 704 stores information within the computing device 700.
  • the memory 704 is a volatile memory unit or units. In some
  • the memory 704 is a non-volatile memory unit or units.
  • the memory 704 may also be another form of computer-readable medium, such as a magnetic or optical disk.
  • the storage device 706 is capable of providing mass storage for the computing device 700.
  • the storage device 706 may be or contain a computer- readable medium, such as a floppy disk device, a hard disk device, an optical disk device, or a tape device, a flash memory or other similar solid state memory device, or an array of devices, including devices in a storage area network or other configurations.
  • Instructions can be stored in an information carrier.
  • the instructions when executed by one or more processing devices (for example, processor 702), perform one or more methods, such as those described above.
  • the instructions can also be stored by one or more storage devices such as computer- or machine-readable mediums (for example, the memory 704, the storage device 706, or memory on the processor 702).
  • the high-speed interface 708 manages bandwidth-intensive operations for the computing device 700, while the low-speed interface 712 manages lower bandwidth- intensive operations.
  • Such allocation of functions is an example only.
  • the high-speed interface 708 is coupled to the memory 704, the display 716 (e.g., through a graphics processor or accelerator), and to the high-speed expansion ports 710, which may accept various expansion cards (not shown).
  • the low- speed interface 712 is coupled to the storage device 706 and the low-speed expansion port 714.
  • the low-speed expansion port 714 which may include various communication ports (e.g., USB, Bluetooth, Ethernet, wireless Ethernet) may be coupled to one or more input/output devices, such as a keyboard, a pointing device, a scanner, or a networking device such as a switch or router, e.g., through a network adapter.
  • the computing device 700 may be implemented in a number of different forms, as shown in the figure. For example, it may be implemented as a standard server 720, or multiple times in a group of such servers. In addition, it may be implemented in a personal computer such as a laptop computer 722. It may also be implemented as part of a rack server system 724. Alternatively, components from the computing device 700 may be combined with other components in a mobile device (not shown), such as a mobile computing device 750. Each of such devices may contain one or more of the computing device 700 and the mobile computing device 750, and an entire system may be made up of multiple computing devices communicating with each other.
  • the mobile computing device 750 includes a processor 752, a memory 764, an input/output device such as a display 754, a communication interface 766, and a transceiver 768, among other components.
  • the mobile computing device 750 may also be provided with a storage device, such as a micro-drive or other device, to provide additional storage.
  • a storage device such as a micro-drive or other device, to provide additional storage.
  • Each of the processor 752, the memory 764, the display 754, the communication interface 766, and the transceiver 768, are interconnected using various buses, and several of the components may be mounted on a common motherboard or in other manners as appropriate.
  • the processor 752 can execute instructions within the mobile computing device 750, including instructions stored in the memory 764.
  • the processor 752 may be
  • the processor 752 may provide, for example, for coordination of the other components of the mobile computing device 750, such as control of user interfaces, applications run by the mobile computing device 750, and wireless communication by the mobile computing device 750.
  • the processor 752 may communicate with a user through a control interface 758 and a display interface 756 coupled to the display 754.
  • the display 754 may be, for example, a TFT (Thin-Film-Transistor Liquid Crystal Display) display or an OLED (Organic Light Emitting Diode) display, or other appropriate display technology.
  • the display interface 756 may comprise appropriate circuitry for driving the display 754 to present graphical and other information to a user.
  • the control interface 758 may receive commands from a user and convert them for submission to the processor 752.
  • an external interface 762 may provide communication with the processor 752, so as to enable near area communication of the mobile computing device 750 with other devices.
  • the external interface 762 may provide, for example, for wired communication in some implementations, or for wireless communication in other implementations, and multiple interfaces may also be used.
  • the memory 764 stores information within the mobile computing device 750.
  • the memory 764 can be implemented as one or more of a computer-readable medium or media, a volatile memory unit or units, or a non-volatile memory unit or units.
  • An expansion memory 774 may also be provided and connected to the mobile computing device 750 through an expansion interface 772, which may include, for example, a SIMM (Single In Line Memory Module) card interface.
  • SIMM Single In Line Memory Module
  • the expansion memory 774 may provide extra storage space for the mobile computing device 750, or may also store applications or other information for the mobile computing device 750.
  • the expansion memory 774 may include instructions to carry out or supplement the processes described above, and may include secure information also.
  • the expansion memory 774 may be provide as a security module for the mobile computing device 750, and may be programmed with instructions that permit secure use of the mobile computing device 750.
  • secure applications may be provided via the SIMM cards, along with additional information, such as placing identifying information on the SIMM card in a non-hackable manner.
  • the memory may include, for example, flash memory and/or NVRAM memory (non-volatile random access memory), as discussed below.
  • instructions are stored in an information carrier, that the instructions, when executed by one or more processing devices (for example, processor 752), perform one or more methods, such as those described above.
  • the instructions can also be stored by one or more storage devices, such as one or more computer- or machine-readable mediums (for example, the memory 764, the expansion memory 774, or memory on the processor 752).
  • the instructions can be received in a propagated signal, for example, over the transceiver 768 or the external interface 762.
  • the mobile computing device 750 may communicate wirelessly through the communication interface 766, which may include digital signal processing circuitry where necessary.
  • the communication interface 766 may provide for communications under various modes or protocols, such as GSM voice calls (Global System for Mobile communications), SMS (Short Message Service), EMS (Enhanced Messaging Service), or MMS messaging (Multimedia Messaging Service), CDMA (code division multiple access), TDMA (time division multiple access), PDC (Personal Digital Cellular), WCDMA (Wideband Code Division Multiple Access), CDMA2000, or GPRS (General Packet Radio Service), among others.
  • GSM voice calls Global System for Mobile communications
  • SMS Short Message Service
  • EMS Enhanced Messaging Service
  • MMS messaging Multimedia Messaging Service
  • CDMA code division multiple access
  • TDMA time division multiple access
  • PDC Personal Digital Cellular
  • WCDMA Wideband Code Division Multiple Access
  • CDMA2000 Code Division Multiple Access
  • GPRS General Packet Radio Service
  • Such communication may occur, for example, through the transceiver 768
  • Positioning System receiver module 770 may provide additional navigation- and location- related wireless data to the mobile computing device 750, which may be used as appropriate by applications running on the mobile computing device 750.
  • the mobile computing device 750 may also communicate audibly using an audio codec 760, which may receive spoken information from a user and convert it to usable digital information.
  • the audio codec 760 may likewise generate audible sound for a user, such as through a speaker, e.g., in a handset of the mobile computing device 750.
  • Such sound may include sound from voice telephone calls, may include recorded sound (e.g., voice messages, music files, etc.) and may also include sound generated by applications operating on the mobile computing device 750.
  • the mobile computing device 750 may be implemented in a number of different forms, as shown in the figure. For example, it may be implemented as a cellular telephone 780. It may also be implemented as part of a smart-phone 782, personal digital assistant, or other similar mobile device.
  • implementations can include implementation in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.
  • a programmable processor which may be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.
  • machine-readable medium and computer-readable medium refer to any computer program product, apparatus and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine- readable medium that receives machine instructions as a machine-readable signal.
  • machine-readable signal refers to any signal used to provide machine instructions and/or data to a programmable processor.
  • the systems and techniques described here can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the computer.
  • a display device e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor
  • a keyboard and a pointing device e.g., a mouse or a trackball
  • Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.
  • the systems and techniques described here can be implemented in a computing system that includes a back end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front end component (e.g., a client computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back end, middleware, or front end components.
  • the components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.
  • LAN local area network
  • WAN wide area network
  • the Internet the global information network
  • the computing system can include clients and servers.
  • a client and server are generally remote from each other and typically interact through a communication network.
  • the relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.

Abstract

At a hosted storage service, a resource and a request to store the resource are received. The request includes a location of an access control service. The access control service is separate from the hosted storage service and controls access permissions for the resource. A request to access the stored resource is received. The hosted storage service accesses metadata stored in association with the resource and determines that access permissions for the resource are controlled by the access control service. An access request is from the hosted storage service to the access control service, the access request identifying the resource and a user of the client system.

Description

DELEGATE AUTHORIZATION IN CLOUD-BASED STORAGE SYSTEM
CROSS-REFERENCE TO RELATED APPLICATION
[0001] This application claims priority to U.S. Application Serial No. 13/681,516, filed on November 20, 2012, entitled DELEGATE AUTHORIZATION IN CLOUD-BASED
STORAGE SYSTEM, the disclosure of which is incorporated herein by reference.
TECHNICAL FIELD
[0002] This document relates to hosted storage.
BACKGROUND
[0003] Hosted, or cloud-based storage, refers to off-site or remote data storage that is typically provided by a third party. The third party may implement the hosted storage in a data center, and provide access to the hosted storage over a network, such as the Internet.
SUMMARY
[0004] In one aspect, a method is performed by one or more processors. The method includes receiving, at a hosted storage service, a resource and a request to store the resource, the request includes a location of an access control service. The access control service is separate from the hosted storage service and controls access permissions for the resource. The method further includes storing, at the hosted storage service, the resource in association with metadata that indicates the location of the access control service. The method further includes receiving, at the hosted storage service and from a client system, a request to access the stored resource. The method further includes accessing, at the hosted storage service, the metadata stored in association with the resource. The method further includes determining, at the hosted storage service and based on the metadata, that access permissions for the resource are controlled by the access control service. The method further includes in response to determining that access permissions for the resource are controlled by the access control service, sending an access request from the hosted storage service to the access control service, the access request identifying the resource and a user of the client system. The method further includes receiving, at the hosted storage service and from the access control service, an access response that indicates the user is permitted to access the resource. The method further includes in response to receiving the access response, sending the resource from the hosted storage service to the client system.
[0005] Implementations can include any, all, or none of the following features. The access control service can maintain an access control list that defines who is authorized to perform actions on resources, and the nature of the permitted actions. The access control service may be subject to a different administrative control than the hosted storage service. The resource may be encrypted by a content provider with a first key before the resource is received at the hosted storage service. The method may includs receiving, at the hosted storage service, the first key encrypted with a client key; and sending, by the hosted storage service and to the client system, the first key encrypted with the client key for decryption by the client using the client key. The first key encrypted with a client key may be received from an access keystore that is subject to a different administrative control than the hosted storage service and subject to a different administrative control than the access control service. The first key may be provided to the client system from the content provider. The first key may be encrypted with a provider key and wherein the method further includes receiving, at the hosted storage service, the encrypted first key; and storing, at the hosted storage service and in association with the resource, the encrypted first key. The method may include; in response to receiving the access response, sending the encrypted first key from the hosted storage service to the client system. The metadata stored in association with the resource may include an access control list. The access control list may identify a user and access permission for the associated resource for the user. The hosted storage service may store a second resource in association with a second access control list which identifies a second user and a second access permission for the associated second resource for the second user. The method may include receiving, at the hosted storage service, a validation of the access control service indicating that the access control service may be used for authorizing access to the resource. Receiving a request to access the stored resource may include receiving authentication information agreed upon by client system and the access control service; and wherein sending an access request to the access control service may include sending the authentication information.
[0006] In one aspect, a computer system includes a hosted storage service configured to receive a resource and a request to store the resource, the request includes a location of an access control service. The access control service is separate from the hosted storage service and controls access permissions for the resource. The hosted storage service is further configured to store the resource in association with metadata that indicates the location of the access control service. The hosted storage service is further configured to receive a request to access the stored resource. The hosted storage service is further configured to access the metadata stored in association with the resource. The hosted storage service is further configured to determine, based on the metadata, that access permissions for the resource are controlled by the access control service. The hosted storage service is further configured to, in response to determining that access permissions for the resource are controlled by the access control service, send an access request to the access control service, the access request identifying the resource and a user of the client system. The hosted storage service is further configured to receive, from the access control service, an access response that indicates the user is permitted to access the resource. The system further includes in response to receiving the access response, send the resource from the hosted storage service to the client system. The system further includes a client system configured to send, to the hosted storage service, the request to access the stored resource. The client system is further configured to receive from the hosted storage service, the resource. The system further includes an access control service configured to receive, from the hosted storage service, the access request. The access control service is further configured to send, in response to receiving the access request, the access response.
[0007] Implementations can include any, all, or none of the following features. The access control service can maintain an access control list that defines who is authorized to perform actions on resources, and the nature of the permitted actions. The access control service may be subject to a different administrative control than the hosted storage service. The system may further include a content provider configured to encrypt the resource with a first key; and send, after encrypting the resource, the resource to the hosted storage service. The system may be configured to encrypt the first key with a client key; and send, to the hosted storage service, the first key encrypted with the client key; the hosted storage service further configured to: receive the first key encrypted with the client key; and send, to the client system, the first key encrypted with the client key; and the client system further configured to receive the first key encrypted with the client key. The system may further include an access keystore that is subject to a different administrative control than the hosted storage service and subject to a different administrative control than the access control service, the access keystore configured to send, to the hosted storage service, the first key encrypted with a client key to the hosted storage system; and the hosted storage service further configured to receive the first key encrypted with a client key. The system may be configured to send, to the client system, the first key; and the client system is further configured to receive the first key. The first key may be encrypted with a provider key and wherein the hosted storage service is further configured to receive the encrypted first key; and store the encrypted first key in association with the resource. The hosted storage service may be further configured to send the encrypted first key to the client system in response to receiving the access response. The metadata may be stored in association with the resource includes an access control list. The access control list may identify a user and access permission for the associated resource for the user. The system may be configured to store a second resource in association with a second access control list which identifies a second user and a second access permission for the associated second resource for the second user. The hosted storage service may be further configured to receive a validation of the access control service indicating that the access control service may be used for authorizing access to the resource. The system may be configured to receive authentication information agreed upon by client system and the access control service; and wherein to send an access request to the access control service, the hosted storage service is configured to send the authentication information.
[0008] Implementations may include one or more of the following advantages.
Delegating authorization to another system can enable a hosted storage system to provide flexible and extensible data service models. By delegating authorization requests, the hosted storage system can serve resources to users based on secret or unknown factors. That is, a user's financial information does not need to be provided to the hosted storage system for a resource purchased by the user. Only a message from a resource owner that indicates the user is authorized to receive the resource may be needed. A third party authorization service can be used to ensure trusted data escrow. Encrypted resources and encryption keys can be used to ensure that a content provider and client have access to the resource in plaintext form, but the hosted storage system does not.
[0009] The details of one or more implementations are set forth in the accompanying drawings and the description below. Other features and advantages will be apparent from the description and drawings, and from the claims. DESCRIPTION OF DRAWINGS
[0010] FIG. 1 is a block diagram showing an example of a system for providing hosted storage, authorizing access, and accessing the hosted storage from a client device.
[0011] FIG. 2 is a flow chart showing an example of a process for storing data in a hosted storage service.
[0012] FIG. 3 is a flow chart showing an example of a process for providing data in a hosted storage service.
[0013] FIG. 4 is a flow chart showing an example lifecycle of an access control list.
[0014] FIG. 5 is a swim lane diagram showing an example of a process for authorizing access to a resource.
[0015] FIG. 6 is a block diagram showing an example of hosted storage metadata and access control lists.
[0016] FIG. 7 shows an example of a computing device and a mobile computing device.
DETAILED DESCRIPTION
[0017] A hosted storage system can specify a pre-response callout for authentication and/or authorization of an access request. Metadata associated with a resource can specify an access control service and a collection of parameters to be used to determine whether a user is authorized to access the resource. The access control service is separate from the hosted storage service and may be subject to a different administrative control than the hosted storage service. The access control service may determine authorization based on information or logic that is unavailable to the hosted storage service.
[0018] FIG. 1 is a block diagram showing an example of a system 100 for providing hosted storage, authorizing access, and accessing the hosted storage from a client device 102. In some implementations, a hosted storage service 120 can provide access to stored data by applications running on computing devices geographically separate from each other, provide offsite data backup and restore functionality, provide data storage to a computing device with limited storage capabilities, and/or provide storage functionality not implemented on a computing device. In some implementations the hosted storage service 120 can use an access control service 104 to authenticate and/or authorize requests to access resources stored in the hosted storage service 120
[0019] The system 100 can provide scalable stores for storing data objects. The client device 102 can upload data objects to the hosted storage service 120 and specify access to the uploaded data objects. Access control can include a range of security levels, from keeping data securely confidential to publishing it without restrictions. Data stored in hosted storage service 120 can be secured from unauthorized access. The hosted storage service 120 can use a simple and consistent application programming interface, or API, which can allow arbitrary quantities of structured or unstructured data to be kept private or shared between individuals, organizations, or with the world at large. The client device 102 can store data in the hosted storage service 120 for mutual business reasons (e.g., submission of work product ordered by the owner of the hosted storage service 120), or for use in data processing by other services (e.g., images uploaded are used to automatically and dynamically create a photo gallery web page.)
[0020] The client device 102 can be implemented using a computing device, such as the computing device 700 or the mobile device 750 described with respect to FIG. 7. The client device 102 can communicate with the hosted storage service 120 via a network 104, such as the Internet. The client device 102 can communicate across the network using
communication protocols such as, for example, one or more of Transmission Control Protocol/Internet Protocol (TCP/IP), Hypertext Transfer Protocol (HTTP), Secure Shell Remote Protocol (SSH), or Application Program Interfaces (API). While only a single client device 102 is shown, there can be multiple client devices communicating across the network 104 with the hosted storage service 120 and/or other services and devices.
[0021] The hosted storage service 120 can be implemented such that client applications such as a client application 103 can store, retrieve, or otherwise manipulate data objects in the hosted storage service 120. The hosted storage service 120 can be implemented by one or more server devices, which can be implemented using a computing device, such as the computing device 700 or mobile device 750 described with respect to FIG. 7. For example, the hosted storage service 120 can be implemented by multiple server devices operating in the same, or different, data centers.
[0022] The hosted storage service 120 generally includes an interface frontend 106, an interface backend 108, a storage backend 110, metadata 1 16 for objects stored in the storage backend 110, and a keystore 109. In general, the interface frontend 106 may receive requests from and send responses to the client device 102. For instance, the hosted storage service 120 can be implemented as a Web Service with a corresponding set of Web Service
Application Programming Interfaces (APIs). The Web Service APIs may be implemented, for example, as a Representational State Transfer (REST)-based HTTP interface or a Simple Object Access Protocol (SOAP)-based interface.
[0023] An interface frontend 106 can receive messages from the client 102 and parse the request into a format usable by the hosted storage service 120, such as a remote procedure call (RPC) to an interface backend 108. The interface frontend 106 writes responses generated by the hosted storage service 120 for transmission to the client 102. In some implementations, multiple interface frontends 106 are implemented, for example to support multiple access protocols.
[0024] The interface frontend 106 can include a graphical front end, for example to display on a web browser for data access. The interface frontend 106 can include a subsystem to enable managed uploads and downloads of large files (e.g., for functionality such as pause, resume, and recover from time-out). The interface frontend 106 can monitor load information and update logs, for example to track and protect against denial of service (DOS) attacks.
[0025] As described above, the Web Service API may be a REST-based HTTP interface. In a REST-based interface, a data object is accessed as a resource, uniquely named using a URI, and the client application 103 and service 120 exchange representations of resource state using a defined set of operations. For example, requested actions can be represented as verbs, such as by HTTP GET, PUT, POST, HEAD, and DELETE verbs. The GET verb may be used to retrieve an object, while the HEAD verb may be used to retrieve information about an object without retrieving the object itself. The DELETE verb may be used to delete an object from the hosted storage service 120. The PUT and POST verbs may be used to upload an object to the service 120. PUT requests can come from the client 102 and contain authentication and authorization credentials and object metadata in a header, such as an HTTP header. POST requests can be received when a client 102 wants to upload from a web browser form. The form POST upload protocol for the hosted storage service 120 can involve multiple required form fields to provide authentication, authorization and object metadata. More generally, any of the API requests may include credentials for authentication and authorization, for example, in a header of the request. For example, an authorization header may be included in the REST requests, which includes an access key to identify the entity sending the request. [0026] Alternatively, or additionally, a user can be authenticated based on credentials stored in a browser cookie, which gets appended to the API requests. If no valid cookie is present, a redirect to an authentication frontend can be generated, and the authentication frontend can be used to generate the browser cookie. The authentication frontend can be used by systems and services in addition to the hosted storage service 120 (e.g., if the organization operating the hosted storage service 120 also operates other web services such as email service.) A user can also or alternatively be authenticated based on authentication credentials from an external credentialing service or an external service that includes credentialing functionally. User or group identifier information can be calculated from the external service's credential information. Requests sent by the client 102 to the interface frontend 106 can be translated and forwarded to the external service for authentication.
[0027] In general, objects stored in the hosted storage service 120 can be referenced by object identifiers. The hosted storage service 120 can define namespaces to which a valid object identifier must conform. For example, the namespace may require that object identifiers be a sequence of Unicode characters whose UTF-8 encoding is at most 1024 bytes long. As another example, the namespace may require that object identifiers be globally unique identifiers (GUIDs), which may be 128-bit integers.
[0028] Objects can be stored in hosted storage service 120 in buckets. In some examples, each bucket is uniquely named in the hosted storage service 120, each object is uniquely named in a bucket, and every bucket and object combination is unique. Objects may be uniquely identified by a URI that includes the bucket name and the object name, and identifies the hosted storage service 120. For example, an object named "long/song.mp3" in a bucket named "music" could be specified using a URI pattern such as
http ://s . [any exampledomain] .com/ mus ic/long/ s ong. mp3 or
http://musics.fanyexampledomainJ.com/long/song.mp3. Alternatively, the user of the client 102 can create a bucket named www.[secondexampledomain], publish a CNAME alias redirecting that to http://music.s.[anyexampledomain].com, and address the object as http://www.[secondexampledomain]/long/song.mp3. In some examples, buckets do not nest.
[0029] The interface backend 108 can handle or pass request authentication and authorization, can manage data and metadata, and can track activity such as for billing. The interface backend 108 can provide functionality for independent frontend / backend scaling for resource utilization and responsiveness under localized heavy loads. Data management can be encapsulated in the interface backend 108 while communication serving can be encapsulated in the interface frontend 106. The interface backend 108 can isolate security mechanisms from the client- facing interface frontend 106.
[0030] The interface backend 108 can expose an interface usable by both the interface frontend 106 and other systems. In some examples, some features of the interface backend 108 are accessible only by an interface frontend (not shown) used by the owners of the hosted storage service 120 (internal users). Such features can include those needed for
administrative tasks (e.g., resolving an object reference to a low level disk address.) The interface backend 108 can handle request authentication (e.g., ensuring a user's credentials are valid) and authorization (e.g., verifying that a requested operation is permitted) or can pass authentication and/or authorization to an access control service 124. The interface backend can also provide encryption and decryption services to prevent unauthorized access to data, even by internal users.
[0031] A keystore 109 can store encryption keys for data objects, where the encryption keys have themselves been encrypted by the interface backend 108. The encrypted keys can carry associated metadata that is cryptographically bound to the key itself, and are referred here to as wrapped keys. From the point of view of the interface backend 108, the wrapped keys can be opaque objects. To obtain the cleartext key of a wrapped key for use (e.g., to encrypt or decrypt a data object,) the interface backend 108 can provide the wrapped key and client authentication credentials to the keystore 109. The keystore 109 can verify, based in part on the wrapped key's metadata, that the provided authentication credential is sufficient to authorize release of the key, and if so, can return the unwrapped key to the interface backend 108. The interface backend 108 can use the key to encrypt or decrypt the data object and then can discard the key.
[0032] In some examples, the encryption key is a symmetric key that can be used to both encrypt and decrypt an object. In some examples, a wrapped key can have associated metadata indicating multiple users or groups authorized to access the cleartext key. In some examples, the keystore 109 can copy a wrapped key and rewrap the key for a different principle (e.g., containing different metadata).
[0033] The interface backend 108 can manage metadata 1 16 associated with data objects, for example in a structured data format such as a database (e.g., MySQL). User-specified names labeling the buckets can be completely defined within the metadata 1 16, and object metadata 1 16 can map a resource name to one or more data shares 1 12 storing the resource. The metadata 116 can also contain bucket and object creation times, object sizes, hashes, and access control lists 1 18 (ACL 118) for both buckets and objects. The interface backend 108 can log activity and track storage consumption to support accounting for billing and chargebacks. In some examples, this includes quota monitoring in each dimension in which customers are charged (e.g., reads, writes, network transfers, total storage in use.)
[0034] The ACLs 1 18 define who is authorized to perform actions on corresponding buckets or objects, and the nature of the permitted actions. The ACLs 1 18 can be an unordered list of {scope, role} pairs, plus Boolean flags. The scope may define a user or group of users, and the role may define the access permissions for the user or group. In some examples, the union of all {scope, role} pairs can define access rights. In some examples, more specific {scope, role} pairs override more general ones.
Table 1 : Bucket Roles below shows a list of example roles that can be included in ACLs 1 18 for buckets. Table 2: Object Roles below shows a list of example roles that can be included in ACLs 118 for data objects.
Figure imgf000012_0001
[0035] Scopes can be defined to a single user or a group of users. In one implementation, those users with a FULL_CONTROL role (and therefore able to modify the ACL for a given bucket or object) may define a group of users, and then provide a role for the group. For example, a group of users may be managed by the hosted storage service 120 (or, more generally, by the service provider that provides the hosted storage service 120) for reasons other than storage permissions (for example, for a message board or other service that employs groups) and those groups may be identified by a single username or other identifier associated with the group of users, an e-mail address associated with the group of users (which may or may not also correspond to an identifier of the group), or a domain name associated with a group. This may allow a user to specify a preexisting group managed by the service provider that is already defined by the identifier, e-mail address, or domain name. Similarly, users may be able to specify a group of users (for example, by user id or e-mail address) and associate an access key with the group. This may allow for the formation of ad- hoc groups for the management of storage permissions, rather than groups already managed by the service provider.
[0036] In this way, a group of users can be given a particular role simply by managing the role of the group. Similarly, if the ACL is associated with a bucket containing a number of objects, or the ACL is otherwise associated with multiple objects, the role with respect to those objects can be easily changed by simply changing the role of the group.
[0037] Table 3: Scopes below shows a list of example scopes that can be included in ACLs 118 for buckets and/or data objects.
Figure imgf000013_0001
Table 3: Scopes
[0038] The FULL CONTROL role can represent all possible capabilities, such as those assigned to an object or bucket owner connected to a financially responsible party. The bucket owner can be configured to always have FULL CONTROL for the bucket. In general, the bucket and/or object owner can create or modify scopes and roles in the corresponding ACLs, but in some implementations the pair {bucket owner,
FULL_CONTROL} may be prevented from being removed from the bucket ACL 1 18 (or the object ACL). To create an object, a user can have write permission on the bucket, which can be granted by WRITE and FULL CONTROL. WRITE permission on the bucket can imply permission to delete or overwrite an object in the bucket. Additional constraints can disallow certain modifications to ACLs 1 18. In some examples, it is possible to create an object that the bucket owner cannot read.
[0039] Additionally or alternatively to the {scope, role} format ACLs 1 18, some ACLs 118 can reference one or more access control services 124 that can determine a user's authorization to perform actions on corresponding buckets or objects. These remote- authorization ACLs 1 18 can contain a reference, such as a URI, to an access control service 124. When the interface backend 108 encounters a remote-authorization ACL 118 while attempting to authorize an access to a data object, the interface backend 108 can pass an authorization request to the access control service 124 referenced in the remote-authorization ACL 1 18. Parameters that need to be sent to the access control service 124 for the service 124 to perform authorization, as well as the possible parameters that may be received in response, can be specified in metadata 1 16 associated with the requested object. In some cases, these parameters may be included in the remote-authorization ACLs 118. Listed below is one example set of parameters that can be stored in the metadata 116 and/or remote- authorization ACLs 118.
{ "Authent cati onRequest" : {
"ope rati on" : " read" ,
"bucket" : "mybucket" ,
"obj ect" : "myobj ect" ,
"authent cati on " : "authenti cati on token " ,
"ti mestamp" : " 1318620440000" ,
"metadata" : {
"appl i cati on_metadata" : [
{"name" : "use rf i el dl" , "val ue" : "document name"} , {"val ue" : "userfi el d2 " , "val ue" : " somethi ng el se" }
]
}
} } { "Authent cati onResponse" : {
"grant_access " : "fal se" ,
"er ror_detai I s " : " Pe rmi ssi on deni ed"
}
}
[0040] The access control service 124 can receive and examine the authorization request, and return a message to the interface backend 108 indicating permission or denial of the access attempt. Some access control services 124 can maintain an ACL list that is formatted similar to the {scope, role} ACLs 1 18.
[0041] The access control service 124 can be implemented using a computing device, such as the computing device 700 or the mobile device 750 described with respect to FIG. 7. The access control service 124 can communicate with the hosted storage service 120 via a network 104, such as the Internet. The access control service 124 can communicate across the network using communication protocols such as, for example, one or more of
Transmission Control Protocol/Internet Protocol (TCP/IP), Hypertext Transfer Protocol (HTTP), Secure Shell Remote Protocol (SSH), or Application Program Interfaces (API). While only a single access control service 124 is shown, there can be multiple access control service 124s communicating across the network 104 with the hosted storage service 120 and/or other services and devices.
[0042] The access control service 124 is separate from the hosted storage service 120 and may be subject to a different administrative control than the hosted storage service 120. For example, the access control service 124 may be owned and operated from an entity (such as a company) that is different than the one that owns and operates the hosted storage system 120. Alternatively, the hosted storage system 120 and access control service 124 may be owned by the same entity, but be controlled by two separate parts of the entity (such as different business units) such that the hosted storage system 120 and access control service are under different administrative controls.
[0043] As one example, the access control service 124 may be associated with a content provider 122 that generates data objects and uploads them to the hosted storage service 120. One example content provider 122 is a musician or record label using an access control service 124 to process sales and authorization of access to music files stored in the hosted storage service 120. While the access control service 124 is shown here as a component of a content provider 122, the access control service 122, and the hosted storage service 120 may be separate logically, communicably, and/or administratively.
[0044] An access keystore 126 can store encryption keys to be used in conjunction with the access authorization provided by the access control service 124. For example, the access control keystore 126 may store one or more data object encryption keys for use in decrypting data objects whose authorization has been granted by the access control service 124. In some cases, the access keystore does not store any data object encryption keys, but instead unwrapped data object encryption keys.
[0045] The access keystore 126 can be implemented using a computing device, such as the computing device 700 or the mobile device 750 described with respect to FIG. 7. The access keystore 126 can communicate with the hosted storage service 120 and/or the access control service 124 via a network 104, such as the Internet. The access keystore 126 can communicate across the network using communication protocols such as, for example, one or more of Transmission Control Protocol/Internet Protocol (TCP/IP), Hypertext Transfer Protocol (HTTP), Secure Shell Remote Protocol (SSH), or Application Program Interfaces (API). While only a single access keystore 126 is shown, there can be multiple access keystores 126 communicating across the network 104 with the hosted storage service 120 and/or other services and devices.
[0046] Although shown as a component of the content provider 122 along with the access control service 124, the relationship between access keystore 126 and access control service 124 may take other forms. For example, the access keystore 126 may be a component of the access control service 124. In another example, the access control service 124 may be separate from the access keystore 126 and may be subject to a different administrative control than the access keystore 126. This may be desirable, for example, to prevent access to the data objects in the event that one of the access control service 124 or the access keystore 126 is compromised.
[0047] The storage backend 110 can contain multiple datastores 1 12a-l 12c. Although three datastores 1 12 are shown, more or fewer are possible. Each of the datastores 1 12a-l 12c can store data objects 114a-l 14c in a particular format. For example, data store 112a can store a data object 1 14a as a Binary Large Object (BLOB), data store 112b can store a data object 1 14b in a distributed file system (e.g., Network File System), and data store 112c can store a data object 1 14c in a structured data format such as a database (e.g., MySQL.) [0048] FIG. 2 is a flow chart showing an example of a process 200 for storing data in a hosted storage service. The process 200 can be performed by, for example, the interface frontend 106 and the interface backend 1 10, and for clarity of presentation, the description that follows uses the system 100 as the basis for describing the process. However, another system, or combination of systems, may be used to perform the process 200.
[0049] A request is received by the interface frontend 106 from the client application 103 to store an object (202). The request can include a HTTP PUT or POST request, an authentication credential that authenticates the principal (entity) making the request, a data object, and a target for the object consisting of a bucket and data object name. In some examples, the authentication credentials can include an interoperable authentication header, token, or cookie. The interface frontend can make a RPC to the backend 108 including the request headers.
[0050] The interface backend 108 can examine and validate the authentication credentials (204). For example, native credentials (e.g., user ID, token) can be validated using internal validation features of the hosted storage service 120. External credentials (e.g., user names and passwords for another system) can be sent to the associated external system for validation.
[0051] The interface backend 108 can query the request's target bucket's ACL 1 18 to determine if the authenticated principal is permitted to create an object in the bucket (206). For example, the principal or a group the principal is a member of can have the WRITE or FULL CONTROL role assigned in the bucket's ACL 1 18, which would allow the principal to create an object in the bucket. If the principal is not authorized to create an object, the request is denied.
[0052] Otherwise, the interface backend 108 uploads the object to the target bucket with the target data object name to a datastore 112 (208). In some examples, each bucket is associated with only a single datastore 1 12, and specifying a target bucket specifies a datastore 1 12. In some examples, the interface backend 108 can examine the data object or use a parameter in the RPC from the interface frontend 106 to determine which datastore 1 12 to store the object in, with associated metadata 116 indicating the location of the object (that is, the particular datastore the object is stored in and the object's location in that datastore). [0053] The interface backend 108 re-validates the principal's authentication and authorization (210). To support long-running uploads, expiry times of authentication credentials can be temporarily ignored.
[0054] The interface backend 108 generates a new document key request to the keystore 109 for a wrapped key for the newly-uploaded object (212). The new wrapped key is tied to the authentication credentials of the principal of the request. The keystore 109 can also supply an encryption key to encrypt the wrapped key. The interface backend 108 encrypts the wrapped key (214).
[0055] The interface backend 108 creates an ACL 118 representing the access control list for the newly created object (216). In some example, a default ACL 1 18 is used or an ACL 118 can be specified by the request from the client 102.
[0056] The interface backend 108 generates a new document key request to the keystore 109 for a wrapped key for every principal (user or group) in the ACL 118 with permissions to read the object or modify the object's ACL 1 18. Each new wrapped key is tied to a single principal. The keystore 109 can also supply an encryption key to encrypt the wrapped keys, or the interface backend 108 can reuse the encryption key from the step 108.
[0057] The interface backend 108 stores the object's ACL 1 18 and wrapped keys in the object's metadata 1 16. The encryption key or keys can be discarded by the interface backend 108.
[0058] FIG. 3 is a flow chart showing an example of a process for providing data in a hosted storage service. The process 300 can be performed by, for example, the interface frontend 106 and the interface backend 1 10, and for clarity of presentation, the description that follows uses the system 100 as the basis for describing the process. However, another system, or combination of systems, may be used to perform the process 300.
[0059] A request is received by the interface frontend 106 from the client application 103 to download an object (302). The request can include a HTTP GET request, an
authentication credential that authenticates the principal (entity) making the request, and a target consisting of a bucket (and optionally data object) name. In some examples, the authentication credentials can include an interoperable authentication header, token, or cookie. The interface frontend can make a RPC to the backend 108 including the request headers. [0060] The interface backend 108 examines and validates the authentication credentials included in the request (304). For example, native credentials (e.g., user ID, token) can be validated using internal validation features of the hosted storage service 120. External credentials (e.g., user names and passwords for another system) can be sent to the associated external system for validation.
[0061] The interface backend 108 queries the request's bucket or object ACL 1 18 to determine if the authenticated principal is permitted to read the target (306). For example, the principal or a group the principal is a member of can have the READ, WRITE or FULL_CONTROL role assigned, which would allow the principal to read or otherwise access the target. If the principal is not authorized to read or access the object, the request is denied.
[0062] Otherwise, the interface backend 108 determines if the request is for a bucket or for an object (308). If the request is for a bucket, the interface backend 108 queries for a list of the bucket's contents (310) and the listing is returned to the client application 103 (312).
[0063] If the request is for an object, the interface backend 108 looks up the appropriate wrapped key for the given authenticated requestor from the object's metadata 116 (314). The interface backend 108 sends the wrapped key and the authentication credentials to the keystore 109, which can return the decrypted object encryption key to the interface backend 108 (316). The interface backend 108 can fetch and decrypt the target object (318) to be returned to the client application 103 (320).
[0064] FIG. 4 is a flow chart showing an example lifecycle 400 of an ACL 118.
Although the steps of the lifecycle 400 show an order of steps, it is not implied that each step leads directly to another. The steps shown are a listing of possible steps that may be performed on an ACL 1 18 in roughly chronological order. The actual order, number, and kind of steps will be dependent on implementation details and usage of the hosted storage system 120.
[0065] A bucket or object is created by the backend interface 108 based on requests from the client application 103 (402). The client request can include a bucket name, an object name, and/or an ACL 118. The principal requesting the new bucket or object is authenticated and made the owner of the bucket or object.
[0066] If a local ACL 118 is specified in the request (404), the specified local ACL 1 18 is associated with the bucket or object (406). If the specified ACL 1 18 does not include a {scope, role} pair specifying the principal having FULL_CONTROL, one such {scope, role} pair can be added to the ACL 118. In one implementation, an ACL may be specified in a request by enumerating each scope and role pair to be included in the ACL, or may be specified by reference to the name of a pre-specified or "canned" local ACL. A list of pre- specified or 'canned' local ACLs 118 is shown in Table 4 Canned ACLs below. The canned local ACLs 118 can be cataloged by the hosted storage system 120 and referenced by the client application 103 by name, rather than requiring the request enumerate each scope and role pair.
Figure imgf000020_0001
Table 4 Canned ACLs
[0067] If a remote ACL 118 is specified in the request (404), the specified remote ACL 118 is associated with the bucket or object (407). In one implementation, an ACL may be specified in a request by listing the network location of the access control service 124, or may be specified by reference to the name of a pre-specified or "canned" remote ACL. The canned remote ACLs may each contain the network location of access control services 124 that are trusted, canonical, or otherwise known to many potential resource uploaders.
[0068] If an ACL 1 18 is not specified in the request (404), a default local ACL 118 can be used (408). For example, bucket and object creation can default to the "private" local canned ACL 118 for authenticated users. For object creation by unauthenticated users, such as for new objects created in a "public-read-write" bucket, a default of "bucket-owner- full- control" can be used.
[0069] An ACL 1 18 can be served, for example, to a principal with READ, WRITE, or FULL CONTROL of the associated bucket or object, or to a principal that has been authorized by the access control service 124 (410). For example, a client application 103 can perform a HTTP GET to a target's URI with the query string ?acl to retrieve the ACL associated with the target. The ACL 118 can be serialized and returned to the client application 103.
[0070] The serialization of a local ACL may be defined, for example, by the following extended Backus-Naur form. Nonterminals appear in sans serif italics, terminals appear in Courier Bold, { } denote zero or more repetitions, [ ] enclose optional entities, | separates alternatives, and ( ) denote grouping. The terminal symbols canonical-id, email-address, and domain are defined in English below: access-control-list: <AccessControlList> owner entries </AccessControlList>
owner. <Owner> id </Owner>
entries: <Entries> entry { entry } </Entries>
entry: <Entry> ( permission scope \ scope permission ) </Entry>
permission: <Permission> ( READ | WRITE | FULL_CONTROL ) </Permission>
scope: <Scope type=UserById> /'c/</Scope>
I <Scope type=UserByEmail> email </Scope>
I <Scope type=GroupById> id </Scope>
I <Scope type=GroupByEmail> email </Scope>
I <Scope type=GroupByDomain> <Domain> domain </Domain> </Scope>
I <Scope type=AllUsers/>
I <Scope type=AllAuthenticatedUsers/>
id: <ID> canonical-id </lD> [<Name> fexf </Name> ]
|[<Name> fexf </Name> ] <ID> canonical-id </lD>
email: <EmailAddress> email-address </EmailAddress> [<Name> text </ ame>]
|[<Name> text </Name> ] <EmailAddress> canonical-id </EmailAddress>
text: { printable character excluding < and > }
canonical-id: 64 hex digits
email-address: standard RFC 822 email address
domain: standard RFC 822 domain specification A canonical-id or an email-address can identify a user or a group. A canonical-id is the encrypted service id for the user or group. Email addresses are a convenience for specifying canonical ids. In some implementations, the ACLs returned from the system always contain canonical ids. The <Name> iexi</Name> element may be used for information purposes only such that it is otherwise ignored by the system, and the system does not return it if there is no public name associated with the user or group.
[0071] An example serialized local ACL 1 18 is shown below.
<AccessCont rol Li st>
<Owne r>
<ID>a9a7b886d6fd24a52fe8ca5bef65f89a64e0193f23000e241bf9blc61be666e9</ID> <Name>ch ri s custome r </Name>
</Owner>
<Entri es>
<EntryxPe rmi ss on>FULL_CONTROL</Pe rmi ssi on>
<Scope type=Use rById>
<ID>a9a7b886d6fd24a52fe8ca5bef65f89a64e0193f23000e241bf9blc61be666e9</ID>
<Name>ch ri scustome r</Name>
</Scope>
</Ent ry>
<EntryxPe rmi ss on>FULL_CONTROL</Pe rmi ssi on>
<Scope type=Use rById>
<ID>79a59df900b949e55d96ale698fbacedfd6e09d98eacf8f8d5218e7cd47ef2be</ID>
<Name>Frank</Name>
</Scope>
</Ent ry>
<EntryxPe rmi ssi on>FULL_CONTROL</Pe rmi ssi on>
<Scope type=Use rById>
<ID>de019164ebb0724ff67188e243eae9ccbebdde523717cc312255d9a82498e394a</ID>
<Name>3ose</Name>
</Scope>
</Ent ry>
<EntryxPe rmi ssi on>READ</Pe rmi ssi onxScope type=Al 1 Use rsx/Ent ry>
</Ent ri es>
</AccessControl Li st>
[0072] An ACL 1 18 can be updated, for example by a principal with FULL CONTROL of the associated bucket or object (412). In some examples, a client must read, modify, and write an ACL 1 18 in order to update an ACL 1 18. In this example, the ACL 1 18 is served (410) as part of modification (412). In some implementations, a client application 103 can send ACL update requests to the hosted storage system 120.
[0073] FIG. 5 is a swim lane diagram showing an example of a process 500 for authorizing access to a data object. The process 500 can be performed by, for example, the system 100, and for clarity of presentation, the description that follows uses the system 100 as the basis for describing the process. However, another system, or combination of systems, may be used to perform the process 500. Message passing between networked computers, as described here and elsewhere, may be over a secure socket layer (SSL) channel or another format that can protect the messages from tampering and inspection by third parties.
[0074] The content provider 122 can encrypt a data object with an encryption key (502). For example, the content provider 122 may generate, purchase, or otherwise acquire a data object that is to be shared, rented, or sold to users or customers. Data objects of this type can include, but are not limited to, media files, scientific data-sets, personal communications, medical records, and business records.
[0075] In this example, this encryption key will be referred to as the data object encryption key. The data object encryption key described here is a symmetric encryption key. That is, a data object encrypted with the data object encryption key may be decrypted by anyone that knows the data object encryption key. However, other encryption schemes are possible, such as a public/private key system where a public key is used to encrypt a data object, but only a private can decrypt the data object.
[0076] The hosted storage system 120 can receive, from the content provider 122, a request to store the data object (504). The request includes a location of an access control service that is separate from the hosted storage service and that controls access permissions for the data object. The location can specify, for example, a URI for the access control service 124, a protocol to use when communicating with the control service 124, and parameters to send to the access control service 124. These parameters can include information such as information about a user requesting access authorization (e.g. user ID), the state of the hosted storage service 120 (e.g. timestamp of last request), and/or other information that may be used to determine authorization. In this example, the access keystore 126 is either not used, or is a component of the access control service 124. For clarity, communications between the access control service 124 and a keystore 126 are not shown. Other examples in which the access control service 124 and the access keystore 126 are separate entities are discussed below.
[0077] The hosted storage service 120 can store the data object in association with metadata that indicates the location of the access control service (506). The hosted storage service 120 can store this data in metadata 1 16. An example scheme for this storage is discussed with respect to Fig 6, below.
[0078] The client 102 can identify a data object in the hosted storage system 120 to access (508). For example, the client 102 can receive information about the data object from the content provider 122. A web browser on the client 102 may be browsing the content provider's 122 website and select a link that has an embedded reference to the hosted data object. As a result, the client 102 can send a request to the hosted storage service 120 to access the object.
[0079] The hosted storage service 120 can receive, from the client 102, the request to access the stored data object (510). For example, the client 102 can send a HTTP GET or HEAD message referencing the data object to the hosted storage service 120, as previously described. The hosted storage service 120 can parse the request and identify the referenced data object.
[0080] The hosted storage service 120 can access the metadata stored in association with the data object (512). The metadata can store, among other information, information about the authentication and/or authorization scheme used for the associated data object. The hosted storage service 120 can determine, from the metadata, that a remote access control service determines access authorization for the data object (514). The hosted storage service 120 can also identify information in the metadata about the authorization request to send to the access control service 124, including but not limited to, the location of the access control service 124.
[0081] In some implementations, the hosted storage service 120 can receive a validation of the access control service 124 that indicates that the access control service may be used for authorizing access to the data object. This validation may be received as part of determining the access control service 514, or at some previous point. Some schemes for validation of the access control service 124 are described later in this document.
[0082] In response to determining that the access permissions for the resource are controlled by the access control service 124, the hosted storage service 120 can send an access request to the access control service 124. The access request can include identifying information about the data object requested, and about the user of the client 102 that requested access. Some or all of this information may be specified by the parameters listed in the location information, and/or some or all of this information may be provided in all access requests generated by the hosted storage service 120.
[0083] In some implementations, the information that identifies the user of the client 102 may be an authentication token created by the hosted storage service 120, or by a system used by the hosted storage service 120 for user authentication. Here, the user would have been authenticated and known by the hosted storage service 120 prior to, or as part of, the request to access the data object. The authentication token, or other data if a different authentication scheme is used, is provided by the hosted storage service 120 to the access control service 124 as an indication that the request is originating a user that has been authenticated by the hosted storage service 120.
[0084] Alternatively, the information that identifies the user of the client 102 may be copied from the request to access the stored resource. For example, the request to access the stored resource may include a header with authentication information (e.g. user name and password) used by the access control service 124. This authentication information may be hashed, encrypted, or otherwise obfuscated to be hidden from the hosted storage service 120.
[0085] The access control service 124 can receive the access request from the hosted storage service 120 and can authorize the access (518). In some implementations, the authorization process used by the access control service 124 may be unknown by the hosted storage service 120. That is, the access control service 124 need not report or register the logic or process used to determine authorization. This can permit, for example, the access control service to change, extend, add, and/or terminate authentication processes without reporting to the hosted storage service 120. In addition to the information contained in the access request, the access control service 124 may also use information for authorization that is not available to the hosted storage service 120. For example, the access control service 124 may process billing of the user for authorization without passing any user financial information through the hosted storage service 120.
[0086] In some implementations, the access control service 124 can receive a validation of the hosted storage service 120 that indicates that the hosted storage service 120 may be used for serving the data object to the client 102. This validation may be received as part of authorizing the access to the data object 518, or at some previous point. Some schemes for validation of the hosted storage service 120 are described later in this document.
[0087] The hosted storage service 120 can receive, from the access control service 124, an access response that indicates that the user is permitted to access the resource (520). In some implementations, the access response can include a bucket or object role, as previously described with regards to ACL 118 {scope, role} pairs. The access response can include a duration and/or access count that indicates that the user is authorized for a particular period of time and/or number of access. An access response may authorize a user for one logical operation, as determined by the access control service. For example, an access response may authorize a user for one GET and one PUT message, permitting one logical edit to the data object. In some implementations, this duration or count may reduce the number of access request sent from the hosted storage service 120 to the access control service 124.
[0088] In response to receiving the access response, the hosted storage service 120 can send the data object to the client 102 (522). For example, the hosted storage service 120 may transmit the data object to the client 102, as previously described. The client 102 can receive the data object from the hosted storage service 120 (524). Using the data object encryption key, the client 102 can decrypt the data object to access the data object's plaintext. Some schemes for key management where the client 102 and the content provider 122 have access to the data object encryption key are described later in this document.
[0089] Alternatively, the hosted storage service 120 can receive, from the access control service 124, an access response that indicates that the user is not permitted to access the resource. In some implementations, this type of access response may include a text string or denial code indicating the reason that the access control service 124 denied access (e.g. unrecognized user, failed billing attempt). The hosted storage service 120 may use this information in future processes, and/or may pass this information back to the client 102. In other implementations, the access response may not contain this type of information. For example, the access control service 124 may communicate a reason for denial directly to the client 102.
[0090] As described, the content provider 122 and the client 102 may both have copies of the data object encryption key used to encrypt and decrypt the data object. A number of schemes for key management are possible that ensure that both the client 102 and the content provider 122 have access to the data object encryption key while the hosted storage service 120 does not. A feature of such key management schemes is that the content provider and the client 102 can use the hosted storage service 120 for hosted storage without exposing the plain text of the data object to the hosted storage service 120. In some implementations, such as where the data object is not secret or sensitive, the encryption and key management need not be used. Described here are two key management schemes, but others are possible.
[0091] In one scheme, the content provider 122 can send the data object encryption key to the client 102 through a side channel, that is, through a communication channel that does not include the hosted storage service. For example, the content provider 122 may transmit the data object encryption key directly through the network 104, through email, parcel mail, verbally in person or telephonically. This scheme may be useful for situations in which the content provider 122 wishes to make all of its content, or all content within a particular category, available to the user of the client 102. One such example includes a personal accountant preparing reports and statements for a customer. The accountant is unlikely to charge per report, instead wishing the customer to be able to access any of the customer's documents if the customer has paid for the accountant's services.
[0092] In another scheme, the content provider 122 can provide to the user of the client 102, through a side channel, a client encryption key. This key is a symmetric encryption key unique to the user. Later, when the content provider 122 receives the access request identifying the user, the content provider 122 can encrypt the data object encryption key with the client encryption key. In this encrypted state, the data object encryption key cannot be used to decrypt the data object. In the access response from the access control service 124, the access control service 124 can include the encrypted data object encryption key. The hosted storage service 120 can pass this encrypted data object encryption key to the client 102, which can decrypt the encrypted data object encryption key with the client encryption key. This can allow the client 102 access to the data object encryption key for use in decrypting the data object. This scheme may be useful for situation in which the content provider 122 wishes to encrypt each data object with a different data object encryption key. That is, the content provider 122 does not wish to make all data objects available to the client 102. One such example includes a movie distributor selling access to movies to customers. A customer that purchases access to one movie in this scheme would not have access to the data object encryption keys for movies they did not purchase.
[0093] In the process 500, the access keystore 126 is either not used, or is a component of the access control service 124. In other example processes, the access keystore 126 may be used and may be a separate entity from the access control service 124. In one example, the client 102 may request the data object encryption key from the access keystore 126 after receiving the encrypted data object from the hosted storage service 120. In this case, the user may be authenticated by the access keystore 126, or a user's request may include information proving that the user was granted authorization to access the data object. This information may include, for example, a token provided to the client 102 by the access control service 124 or the hosted storage service 120, a cryptographic hash of the encrypted data object, and/or any other sort of appropriate information.
[0094] In another example in which the access keystore 126 may be used and may be a separate entity from the access control service 124, the hosted storage system 120 may request the data object encryption key from the access keystore 126. For example, after receiving the authorization message from the access control service 124, the hosted storage service can request the data object encryption key from the access keystore 126. The keystore 126 may return the data object encryption key in encrypted form, for example encrypted with the client key, to the hosted storage service 120. When the hosted storage service serves 120 the data object to the client, the hosted storage service can also provide the encrypted data object encryption key.
[0095] In addition to these key management schemes, there are key management schemes that support a stateless access control service 124 or stateless access keystore 126. By configuring a component to be stateless, the speed and scalability of the component can be improved compared to a stateful version of the component. In some of these stateless configurations, the access control service 124 or the access keystore 126 may need to store only one encryption key for the content provider 122.
[0096] In this scheme, the content provider 122 can encrypt a data object with a data object encryption key before storing the data objects in the hosted storage service 120. When the content provider 122 stores a data object in the hosted storage service 120, the content provider 122 can encrypt the data object encryption key with a provider key and store the encrypted data object encryption key with the encrypted data object. This provider key may be used by the content provider 122 to encrypt all data object encryption keys, or all data object encryption keys of a particular class (e.g. one key per copyright holder for a movie distributor). The content provider 122 can then provide the content key(s) to the access control service 124 or the access keystore 126 through a side-channel that does not include the client 102 or the hosted storage service 120. The hosted storage service 120 can store the encrypted data object encryption key in association with the data object, for example in the metadata 116.
[0097] Depending on the configuration of the system 100, the access control service 124 or the access keystore 126 can be sent the encrypted data object encryption key by the hosted storage service 120, the client 102, or the access control service 124. Additional authorization or authentication information may also be provided to show that the requesting party authorized to access the data object in decrypted form. In response to a valid request, the access control service 124 or the access keystore 126 can decrypt the data object encryption key and return it to the requestor. In addition to the features of a stateless access control service 124 or the access keystore 126, the scheme also permits the use of different data object encryption keys for every data object. As such, access one data object of the content provider 122 (e.g. one movie) need not permit or enable access to anther data object of the content provider 122 (e.g. a different movie).
[0098] Described here are schemes for validation of the hosted storage service 120 and the access control services 124. These schemes may be used to ensure that only hosted storage services 120 and access control services 124 specified by the content provider 122 and/or client 102 are used for storage and access control, respectively. They may prevent, for example, use of a rogue access control service that is configured to grant any authorization request, or denial of service attacks to the access control service 124.
[0099] In one scheme, the content provider 122 registers the hosted storage service 120 with the access control service 124. This registration may include, for example, a listing or classification of data objects that the content provider 122 will store in the hosted storage service 120. Then, any request to the access control service 124 will be compared with this validation information. If the hosted storage service 120, and any other information, of an access request matches the validation information, the access control service 124 can process the access authorization 518.
[00100] In another scheme, the content provider 122 can register the access control service 124 with the hosted storage service 120. This registration may include, for example, a listing or classification of data objects that the access control service 124 can authorize access to. If the access control service 124, and any other information, matches the access metadata of a data object being request, the hosted storage service 120 can send the access request 216.
[00101] In some cases of bi-directional validation in which both the hosted storage service 120 and the access control service 124 have been validated with each other, the validation process can include certificates that define the valid endpoints. For example, the hosted storage service 120 and/or the access control service 124 may require that communication be over SSL. [00102] The registration of the hosted storage service 120 by the client 102 in the access control service 124 may include the creation of a secret. This secret can be used by the client 102 as authentication information when requesting a data object from the hosted storage service 120, and the hosted storage service 120 can pass this secret to the access control service 124 with the authorization request to show that the authorization request is on behalf of the client 102. To create this secret, the client 102 can authenticate itself to the access control service 124 using any appropriate client-server authentication mechanisms (e.g. user name and password, client certificate, one time password, hardware tokens). Once authenticated, the client 102 and the access control service 102 can create and agree on a symmetric encryption key that will be referred to as a session key. The client may then generate a tag, sometimes called a message authentication code or MAC secret, for a request sent to the hosted storage service 120 for a data object that is authorized by the access control service. This tag may be created via a cryptographic hashing function that takes the session key and the message as input and returns the tag as output. The hosted storage service 120 can include the tag in the authorization request to the access control service 124. The access control service, which has a copy of the session key, may verify that the request originated with the client 102. In some cases, the access control service 124 can use the session key, or a key derived from the session key, to encrypt the data object or data object encryption keys before they pass back through the hosted storage system 120 to the client 102.
[00103] In some implementations, the hosted storage service 120 may be independently authenticated by access control service 124, and/or the access control service 124 may be independently authenticated by the hosted storage service 120. That is, the hosted storage service 120 and the access control service 124 may have an authentication relationship that is independent of the client 102. This may permit, for example, the hosted storage service 120 and the access control service 124 to expose their authorization endpoints to the Internet without accepting traffic from valid hosted storage services and access control services.
[00104] The process 500 can be used to facilitate a number of uses. Described below are a number of example uses, although others are possible.
[00105] The process 500 can be used to assure compliance with a regulatory, contractual, or insurance mandate. For example, a business may be required to maintain records for inspection by compliance officers. The business may store the records in the hosted storage service 120 and assign a trusted access control service 124 to permit access by the compliance officer and reject attempts by the business to alter the records.
[00106] An administrator of the data objects may use the process 500 to facilitate fail-safe auditing of access requests. That is, the administrator may log, in the access control server 124, authorization requests to the data object. Using behavior heuristics, the administrator may determine, before granting access to the data object, that a new access request is malicious or from an untrusted party (e.g. from a computer system with a virus). The administrator may deny access or contact the user that apparently generated the access request, as appropriate.
[00107] The process 500 may be used when the hosted storage service 120 does not or cannot have access to all information needed to authorize access to a data object. For example, the access control service 124 may be a component of another computer system such as a corporate network. This corporate network may use information to authorize access that is secret or constantly changing. For example, the location of an employee, as determined by key-card swipes, can be used to ensure that an employee is in the corporation's building before authorizing access to sensitive documents.
[00108] Some authentication processes require interactions between the client 102 and the access control service 124 during authorization. For example, a request to access downloadable content by a video game client may require the user of the video game to process a real or in-game financial transaction or to complete and in-game challenge.
[00109] Collaborative software development projects can use the process 500 for code management. In this example, any user may be permitted to read a data object, as defined by a {role, scope} ACL 118 for the project's bucket, but any edits or uploads must be reviewed by a code maintenance team, as defined by a remote authorization ACL 118.
[00110] FIG. 6 is a block diagram showing an example of hosted storage metadata 116 and access control lists 118. In this example, the hosted storage service 120 is storing at least two data objects, data object A and data object B, though more, fewer, and different data objects may be stored in other examples. Different configurations of the hosted storage service 120 may use some, all, or none of the metadata 118 and ACLs 1 16 shown.
[00111] Data object A is stored, in this example, in association with the ACL 602. The ACL 602 is formatted as a {scope, role} tuple that defines the authorization permission available to User 1 for data object A. Although only a single user is shown in ACL 602, other {scope, role} ACLs can define permissions for multiple users, user groups, etc. When a user attempts to access the data object A, the ACL 602 is used, for example by the interface backend 108, to determine if the access is permitted or not.
[00112] Data object B is stored, in this example, with some or all of the ACLs 604 and 606 and the metadata 608. Although only a single user is shown in each of the ACLs 604 and 606, other ACLs can define permissions for multiple users, user groups, etc. The ACL 604 is a {scope, role} formatted ACL which defines the authorization permission available to User 2. The ACL 606 is a remote access formatted ACL that lists an access control address. The access control address references a remote access control service, such as the remote access control service 124, which determines authorization access of data object B for User 3. The metadata 608 can specify access parameters and the format of those access parameters in access request messages from the hosted storage service 120 to the access control service. In some implementations, a single ACL 1 18 can have entries of both {scope, role} format and remote access format. That is, a single ACL 1 18 may contain the ACLs 604 and 606.
[00113] In some configurations of the hosted storage service 120, the interface backend 108 can check for {scope, role} formatted ACLs 1 18 first, and fall back on remote access formatted ACLs 1 18. Here, a user entry in the ACL 604 would effectively supersede a user entry in the ACL 606. For example, consider User 2 ID and User 3 ID as Service Group ID, to which any particular user may or may not be a member. If a user requests access to the data object B and is a member of the User 2 service group, the permission field of the ACL 604 is used to determine access authorization. If the user is not a member of the User 2 service group but is a member of the User 3 service group, the ACL 606 is used to determine access authorization.
[00114] In some other configurations, the interface backend 108 can check for remote access formatted ACLs 1 18 first, and fall back on {scope, role} formatted ACLs 118. In these configurations, a user entry in the ACL 606 would effectively supersede a user entry in the ACL 604. In this confirmation, if the user is a member of the User 3 service group, the ACL 606 would be used, even if the user is also a member of the User 2 service group.
[00115] The hosted storage service 120 can be configured to ensure that the owner of a data object, or the owner of the bucket containing the data object, is always given the FULL_CONTROL role. For example, this can ensure that, even if an access control service is misconfigured and erroneously rejecting all access request or is off-line, the owner of the data object is able to access the data object.
[00116] FIG. 7 shows an example of a computing device 700 and a mobile computing device 750 that can be used to implement the techniques described here. The computing device 700 is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The mobile computing device 750 is intended to represent various forms of mobile devices, such as personal digital assistants, cellular telephones, smart-phones, and other similar computing devices. The components shown here, their connections and relationships, and their functions, are meant to be examples only, and are not meant to be limiting.
[00117] The computing device 700 includes a processor 702, a memory 704, a storage device 706, a high-speed interface 708 connecting to the memory 704 and multiple highspeed expansion ports 710, and a low-speed interface 712 connecting to a low-speed expansion port 714 and the storage device 706. Each of the processor 702, the memory 704, the storage device 706, the high-speed interface 708, the high-speed expansion ports 710, and the low-speed interface 712, are interconnected using various busses, and may be mounted on a common motherboard or in other manners as appropriate. The processor 702 can process instructions for execution within the computing device 700, including instructions stored in the memory 704 or on the storage device 706 to display graphical information for a GUI on an external input/output device, such as a display 716 coupled to the high-speed interface 708. In other implementations, multiple processors and/or multiple buses may be used, as appropriate, along with multiple memories and types of memory. Also, multiple computing devices may be connected, with each device providing portions of the necessary operations (e.g., as a server bank, a group of blade servers, or a multi-processor system).
[00118] The memory 704 stores information within the computing device 700. In some implementations, the memory 704 is a volatile memory unit or units. In some
implementations, the memory 704 is a non-volatile memory unit or units. The memory 704 may also be another form of computer-readable medium, such as a magnetic or optical disk.
[00119] The storage device 706 is capable of providing mass storage for the computing device 700. In some implementations, the storage device 706 may be or contain a computer- readable medium, such as a floppy disk device, a hard disk device, an optical disk device, or a tape device, a flash memory or other similar solid state memory device, or an array of devices, including devices in a storage area network or other configurations. Instructions can be stored in an information carrier. The instructions, when executed by one or more processing devices (for example, processor 702), perform one or more methods, such as those described above. The instructions can also be stored by one or more storage devices such as computer- or machine-readable mediums (for example, the memory 704, the storage device 706, or memory on the processor 702).
[00120] The high-speed interface 708 manages bandwidth-intensive operations for the computing device 700, while the low-speed interface 712 manages lower bandwidth- intensive operations. Such allocation of functions is an example only. In some
implementations, the high-speed interface 708 is coupled to the memory 704, the display 716 (e.g., through a graphics processor or accelerator), and to the high-speed expansion ports 710, which may accept various expansion cards (not shown). In the implementation, the low- speed interface 712 is coupled to the storage device 706 and the low-speed expansion port 714. The low-speed expansion port 714, which may include various communication ports (e.g., USB, Bluetooth, Ethernet, wireless Ethernet) may be coupled to one or more input/output devices, such as a keyboard, a pointing device, a scanner, or a networking device such as a switch or router, e.g., through a network adapter.
[00121] The computing device 700 may be implemented in a number of different forms, as shown in the figure. For example, it may be implemented as a standard server 720, or multiple times in a group of such servers. In addition, it may be implemented in a personal computer such as a laptop computer 722. It may also be implemented as part of a rack server system 724. Alternatively, components from the computing device 700 may be combined with other components in a mobile device (not shown), such as a mobile computing device 750. Each of such devices may contain one or more of the computing device 700 and the mobile computing device 750, and an entire system may be made up of multiple computing devices communicating with each other.
[00122] The mobile computing device 750 includes a processor 752, a memory 764, an input/output device such as a display 754, a communication interface 766, and a transceiver 768, among other components. The mobile computing device 750 may also be provided with a storage device, such as a micro-drive or other device, to provide additional storage. Each of the processor 752, the memory 764, the display 754, the communication interface 766, and the transceiver 768, are interconnected using various buses, and several of the components may be mounted on a common motherboard or in other manners as appropriate.
[00123] The processor 752 can execute instructions within the mobile computing device 750, including instructions stored in the memory 764. The processor 752 may be
implemented as a chipset of chips that include separate and multiple analog and digital processors. The processor 752 may provide, for example, for coordination of the other components of the mobile computing device 750, such as control of user interfaces, applications run by the mobile computing device 750, and wireless communication by the mobile computing device 750.
[00124] The processor 752 may communicate with a user through a control interface 758 and a display interface 756 coupled to the display 754. The display 754 may be, for example, a TFT (Thin-Film-Transistor Liquid Crystal Display) display or an OLED (Organic Light Emitting Diode) display, or other appropriate display technology. The display interface 756 may comprise appropriate circuitry for driving the display 754 to present graphical and other information to a user. The control interface 758 may receive commands from a user and convert them for submission to the processor 752. In addition, an external interface 762 may provide communication with the processor 752, so as to enable near area communication of the mobile computing device 750 with other devices. The external interface 762 may provide, for example, for wired communication in some implementations, or for wireless communication in other implementations, and multiple interfaces may also be used.
[00125] The memory 764 stores information within the mobile computing device 750. The memory 764 can be implemented as one or more of a computer-readable medium or media, a volatile memory unit or units, or a non-volatile memory unit or units. An expansion memory 774 may also be provided and connected to the mobile computing device 750 through an expansion interface 772, which may include, for example, a SIMM (Single In Line Memory Module) card interface. The expansion memory 774 may provide extra storage space for the mobile computing device 750, or may also store applications or other information for the mobile computing device 750. Specifically, the expansion memory 774 may include instructions to carry out or supplement the processes described above, and may include secure information also. Thus, for example, the expansion memory 774 may be provide as a security module for the mobile computing device 750, and may be programmed with instructions that permit secure use of the mobile computing device 750. In addition, secure applications may be provided via the SIMM cards, along with additional information, such as placing identifying information on the SIMM card in a non-hackable manner.
[00126] The memory may include, for example, flash memory and/or NVRAM memory (non-volatile random access memory), as discussed below. In some implementations, instructions are stored in an information carrier, that the instructions, when executed by one or more processing devices (for example, processor 752), perform one or more methods, such as those described above. The instructions can also be stored by one or more storage devices, such as one or more computer- or machine-readable mediums (for example, the memory 764, the expansion memory 774, or memory on the processor 752). In some implementations, the instructions can be received in a propagated signal, for example, over the transceiver 768 or the external interface 762.
[00127] The mobile computing device 750 may communicate wirelessly through the communication interface 766, which may include digital signal processing circuitry where necessary. The communication interface 766 may provide for communications under various modes or protocols, such as GSM voice calls (Global System for Mobile communications), SMS (Short Message Service), EMS (Enhanced Messaging Service), or MMS messaging (Multimedia Messaging Service), CDMA (code division multiple access), TDMA (time division multiple access), PDC (Personal Digital Cellular), WCDMA (Wideband Code Division Multiple Access), CDMA2000, or GPRS (General Packet Radio Service), among others. Such communication may occur, for example, through the transceiver 768 using a radio-frequency In addition, short-range communication may occur, such as using a Bluetooth, WiFi, or other such transceiver (not shown). In addition, a GPS (Global
Positioning System) receiver module 770 may provide additional navigation- and location- related wireless data to the mobile computing device 750, which may be used as appropriate by applications running on the mobile computing device 750.
[00128] The mobile computing device 750 may also communicate audibly using an audio codec 760, which may receive spoken information from a user and convert it to usable digital information. The audio codec 760 may likewise generate audible sound for a user, such as through a speaker, e.g., in a handset of the mobile computing device 750. Such sound may include sound from voice telephone calls, may include recorded sound (e.g., voice messages, music files, etc.) and may also include sound generated by applications operating on the mobile computing device 750. [00129] The mobile computing device 750 may be implemented in a number of different forms, as shown in the figure. For example, it may be implemented as a cellular telephone 780. It may also be implemented as part of a smart-phone 782, personal digital assistant, or other similar mobile device.
[00130] Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, specially designed ASICs
(application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various implementations can include implementation in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.
[00131] These computer programs (also known as programs, software, software applications or code) include machine instructions for a programmable processor, and can be implemented in a high-level procedural and/or object-oriented programming language, and/or in assembly/machine language. As used herein, the terms machine-readable medium and computer-readable medium refer to any computer program product, apparatus and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine- readable medium that receives machine instructions as a machine-readable signal. The term machine-readable signal refers to any signal used to provide machine instructions and/or data to a programmable processor.
[00132] To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the computer. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.
[00133] The systems and techniques described here can be implemented in a computing system that includes a back end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front end component (e.g., a client computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.
[00134] The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
[00135] Although a few implementations have been described in detail above, other modifications are possible. For example, while a client application is described as accessing the delegate(s), in other implementations the delegate(s) may be employed by other applications implemented by one or more processors, such as an application executing on one or more servers. In addition, the logic flows depicted in the figures do not require the particular order shown, or sequential order, to achieve desirable results. In addition, other actions may be provided, or actions may be eliminated, from the described flows, and other components may be added to, or removed from, the described systems. Accordingly, other implementations are within the scope of the following claims.

Claims

WHAT IS CLAIMED IS:
1. A method performed by one or more processors, the method comprising:
receiving, at a hosted storage service, a resource and a request to store the resource, the request including a location of an access control service, wherein the access control service is separate from the hosted storage service and controls access permissions for the resource;
storing, at the hosted storage service, the resource in association with metadata that indicates the location of the access control service;
receiving, at the hosted storage service and from a client system, a request to access the stored resource;
accessing, at the hosted storage service, the metadata stored in association with the resource;
determining, at the hosted storage service and based on the metadata, that access permissions for the resource are controlled by the access control service;
in response to determining that access permissions for the resource are controlled by the access control service, sending an access request from the hosted storage service to the access control service, the access request identifying the resource and a user of the client system;
receiving, at the hosted storage service and from the access control service, an access response that indicates the user is permitted to access the resource; and
in response to receiving the access response, sending the resource from the hosted storage service to the client system.
2. The method of claim 1, wherein the access control service maintains an access control list that defines who is authorized to perform actions on resources, and the nature of the permitted actions.
3. The method of claim 1, wherein the access control service is subject to a different
administrative control than the hosted storage service.
4. The method of claim 1 , wherein the resource is encrypted by a content provider with a first key before the resource is received at the hosted storage service.
5. The method of claim 4, the method further comprising:
receiving, at the hosted storage service, the first key encrypted with a client key; and sending, by the hosted storage service and to the client system, the first key encrypted with the client key for decryption by the client using the client key.
6. The method of claim 5, wherein the first key encrypted with a client key is received from an access keystore that is subject to a different administrative control than the hosted storage service and subject to a different administrative control than the access control service.
7. The method of claim 4, wherein the first key is provided to the client system from the content provider.
8. The method of claim 4, wherein the first key is encrypted with a provider key and
wherein the method further comprises:
receiving, at the hosted storage service, the encrypted first key; and
storing, at the hosted storage service and in association with the resource, the encrypted first key.
9. The method of claim 8, the method further comprising;
in response to receiving the access response, sending the encrypted first key from the hosted storage service to the client system.
10. The method of claim 1, wherein the metadata stored in association with the resource comprises an access control list.
1 1. The method of claim 10, wherein the access control list identifies a user and access permission for the associated resource for the user.
12. The method of claim 10, wherein the hosted storage service stores a second resource in association with a second access control list which identifies a second user and a second access permission for the associated second resource for the second user.
13. The method of claim 1, the method further comprising:
receiving, at the hosted storage service, a validation of the access control service indicating that the access control service may be used for authorizing access to the resource.
14. The method of claim 1, wherein receiving a request to access the stored resource includes receiving authentication information agreed upon by client system and the access control service; and
wherein sending an access request to the access control service include sending the authentication information.
15. A computer system comprising:
a hosted storage service configured to:
receive a resource and a request to store the resource, the request including a location of an access control service, wherein the access control service is separate from the hosted storage service and controls access permissions for the resource;
store the resource in association with metadata that indicates the location of the access control service;
receive a request to access the stored resource;
access the metadata stored in association with the resource;
determine, based on the metadata, that access permissions for the resource are controlled by the access control service;
in response to determining that access permissions for the resource are controlled by the access control service, send an access request to the access control service, the access request identifying the resource and a user of the client system; and receive, from the access control service, an access response that indicates the user is permitted to access the resource; and
in response to receiving the access response, send the resource from the hosted storage service to the client system;
a client system configured to:
send, to the hosted storage service, the request to access the stored resource; and
receive from the hosted storage service, the resource; and
an access control service configured to:
receive, from the hosted storage service, the access request; and send, in response to receiving the access request, the access response.
16. The system of claim 15, wherein the access control service maintains an access control list that defines who is authorized to perform actions on resources, and the nature of the permitted actions.
17. The system of claim 15, wherein the access control service is subject to a different
administrative control than the hosted storage service.
18. The system of claim 15, wherein the system further comprises:
a content provider configured to:
encrypt the resource with a first key; and
send, after encrypting the resource, the resource to the hosted storage service.
19. The system of claim 18, wherein:
the access control service further configured to:
encrypt the first key with a client key; and
send, to the hosted storage service, the first key encrypted with the client key; the hosted storage service further configured to:
receive the first key encrypted with the client key; and
send, to the client system, the first key encrypted with the client key; and the client system further configured to receive the first key encrypted with the client key.
20. The system of claim 21, wherein the system further comprises an access keystore that is subject to a different administrative control than the hosted storage service and subject to a different administrative control than the access control service, the access keystore configured to:
send, to the hosted storage service, the first key encrypted with a client key to the hosted storage system; and
the hosted storage service further configured to:
receive the first key encrypted with a client key.
21. The system of claim 18, wherein:
the content provider is further configured to send, to the client system, the first key; and
the client system is further configured to receive the first key.
22. The system of claim 18, wherein the first key is encrypted with a provider key and
wherein the hosted storage service is further configured to:
receive the encrypted first key; and
store the encrypted first key in association with the resource
23. The system of claim 22, wherein the hosted storage service is further configured to send the encrypted first key to the client system in response to receiving the access response.
24. The system of claim 15, wherein the metadata stored in association with the resource comprises an access control list.
25. The system of claim 24, wherein the access control list identifies a user and access permission for the associated resource for the user.
26. The system of claim 24, wherein:
the hosted storage service is further configured to store a second resource in association with a second access control list which identifies a second user and a second access permission for the associated second resource for the second user.
27. The system of claim 15, wherein the hosted storage service is further configured to receive a validation of the access control service indicating that the access control service may be used for authorizing access to the resource.
28. The system of claim 15, wherein, to receive a request to access the stored resource, the hosted storage service is further configured to receive authentication information agreed upon by client system and the access control service; and
wherein to send an access request to the access control service, the hosted storage service is configured to send the authentication information.
PCT/US2013/070733 2012-11-20 2013-11-19 Delegate authorization in cloud-based storage system WO2014081698A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13/681,516 US9209973B2 (en) 2012-11-20 2012-11-20 Delegate authorization in cloud-based storage system
US13/681,516 2012-11-20

Publications (2)

Publication Number Publication Date
WO2014081698A2 true WO2014081698A2 (en) 2014-05-30
WO2014081698A3 WO2014081698A3 (en) 2014-09-04

Family

ID=49674418

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2013/070733 WO2014081698A2 (en) 2012-11-20 2013-11-19 Delegate authorization in cloud-based storage system

Country Status (2)

Country Link
US (1) US9209973B2 (en)
WO (1) WO2014081698A2 (en)

Families Citing this family (228)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2508015A (en) * 2012-11-19 2014-05-21 Mastercard International Inc Method and apparatus for secure card transactions
US8897450B2 (en) * 2012-12-19 2014-11-25 Verifyle, Inc. System, processing device, computer program and method, to transparently encrypt and store data objects such that owners of the data object and permitted viewers are able to view decrypted data objects after entering user selected passwords
US10218815B2 (en) * 2013-03-13 2019-02-26 Unify Gmbh & Co. Kg Method, device, and system for communicating a changeability attribute
US9477934B2 (en) * 2013-07-16 2016-10-25 Sap Portals Israel Ltd. Enterprise collaboration content governance framework
WO2015026336A1 (en) * 2013-08-21 2015-02-26 Intel Corporation Processing data privately in the cloud
US11630585B1 (en) 2016-08-25 2023-04-18 Pure Storage, Inc. Processing evacuation events in a storage array that includes a plurality of storage devices
WO2016026537A1 (en) * 2014-08-22 2016-02-25 Nec Europe Ltd. A method for storing of data within a cloud storage and a cloud storage system
EP3012761B1 (en) * 2014-10-20 2021-09-08 dSPACE digital signal processing and control engineering GmbH Protection of software models
US9584489B2 (en) * 2015-01-29 2017-02-28 Google Inc. Controlling access to resource functions at a control point of the resource via a user device
US10599621B1 (en) * 2015-02-02 2020-03-24 Amazon Technologies, Inc. Distributed processing framework file system fast on-demand storage listing
US11188665B2 (en) 2015-02-27 2021-11-30 Pure Storage, Inc. Using internal sensors to detect adverse interference and take defensive actions
US9762585B2 (en) * 2015-03-19 2017-09-12 Microsoft Technology Licensing, Llc Tenant lockbox
GB201504710D0 (en) * 2015-03-20 2015-05-06 Ibm Establishing transaction metadata
US11102298B1 (en) 2015-05-26 2021-08-24 Pure Storage, Inc. Locally providing cloud storage services for fleet management
US9716755B2 (en) 2015-05-26 2017-07-25 Pure Storage, Inc. Providing cloud storage array services by a local storage array in a data center
US9594678B1 (en) 2015-05-27 2017-03-14 Pure Storage, Inc. Preventing duplicate entries of identical data in a storage device
US10021170B2 (en) 2015-05-29 2018-07-10 Pure Storage, Inc. Managing a storage array using client-side services
US11503031B1 (en) 2015-05-29 2022-11-15 Pure Storage, Inc. Storage array access control from cloud-based user authorization and authentication
US9300660B1 (en) 2015-05-29 2016-03-29 Pure Storage, Inc. Providing authorization and authentication in a cloud for a user of a storage array
US9444822B1 (en) * 2015-05-29 2016-09-13 Pure Storage, Inc. Storage array access control from cloud-based user authorization and authentication
US9588691B2 (en) 2015-06-10 2017-03-07 Pure Storage, Inc. Dynamically managing control information in a storage device
US9594512B1 (en) 2015-06-19 2017-03-14 Pure Storage, Inc. Attributing consumed storage capacity among entities storing data in a storage array
US10310740B2 (en) 2015-06-23 2019-06-04 Pure Storage, Inc. Aligning memory access operations to a geometry of a storage device
US10284534B1 (en) * 2015-06-26 2019-05-07 EMC IP Holding Company LLC Storage system with controller key wrapping of data encryption key in metadata of stored data item
US10931682B2 (en) 2015-06-30 2021-02-23 Microsoft Technology Licensing, Llc Privileged identity management
US10296236B2 (en) 2015-07-01 2019-05-21 Pure Storage, Inc. Offloading device management responsibilities from a storage device in an array of storage devices
US9892071B2 (en) 2015-08-03 2018-02-13 Pure Storage, Inc. Emulating a remote direct memory access (‘RDMA’) link between controllers in a storage array
US9851762B1 (en) 2015-08-06 2017-12-26 Pure Storage, Inc. Compliant printed circuit board (‘PCB’) within an enclosure
US11625181B1 (en) 2015-08-24 2023-04-11 Pure Storage, Inc. Data tiering using snapshots
US10198194B2 (en) 2015-08-24 2019-02-05 Pure Storage, Inc. Placing data within a storage device of a flash array
US11294588B1 (en) 2015-08-24 2022-04-05 Pure Storage, Inc. Placing data within a storage device
CN106487770B (en) 2015-09-01 2019-07-30 阿里巴巴集团控股有限公司 Method for authenticating and authentication device
WO2017053509A1 (en) * 2015-09-22 2017-03-30 Conjur, Inc. Dynamic computing resource access authorization
US10887314B2 (en) * 2015-09-29 2021-01-05 Verisign, Inc. Access control for named domain networking
US11360844B1 (en) 2015-10-23 2022-06-14 Pure Storage, Inc. Recovery of a container storage provider
US10514978B1 (en) 2015-10-23 2019-12-24 Pure Storage, Inc. Automatic deployment of corrective measures for storage arrays
US9384082B1 (en) 2015-10-23 2016-07-05 Pure Storage, Inc. Proactively providing corrective measures for storage arrays
US10284232B2 (en) 2015-10-28 2019-05-07 Pure Storage, Inc. Dynamic error processing in a storage device
US9740414B2 (en) 2015-10-29 2017-08-22 Pure Storage, Inc. Optimizing copy operations
US10374868B2 (en) 2015-10-29 2019-08-06 Pure Storage, Inc. Distributed command processing in a flash storage system
US10353777B2 (en) 2015-10-30 2019-07-16 Pure Storage, Inc. Ensuring crash-safe forward progress of a system configuration update
US9760479B2 (en) 2015-12-02 2017-09-12 Pure Storage, Inc. Writing data in a storage system that includes a first type of storage device and a second type of storage device
US11762764B1 (en) 2015-12-02 2023-09-19 Pure Storage, Inc. Writing data in a storage system that includes a first type of storage device and a second type of storage device
US10326836B2 (en) 2015-12-08 2019-06-18 Pure Storage, Inc. Partially replicating a snapshot between storage systems
US11616834B2 (en) 2015-12-08 2023-03-28 Pure Storage, Inc. Efficient replication of a dataset to the cloud
US11347697B1 (en) 2015-12-15 2022-05-31 Pure Storage, Inc. Proactively optimizing a storage system
US10162835B2 (en) 2015-12-15 2018-12-25 Pure Storage, Inc. Proactive management of a plurality of storage arrays in a multi-array system
CA2951454A1 (en) * 2015-12-16 2017-06-16 Wal-Mart Stores, Inc. Publisher-subscriber queue provisioning
US10346043B2 (en) 2015-12-28 2019-07-09 Pure Storage, Inc. Adaptive computing for data compression
US9886314B2 (en) 2016-01-28 2018-02-06 Pure Storage, Inc. Placing workloads in a multi-array system
GB2547025A (en) * 2016-02-05 2017-08-09 Thales Holdings Uk Plc A method of data transfer, a method of controlling use of data and a cryptographic device
US10572460B2 (en) 2016-02-11 2020-02-25 Pure Storage, Inc. Compressing data in dependence upon characteristics of a storage system
US9760297B2 (en) 2016-02-12 2017-09-12 Pure Storage, Inc. Managing input/output (‘I/O’) queues in a data storage system
US9959043B2 (en) 2016-03-16 2018-05-01 Pure Storage, Inc. Performing a non-disruptive upgrade of data in a storage system
US9841921B2 (en) 2016-04-27 2017-12-12 Pure Storage, Inc. Migrating data in a storage array that includes a plurality of storage devices
US11112990B1 (en) 2016-04-27 2021-09-07 Pure Storage, Inc. Managing storage device evacuation
US11809727B1 (en) 2016-04-27 2023-11-07 Pure Storage, Inc. Predicting failures in a storage system that includes a plurality of storage devices
US9811264B1 (en) 2016-04-28 2017-11-07 Pure Storage, Inc. Deploying client-specific applications in a storage system utilizing redundant system resources
US10303390B1 (en) 2016-05-02 2019-05-28 Pure Storage, Inc. Resolving fingerprint collisions in flash storage system
US11231858B2 (en) 2016-05-19 2022-01-25 Pure Storage, Inc. Dynamically configuring a storage system to facilitate independent scaling of resources
US9507532B1 (en) 2016-05-20 2016-11-29 Pure Storage, Inc. Migrating data in a storage array that includes a plurality of storage devices and a plurality of write buffer devices
US10691567B2 (en) 2016-06-03 2020-06-23 Pure Storage, Inc. Dynamically forming a failure domain in a storage system that includes a plurality of blades
US10452310B1 (en) 2016-07-13 2019-10-22 Pure Storage, Inc. Validating cabling for storage component admission to a storage array
US11706895B2 (en) 2016-07-19 2023-07-18 Pure Storage, Inc. Independent scaling of compute resources and storage resources in a storage system
US10459652B2 (en) 2016-07-27 2019-10-29 Pure Storage, Inc. Evacuating blades in a storage array that includes a plurality of blades
US10474363B1 (en) 2016-07-29 2019-11-12 Pure Storage, Inc. Space reporting in a storage system
US9887975B1 (en) 2016-08-03 2018-02-06 KryptCo, Inc. Systems and methods for delegated cryptography
US10331588B2 (en) 2016-09-07 2019-06-25 Pure Storage, Inc. Ensuring the appropriate utilization of system resources using weighted workload based, time-independent scheduling
US10235229B1 (en) 2016-09-07 2019-03-19 Pure Storage, Inc. Rehabilitating storage devices in a storage array that includes a plurality of storage devices
US11886922B2 (en) 2016-09-07 2024-01-30 Pure Storage, Inc. Scheduling input/output operations for a storage system
US11531577B1 (en) 2016-09-07 2022-12-20 Pure Storage, Inc. Temporarily limiting access to a storage device
US10908966B1 (en) 2016-09-07 2021-02-02 Pure Storage, Inc. Adapting target service times in a storage system
US11481261B1 (en) 2016-09-07 2022-10-25 Pure Storage, Inc. Preventing extended latency in a storage system
US10671439B1 (en) 2016-09-07 2020-06-02 Pure Storage, Inc. Workload planning with quality-of-service (‘QOS’) integration
US10146585B2 (en) 2016-09-07 2018-12-04 Pure Storage, Inc. Ensuring the fair utilization of system resources using workload based, time-independent scheduling
CN106385454A (en) * 2016-09-18 2017-02-08 安徽爱她有果电子商务有限公司 Network computing storage system based on cloud storage
US10592546B2 (en) 2016-09-23 2020-03-17 Amazon Technologies, Inc. System for optimizing access to an indexed database
US10346458B2 (en) * 2016-09-23 2019-07-09 Amazon Technologies, Inc. Media asset access control system
CN109952570B (en) * 2016-09-23 2024-04-05 亚马逊技术有限公司 Media asset access control system
US10007459B2 (en) 2016-10-20 2018-06-26 Pure Storage, Inc. Performance tuning in a storage system that includes one or more storage devices
US11379132B1 (en) 2016-10-20 2022-07-05 Pure Storage, Inc. Correlating medical sensor data
US11620075B2 (en) 2016-11-22 2023-04-04 Pure Storage, Inc. Providing application aware storage
US10162566B2 (en) 2016-11-22 2018-12-25 Pure Storage, Inc. Accumulating application-level statistics in a storage system
US10198205B1 (en) 2016-12-19 2019-02-05 Pure Storage, Inc. Dynamically adjusting a number of storage devices utilized to simultaneously service write operations
US11461273B1 (en) 2016-12-20 2022-10-04 Pure Storage, Inc. Modifying storage distribution in a storage system that includes one or more storage devices
US10489307B2 (en) 2017-01-05 2019-11-26 Pure Storage, Inc. Periodically re-encrypting user data stored on a storage device
US11307998B2 (en) 2017-01-09 2022-04-19 Pure Storage, Inc. Storage efficiency of encrypted host system data
US10503700B1 (en) 2017-01-19 2019-12-10 Pure Storage, Inc. On-demand content filtering of snapshots within a storage system
US11340800B1 (en) 2017-01-19 2022-05-24 Pure Storage, Inc. Content masking in a storage system
US11163624B2 (en) 2017-01-27 2021-11-02 Pure Storage, Inc. Dynamically adjusting an amount of log data generated for a storage system
US11442825B2 (en) 2017-03-10 2022-09-13 Pure Storage, Inc. Establishing a synchronous replication relationship between two or more storage systems
US11169727B1 (en) 2017-03-10 2021-11-09 Pure Storage, Inc. Synchronous replication between storage systems with virtualized storage
US11675520B2 (en) 2017-03-10 2023-06-13 Pure Storage, Inc. Application replication among storage systems synchronously replicating a dataset
US10503427B2 (en) 2017-03-10 2019-12-10 Pure Storage, Inc. Synchronously replicating datasets and other managed objects to cloud-based storage systems
US10521344B1 (en) 2017-03-10 2019-12-31 Pure Storage, Inc. Servicing input/output (‘I/O’) operations directed to a dataset that is synchronized across a plurality of storage systems
US11803453B1 (en) 2017-03-10 2023-10-31 Pure Storage, Inc. Using host connectivity states to avoid queuing I/O requests
US11941279B2 (en) 2017-03-10 2024-03-26 Pure Storage, Inc. Data path virtualization
US10454810B1 (en) 2017-03-10 2019-10-22 Pure Storage, Inc. Managing host definitions across a plurality of storage systems
US11089105B1 (en) 2017-12-14 2021-08-10 Pure Storage, Inc. Synchronously replicating datasets in cloud-based storage systems
US9910618B1 (en) 2017-04-10 2018-03-06 Pure Storage, Inc. Migrating applications executing on a storage system
US10459664B1 (en) 2017-04-10 2019-10-29 Pure Storage, Inc. Virtualized copy-by-reference
US11868629B1 (en) 2017-05-05 2024-01-09 Pure Storage, Inc. Storage system sizing service
US11210133B1 (en) 2017-06-12 2021-12-28 Pure Storage, Inc. Workload mobility between disparate execution environments
US11340939B1 (en) 2017-06-12 2022-05-24 Pure Storage, Inc. Application-aware analytics for storage systems
US10417092B2 (en) 2017-09-07 2019-09-17 Pure Storage, Inc. Incremental RAID stripe update parity calculation
US10884636B1 (en) 2017-06-12 2021-01-05 Pure Storage, Inc. Presenting workload performance in a storage system
US11442669B1 (en) 2018-03-15 2022-09-13 Pure Storage, Inc. Orchestrating a virtual storage system
US10976962B2 (en) 2018-03-15 2021-04-13 Pure Storage, Inc. Servicing I/O operations in a cloud-based storage system
US11592991B2 (en) 2017-09-07 2023-02-28 Pure Storage, Inc. Converting raid data between persistent storage types
US11016824B1 (en) 2017-06-12 2021-05-25 Pure Storage, Inc. Event identification with out-of-order reporting in a cloud-based environment
US11609718B1 (en) 2017-06-12 2023-03-21 Pure Storage, Inc. Identifying valid data after a storage system recovery
US10853148B1 (en) 2017-06-12 2020-12-01 Pure Storage, Inc. Migrating workloads between a plurality of execution environments
US11422731B1 (en) 2017-06-12 2022-08-23 Pure Storage, Inc. Metadata-based replication of a dataset
US10613791B2 (en) 2017-06-12 2020-04-07 Pure Storage, Inc. Portable snapshot replication between storage systems
US10552090B2 (en) 2017-09-07 2020-02-04 Pure Storage, Inc. Solid state drives with multiple types of addressable memory
US11593036B2 (en) 2017-06-12 2023-02-28 Pure Storage, Inc. Staging data within a unified storage element
US11561714B1 (en) 2017-07-05 2023-01-24 Pure Storage, Inc. Storage efficiency driven migration
US11477280B1 (en) 2017-07-26 2022-10-18 Pure Storage, Inc. Integrating cloud storage services
US10831935B2 (en) 2017-08-31 2020-11-10 Pure Storage, Inc. Encryption management with host-side data reduction
US11455168B1 (en) 2017-10-19 2022-09-27 Pure Storage, Inc. Batch building for deep learning training workloads
US10452444B1 (en) 2017-10-19 2019-10-22 Pure Storage, Inc. Storage system with compute resources and shared storage resources
US10671435B1 (en) 2017-10-19 2020-06-02 Pure Storage, Inc. Data transformation caching in an artificial intelligence infrastructure
US11494692B1 (en) 2018-03-26 2022-11-08 Pure Storage, Inc. Hyperscale artificial intelligence and machine learning infrastructure
US11861423B1 (en) 2017-10-19 2024-01-02 Pure Storage, Inc. Accelerating artificial intelligence (‘AI’) workflows
US10360214B2 (en) 2017-10-19 2019-07-23 Pure Storage, Inc. Ensuring reproducibility in an artificial intelligence infrastructure
US10467107B1 (en) 2017-11-01 2019-11-05 Pure Storage, Inc. Maintaining metadata resiliency among storage device failures
US10671494B1 (en) 2017-11-01 2020-06-02 Pure Storage, Inc. Consistent selection of replicated datasets during storage system recovery
US10509581B1 (en) 2017-11-01 2019-12-17 Pure Storage, Inc. Maintaining write consistency in a multi-threaded storage system
US10484174B1 (en) 2017-11-01 2019-11-19 Pure Storage, Inc. Protecting an encryption key for data stored in a storage system that includes a plurality of storage devices
US10817392B1 (en) 2017-11-01 2020-10-27 Pure Storage, Inc. Ensuring resiliency to storage device failures in a storage system that includes a plurality of storage devices
US10929226B1 (en) 2017-11-21 2021-02-23 Pure Storage, Inc. Providing for increased flexibility for large scale parity
US10936238B2 (en) 2017-11-28 2021-03-02 Pure Storage, Inc. Hybrid data tiering
US10990282B1 (en) 2017-11-28 2021-04-27 Pure Storage, Inc. Hybrid data tiering with cloud storage
US10795598B1 (en) 2017-12-07 2020-10-06 Pure Storage, Inc. Volume migration for storage systems synchronously replicating a dataset
US11177961B2 (en) * 2017-12-07 2021-11-16 Nec Corporation Method and system for securely sharing validation information using blockchain technology
US11036677B1 (en) 2017-12-14 2021-06-15 Pure Storage, Inc. Replicated data integrity
US10929031B2 (en) 2017-12-21 2021-02-23 Pure Storage, Inc. Maximizing data reduction in a partially encrypted volume
US10866963B2 (en) 2017-12-28 2020-12-15 Dropbox, Inc. File system authentication
US10992533B1 (en) 2018-01-30 2021-04-27 Pure Storage, Inc. Policy based path management
US10521151B1 (en) 2018-03-05 2019-12-31 Pure Storage, Inc. Determining effective space utilization in a storage system
US11861170B2 (en) 2018-03-05 2024-01-02 Pure Storage, Inc. Sizing resources for a replication target
US10942650B1 (en) 2018-03-05 2021-03-09 Pure Storage, Inc. Reporting capacity utilization in a storage system
US11150834B1 (en) 2018-03-05 2021-10-19 Pure Storage, Inc. Determining storage consumption in a storage system
US10296258B1 (en) 2018-03-09 2019-05-21 Pure Storage, Inc. Offloading data storage to a decentralized storage network
US11863572B1 (en) * 2018-03-14 2024-01-02 Amazon Technologies, Inc. Adaptive data filtering system
US11048590B1 (en) 2018-03-15 2021-06-29 Pure Storage, Inc. Data consistency during recovery in a cloud-based storage system
US10924548B1 (en) 2018-03-15 2021-02-16 Pure Storage, Inc. Symmetric storage using a cloud-based storage system
US11210009B1 (en) 2018-03-15 2021-12-28 Pure Storage, Inc. Staging data in a cloud-based storage system
US11288138B1 (en) 2018-03-15 2022-03-29 Pure Storage, Inc. Recovery from a system fault in a cloud-based storage system
US10917471B1 (en) 2018-03-15 2021-02-09 Pure Storage, Inc. Active membership in a cloud-based storage system
US11095706B1 (en) 2018-03-21 2021-08-17 Pure Storage, Inc. Secure cloud-based storage system management
US11171950B1 (en) 2018-03-21 2021-11-09 Pure Storage, Inc. Secure cloud-based storage system management
US10838833B1 (en) 2018-03-26 2020-11-17 Pure Storage, Inc. Providing for high availability in a data analytics pipeline without replicas
US11436344B1 (en) 2018-04-24 2022-09-06 Pure Storage, Inc. Secure encryption in deduplication cluster
US11392553B1 (en) 2018-04-24 2022-07-19 Pure Storage, Inc. Remote data management
US11455409B2 (en) 2018-05-21 2022-09-27 Pure Storage, Inc. Storage layer data obfuscation
US11675503B1 (en) 2018-05-21 2023-06-13 Pure Storage, Inc. Role-based data access
US20190354628A1 (en) 2018-05-21 2019-11-21 Pure Storage, Inc. Asynchronous replication of synchronously replicated data
US10871922B2 (en) 2018-05-22 2020-12-22 Pure Storage, Inc. Integrated storage management between storage systems and container orchestrators
EP3579241A1 (en) * 2018-06-08 2019-12-11 Siemens Healthcare GmbH Method of managing medical records
US11042661B2 (en) * 2018-06-08 2021-06-22 Weka.IO Ltd. Encryption for a distributed filesystem
US11403000B1 (en) 2018-07-20 2022-08-02 Pure Storage, Inc. Resiliency in a cloud-based storage system
US11416298B1 (en) 2018-07-20 2022-08-16 Pure Storage, Inc. Providing application-specific storage by a storage system
US11632360B1 (en) 2018-07-24 2023-04-18 Pure Storage, Inc. Remote access to a storage device
US11146564B1 (en) 2018-07-24 2021-10-12 Pure Storage, Inc. Login authentication in a cloud storage platform
US11860820B1 (en) 2018-09-11 2024-01-02 Pure Storage, Inc. Processing data through a storage system in a data pipeline
US10671302B1 (en) 2018-10-26 2020-06-02 Pure Storage, Inc. Applying a rate limit across a plurality of storage systems
US11023179B2 (en) 2018-11-18 2021-06-01 Pure Storage, Inc. Cloud-based storage system storage management
US10963189B1 (en) 2018-11-18 2021-03-30 Pure Storage, Inc. Coalescing write operations in a cloud-based storage system
US11340837B1 (en) 2018-11-18 2022-05-24 Pure Storage, Inc. Storage system management via a remote console
US11526405B1 (en) 2018-11-18 2022-12-13 Pure Storage, Inc. Cloud-based disaster recovery
US11128460B2 (en) 2018-12-04 2021-09-21 EMC IP Holding Company LLC Client-side encryption supporting deduplication across single or multiple tenants in a storage system
US11650749B1 (en) 2018-12-17 2023-05-16 Pure Storage, Inc. Controlling access to sensitive data in a shared dataset
US11003369B1 (en) 2019-01-14 2021-05-11 Pure Storage, Inc. Performing a tune-up procedure on a storage device during a boot process
US11693591B2 (en) * 2019-02-28 2023-07-04 Zebware Ab Multi cloud data framework for secure data access and portability
US11042452B1 (en) 2019-03-20 2021-06-22 Pure Storage, Inc. Storage system data recovery using data recovery as a service
US11221778B1 (en) 2019-04-02 2022-01-11 Pure Storage, Inc. Preparing data for deduplication
US11068162B1 (en) 2019-04-09 2021-07-20 Pure Storage, Inc. Storage management in a cloud data store
CN110032840B (en) * 2019-04-16 2022-12-02 广东欧谱曼迪科技有限公司 Method for controlling access authority of medical apparatus of external storage device
WO2020220119A1 (en) * 2019-05-02 2020-11-05 Iisaac Inc. System and method for user-controllable cloud-based data sharing
US11327676B1 (en) 2019-07-18 2022-05-10 Pure Storage, Inc. Predictive data streaming in a virtual storage system
US11126364B2 (en) 2019-07-18 2021-09-21 Pure Storage, Inc. Virtual storage system architecture
US11392555B2 (en) 2019-05-15 2022-07-19 Pure Storage, Inc. Cloud-based file services
US11853266B2 (en) 2019-05-15 2023-12-26 Pure Storage, Inc. Providing a file system in a cloud environment
US11526408B2 (en) 2019-07-18 2022-12-13 Pure Storage, Inc. Data recovery in a virtual storage system
US11487715B1 (en) 2019-07-18 2022-11-01 Pure Storage, Inc. Resiliency in a cloud-based storage system
US11797197B1 (en) 2019-07-18 2023-10-24 Pure Storage, Inc. Dynamic scaling of a virtual storage system
US11861221B1 (en) 2019-07-18 2024-01-02 Pure Storage, Inc. Providing scalable and reliable container-based storage services
US11093139B1 (en) 2019-07-18 2021-08-17 Pure Storage, Inc. Durably storing data within a virtual storage system
US11086553B1 (en) 2019-08-28 2021-08-10 Pure Storage, Inc. Tiering duplicated objects in a cloud-based object store
US11693713B1 (en) 2019-09-04 2023-07-04 Pure Storage, Inc. Self-tuning clusters for resilient microservices
US11797569B2 (en) 2019-09-13 2023-10-24 Pure Storage, Inc. Configurable data replication
US11360689B1 (en) 2019-09-13 2022-06-14 Pure Storage, Inc. Cloning a tracking copy of replica data
US11573864B1 (en) 2019-09-16 2023-02-07 Pure Storage, Inc. Automating database management in a storage system
US11669386B1 (en) 2019-10-08 2023-06-06 Pure Storage, Inc. Managing an application's resource stack
US10628244B1 (en) 2019-10-29 2020-04-21 Snowflake Inc. Calling external functions from a data warehouse
US10715524B1 (en) * 2019-11-14 2020-07-14 Snowflake Inc. External credential-less stages for data warehouse integrations
US11930112B1 (en) 2019-12-06 2024-03-12 Pure Storage, Inc. Multi-path end-to-end encryption in a storage system
US11019033B1 (en) 2019-12-27 2021-05-25 EMC IP Holding Company LLC Trust domain secure enclaves in cloud infrastructure
US11720497B1 (en) 2020-01-13 2023-08-08 Pure Storage, Inc. Inferred nonsequential prefetch based on data access patterns
US11733901B1 (en) 2020-01-13 2023-08-22 Pure Storage, Inc. Providing persistent storage to transient cloud computing services
US11709636B1 (en) 2020-01-13 2023-07-25 Pure Storage, Inc. Non-sequential readahead for deep learning training
US11868622B2 (en) 2020-02-25 2024-01-09 Pure Storage, Inc. Application recovery across storage systems
US11637896B1 (en) 2020-02-25 2023-04-25 Pure Storage, Inc. Migrating applications to a cloud-computing environment
US11321006B1 (en) 2020-03-25 2022-05-03 Pure Storage, Inc. Data loss prevention during transitions from a replication source
US11301152B1 (en) 2020-04-06 2022-04-12 Pure Storage, Inc. Intelligently moving data between storage systems
US11630598B1 (en) 2020-04-06 2023-04-18 Pure Storage, Inc. Scheduling data replication operations
US11494267B2 (en) 2020-04-14 2022-11-08 Pure Storage, Inc. Continuous value data redundancy
US11921670B1 (en) 2020-04-20 2024-03-05 Pure Storage, Inc. Multivariate data backup retention policies
US11431488B1 (en) 2020-06-08 2022-08-30 Pure Storage, Inc. Protecting local key generation using a remote key management service
US11349917B2 (en) 2020-07-23 2022-05-31 Pure Storage, Inc. Replication handling among distinct networks
US11442652B1 (en) 2020-07-23 2022-09-13 Pure Storage, Inc. Replication handling during storage system transportation
US11397545B1 (en) 2021-01-20 2022-07-26 Pure Storage, Inc. Emulating persistent reservations in a cloud-based storage system
US11853285B1 (en) 2021-01-22 2023-12-26 Pure Storage, Inc. Blockchain logging of volume-level events in a storage system
US11138192B1 (en) 2021-04-30 2021-10-05 Snowflake Inc. Invoking external table functions from a database system
US20220365827A1 (en) 2021-05-12 2022-11-17 Pure Storage, Inc. Rebalancing In A Fleet Of Storage Systems Using Data Science
US11816129B2 (en) 2021-06-22 2023-11-14 Pure Storage, Inc. Generating datasets using approximate baselines
AU2022308058A1 (en) * 2021-07-08 2024-01-25 Ric B Richardson System and method for secure storage using offline public keys
US11914877B2 (en) * 2021-10-28 2024-02-27 Red Hat, Inc. Managing access to block storage in cloud computing environments
US11893263B2 (en) 2021-10-29 2024-02-06 Pure Storage, Inc. Coordinated checkpoints among storage systems implementing checkpoint-based replication
US11914867B2 (en) 2021-10-29 2024-02-27 Pure Storage, Inc. Coordinated snapshots among storage systems implementing a promotion/demotion model
US11714723B2 (en) 2021-10-29 2023-08-01 Pure Storage, Inc. Coordinated snapshots for data stored across distinct storage environments
US11922052B2 (en) 2021-12-15 2024-03-05 Pure Storage, Inc. Managing links between storage objects
US11847071B2 (en) 2021-12-30 2023-12-19 Pure Storage, Inc. Enabling communication between a single-port device and multiple storage system controllers
US11860780B2 (en) 2022-01-28 2024-01-02 Pure Storage, Inc. Storage cache management
US11886295B2 (en) 2022-01-31 2024-01-30 Pure Storage, Inc. Intra-block error correction
CN114567483B (en) * 2022-02-28 2024-03-29 天翼安全科技有限公司 Data transmission method and device and electronic equipment
US11907229B2 (en) * 2022-03-31 2024-02-20 Gm Cruise Holdings Llc System and method for platform-independent access bindings

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6876984B2 (en) * 2001-05-31 2005-04-05 Contentguard Holdings, Inc. Method and apparatus for establishing usage rights for digital content to be created in the future
US7716180B2 (en) 2005-12-29 2010-05-11 Amazon Technologies, Inc. Distributed storage system with web services client interface
US7926087B1 (en) 2007-11-30 2011-04-12 Netapp, Inc. Centralizing access request authorizations for storage systems
US20130132232A1 (en) * 2009-04-22 2013-05-23 Florian Pestoni System And Method For Digital Rights Management With Delegated Authorization For Content Access
US20100333116A1 (en) * 2009-06-30 2010-12-30 Anand Prahlad Cloud gateway system for managing data storage to cloud storage sites
US8176283B1 (en) 2011-09-26 2012-05-08 Google Inc. Permissions of objects in hosted storage
US8959574B2 (en) * 2012-06-21 2015-02-17 Google Technology Holdings LLC Content rights protection with arbitrary correlation of second content

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None

Also Published As

Publication number Publication date
US20140143543A1 (en) 2014-05-22
US9209973B2 (en) 2015-12-08
WO2014081698A3 (en) 2014-09-04

Similar Documents

Publication Publication Date Title
US9209973B2 (en) Delegate authorization in cloud-based storage system
US20210200723A1 (en) Accessing objects in hosted storage
US8924674B2 (en) Permissions of objects in hosted storage
US8601600B1 (en) Storing encrypted objects
US10055561B2 (en) Identity risk score generation and implementation
US9154502B2 (en) Accessing objects in hosted storage
US7913309B2 (en) Information rights management
US9002790B2 (en) Hosted storage locking
US10666647B2 (en) Access to data stored in a cloud
US20100095118A1 (en) Cryptographic key management system facilitating secure access of data portions to corresponding groups of users
US10740478B2 (en) Performing an operation on a data storage
US8396969B1 (en) Domain name buckets in a hosted storage system
US9317523B2 (en) Composing objects in hosted storage
WO2024028856A1 (en) A hardware secure enclave and blockchain based system and method for securing and monetising access to data.

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13796230

Country of ref document: EP

Kind code of ref document: A2

122 Ep: pct application non-entry in european phase

Ref document number: 13796230

Country of ref document: EP

Kind code of ref document: A2