EP2186015A4 - De-duplication in virtualized server and virtualized storage environments - Google Patents

De-duplication in virtualized server and virtualized storage environments

Info

Publication number
EP2186015A4
EP2186015A4 EP20080829858 EP08829858A EP2186015A4 EP 2186015 A4 EP2186015 A4 EP 2186015A4 EP 20080829858 EP20080829858 EP 20080829858 EP 08829858 A EP08829858 A EP 08829858A EP 2186015 A4 EP2186015 A4 EP 2186015A4
Authority
EP
European Patent Office
Prior art keywords
virtualized
duplication
storage environments
server
virtualized storage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP20080829858
Other languages
German (de)
French (fr)
Other versions
EP2186015A2 (en
Inventor
Jedidiah Yueh
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
EMC Corp
Original Assignee
EMC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US11/864,583 external-priority patent/US8209506B2/en
Priority claimed from US11/864,756 external-priority patent/US8880797B2/en
Application filed by EMC Corp filed Critical EMC Corp
Publication of EP2186015A2 publication Critical patent/EP2186015A2/en
Publication of EP2186015A4 publication Critical patent/EP2186015A4/en
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0608Saving storage space on storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/174Redundancy elimination performed by the file system
    • G06F16/1748De-duplication implemented within the file system, e.g. based on file segments
    • G06F16/1752De-duplication implemented within the file system, e.g. based on file segments based on file chunks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638Organizing or formatting or addressing of data
    • G06F3/064Management of blocks
    • G06F3/0641De-duplication techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
EP20080829858 2007-09-05 2008-09-05 De-duplication in virtualized server and virtualized storage environments Ceased EP2186015A4 (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US97018107P 2007-09-05 2007-09-05
US97018707P 2007-09-05 2007-09-05
US11/864,583 US8209506B2 (en) 2007-09-05 2007-09-28 De-duplication in a virtualized storage environment
US11/864,756 US8880797B2 (en) 2007-09-05 2007-09-28 De-duplication in a virtualized server environment
PCT/US2008/075467 WO2009033074A2 (en) 2007-09-05 2008-09-05 De-duplication in virtualized server and virtualized storage environments

Publications (2)

Publication Number Publication Date
EP2186015A2 EP2186015A2 (en) 2010-05-19
EP2186015A4 true EP2186015A4 (en) 2015-04-29

Family

ID=40429720

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20080829858 Ceased EP2186015A4 (en) 2007-09-05 2008-09-05 De-duplication in virtualized server and virtualized storage environments

Country Status (3)

Country Link
EP (1) EP2186015A4 (en)
CN (2) CN102880626B (en)
WO (1) WO2009033074A2 (en)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8209506B2 (en) 2007-09-05 2012-06-26 Emc Corporation De-duplication in a virtualized storage environment
US8380681B2 (en) * 2010-12-16 2013-02-19 Microsoft Corporation Extensible pipeline for data deduplication
CN103547991B (en) * 2010-12-29 2017-05-17 亚马逊科技公司 Receiver-side data deduplication in data systems
CN102223409B (en) * 2011-06-13 2013-08-21 浪潮(北京)电子信息产业有限公司 Network storage resource application system and method
CN102221982B (en) * 2011-06-13 2013-09-11 北京卓微天成科技咨询有限公司 Method and system for implementing deletion of repeated data on block-level virtual storage equipment
US8468138B1 (en) 2011-12-02 2013-06-18 International Business Machines Corporation Managing redundant immutable files using deduplication in storage clouds
US9235589B2 (en) * 2011-12-13 2016-01-12 International Business Machines Corporation Optimizing storage allocation in a virtual desktop environment
US9417811B2 (en) 2012-03-07 2016-08-16 International Business Machines Corporation Efficient inline data de-duplication on a storage system
US8923195B2 (en) * 2012-03-20 2014-12-30 Futurewei Technologies, Inc. Method and apparatus for efficient content delivery in radio access networks
US9886352B2 (en) 2012-04-27 2018-02-06 University Of British Columbia De-duplicated virtual machine image transfer
WO2014068617A1 (en) * 2012-10-31 2014-05-08 Hitachi, Ltd. Storage apparatus and method for controlling storage apparatus
GB2510185A (en) 2013-01-29 2014-07-30 Ibm Data de-duplication between emulated disk sub-systems
US9729659B2 (en) * 2013-03-14 2017-08-08 Microsoft Technology Licensing, Llc Caching content addressable data chunks for storage virtualization
US10592347B2 (en) * 2013-05-16 2020-03-17 Hewlett Packard Enterprise Development Lp Selecting a store for deduplicated data
US10496490B2 (en) 2013-05-16 2019-12-03 Hewlett Packard Enterprise Development Lp Selecting a store for deduplicated data
CN103559282B (en) * 2013-11-07 2018-02-23 北京国双科技有限公司 The De-weight method and device of real-time system data
WO2015150976A1 (en) 2014-04-03 2015-10-08 Strato Scale Ltd. Cluster-wide memory management using similarity-preserving signatures
US20150286414A1 (en) * 2014-04-03 2015-10-08 Strato Scale Ltd. Scanning memory for de-duplication using rdma
CN103942292A (en) * 2014-04-11 2014-07-23 华为技术有限公司 Virtual machine mirror image document processing method, device and system
WO2016003454A1 (en) 2014-07-02 2016-01-07 Hewlett-Packard Development Company, L.P. Managing port connections
CN104133888B (en) * 2014-07-30 2019-08-02 宇龙计算机通信科技(深圳)有限公司 A kind of multisystem data processing method, device and terminal
WO2016036378A1 (en) * 2014-09-05 2016-03-10 Hewlett Packard Enterprise Development Lp Data storage over fibre channel
JP6254293B2 (en) * 2014-09-15 2017-12-27 華為技術有限公司Huawei Technologies Co.,Ltd. Data deduplication method and storage array
US9390028B2 (en) 2014-10-19 2016-07-12 Strato Scale Ltd. Coordination between memory-saving mechanisms in computers that run virtual machines
US9912748B2 (en) 2015-01-12 2018-03-06 Strato Scale Ltd. Synchronization of snapshots in a distributed storage system
EP3126987A4 (en) 2015-02-26 2017-11-22 Strato Scale Ltd. Using access-frequency hierarchy for selection of eviction destination
CN107515723B (en) * 2016-06-16 2020-04-24 伊姆西Ip控股有限责任公司 Method and system for managing memory in a storage system
CN107870922B (en) * 2016-09-23 2022-02-22 伊姆西Ip控股有限责任公司 Method, equipment and system for data deduplication
TWI663515B (en) * 2017-07-18 2019-06-21 先智雲端數據股份有限公司 Storage system of distributed deduplication for internet of things backup in data center and method for achieving the same
US11467775B2 (en) * 2019-10-15 2022-10-11 Hewlett Packard Enterprise Development Lp Virtual persistent volumes for containerized applications
CN111209229B (en) * 2019-12-30 2021-12-21 苏州艾利特机器人有限公司 Fieldbus method based on virtual equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6075938A (en) * 1997-06-10 2000-06-13 The Board Of Trustees Of The Leland Stanford Junior University Virtual machine monitors for scalable multiprocessors
US6374266B1 (en) * 1998-07-28 2002-04-16 Ralph Shnelvar Method and apparatus for storing information in a data processing system
US6389433B1 (en) * 1999-07-16 2002-05-14 Microsoft Corporation Method and system for automatically merging files into a single instance store
US6789156B1 (en) * 2001-05-22 2004-09-07 Vmware, Inc. Content-based, transparent sharing of memory units
US20070050423A1 (en) * 2005-08-30 2007-03-01 Scentric, Inc. Intelligent general duplicate management system

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7043614B2 (en) * 2002-07-11 2006-05-09 Veritas Operating Corporation Storage services and systems
CN1826805A (en) * 2003-07-24 2006-08-30 皇家飞利浦电子股份有限公司 Optimisation of stored video data
US20050081099A1 (en) * 2003-10-09 2005-04-14 International Business Machines Corporation Method and apparatus for ensuring valid journaled file system metadata during a backup operation
JP4402565B2 (en) * 2004-10-28 2010-01-20 富士通株式会社 Virtual storage management program, method and apparatus
JP2006134208A (en) * 2004-11-09 2006-05-25 Fujitsu Ltd Storage virtualization device
US7694298B2 (en) * 2004-12-10 2010-04-06 Intel Corporation Method and apparatus for providing virtual server blades

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6075938A (en) * 1997-06-10 2000-06-13 The Board Of Trustees Of The Leland Stanford Junior University Virtual machine monitors for scalable multiprocessors
US6374266B1 (en) * 1998-07-28 2002-04-16 Ralph Shnelvar Method and apparatus for storing information in a data processing system
US6389433B1 (en) * 1999-07-16 2002-05-14 Microsoft Corporation Method and system for automatically merging files into a single instance store
US6789156B1 (en) * 2001-05-22 2004-09-07 Vmware, Inc. Content-based, transparent sharing of memory units
US20070050423A1 (en) * 2005-08-30 2007-03-01 Scentric, Inc. Intelligent general duplicate management system

Also Published As

Publication number Publication date
CN102880626B (en) 2016-02-10
WO2009033074A2 (en) 2009-03-12
EP2186015A2 (en) 2010-05-19
CN101809559B (en) 2013-10-16
CN102880626A (en) 2013-01-16
WO2009033074A3 (en) 2009-05-14
CN101809559A (en) 2010-08-18

Similar Documents

Publication Publication Date Title
EP2186015A4 (en) De-duplication in virtualized server and virtualized storage environments
EP2217114A4 (en) Storage and organization system
EP2013974A4 (en) Data compression and storage techniques
EP2652625A4 (en) Data deduplication in a virtualization environment
EP2548122A4 (en) Highly scalable and distributed data de-duplication
EP2480974A4 (en) Distributed content storage and retrieval
IL201411A0 (en) User equipment capability handling in long - term evolution systems
EP2504755A4 (en) Data de-duplication in a dispersed storage network utilizing data characterization
PL2611849T3 (en) Elastomeric insulation materials and the use thereof in subsea applications
ZA201103573B (en) Card reading shoe with card stop feature and systems utilizing the same
GB201303047D0 (en) Sequential access storage and data de-duplication
EP2179599A4 (en) Methods and systems for use in customizing displayed content associated with a portable storage medium
EP2340491A4 (en) Direct-attached/network-attached storage device
EP2281268A4 (en) Composite assets for use in multiple simulation environments
EP2084663A4 (en) Order fulfillment and content management systems and methods
EP2286343A4 (en) Resilient data storage in the presence of replication faults and rolling disasters
EP2286344A4 (en) Ranking and prioritizing point in time snapshots
GB201214631D0 (en) Retrieval and display or related content using text stream data feeds
EP2176752A4 (en) Order preservation in data parallel operations
EP2139677A4 (en) Improvements in nanocomposites and their surfaces
GB201019584D0 (en) Systems and methods for supoorting pre-boot log in
EP2375427A4 (en) Storage element and storage device
TWI366154B (en) Systems and methods for managing texture data in computer
EP2353104A4 (en) Modeling party identities in computer storage systems
EP2216721A4 (en) Data storage system and data storage program

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20100225

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA MK RS

RIN1 Information on inventor provided before grant (corrected)

Inventor name: YUEH, JEDIDIAH

DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20150331

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/06 20060101ALI20150325BHEP

Ipc: G06F 17/30 20060101AFI20150325BHEP

Ipc: H04L 29/08 20060101ALI20150325BHEP

Ipc: G06F 9/455 20060101ALI20150325BHEP

17Q First examination report despatched

Effective date: 20180613

REG Reference to a national code

Ref country code: DE

Ref legal event code: R003

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20200716