Real-World Cloud Computing
Six Characteristics of Best-in-Class Object Storage
Six “must haves” that are required to create best-in-class object storage solutions and why they matter to you
By: Paul Carpentier
Nov. 25, 2013 07:00 AM
The adoption of cloud storage technology for a broad range of consumer and business applications is transforming the storage landscape by transitioning away from traditional disk arrays to object-based storage systems that have the scalability, availability, resiliency and accessibility to enable cloud-scale storage and instant access.
A recent IDC report predicts that the market for File- and Object-Based Storage (FOBS) will experience an annual growth rate of 24.5% through 2017, reaching $38 billion. "Increased versatility will result in more diverse use cases for FOBS," said IDC.
Software based, object storage is not saddled with the cost, complexity and vendor lock-in of legacy storage arrays or the scalability limitations of traditional file system storage. But all object storage systems are not created equal. Here are six "must haves" that are required to create best-in-class object storage solutions.
1. Granular, Automated Scalability:
Why this matters to you: Granular scalability lets you scale as you grow and eliminates the need to over purchase hardware because of the technical limitations of the storage solution.
2. No Single Point of Failure:
Why this matters to you: When you hear management node, controller node, or database this means more management and the addition of single points of failure that can critically impact performance, stability and fault tolerance. In highly available object storage solutions all nodes do the same thing so that if one fails, the others can immediately remedy the issue. This also eliminates the need for specialized hardware that needs to be physically shipped if an issue is discovered.
3. Flexible Data Protection on a Per-Object Basis:
Why this matters to you: One size fits all just does not work in real life. Different use cases require different combinations of replication and erasure coding. Object solutions that constrain the transition from one protection scheme to the other or lock the protection scheme to specific hardware ultimately hinder growth and your ability to optimize resources. Support for both protection schemes on the same server means you can optimize for access, data protection and resource utilization system wide - without constraint.
4. Support for Large and Small Files:
Why this matters to you: This is primarily about performance from an access perspective. The variation in file sizes will continue. While compression algorithms get more efficient in making files smaller, technological advancements will continue to add to the complexity and depth of some file types resulting in larger files. An object storage solution that ensures rapid access and efficient storage, regardless of file size or object count will increase the number of use cases reducing the number of point solutions you need to purchase.
5. Continuous Integrity Checks and Fast Volume Recovery:
Why this matters to you: Content you store should always be available. Some object solutions only check data integrity on reads - the worst time to ensure data integrity. Others rely on specialized nodes to identify and repair issues that limit scale.
6. Instant Content Lookup and Retrieval:
Why this matters to you: As the amount of content grows from millions to billions of objects and management resources change (hardware migration and employee turnover) efficient content lookup and retrieval becomes a challenge. Some object solutions store metadata in a database, which introduces an additional layer of complexity between content requests and content delivery - a textbook bottleneck. Databases also become unwieldy with size and require investment in specialized management resources. By storing metadata with the object, content is self-contained and security, authentication and all identifying information is always available regardless of application, employee turnover, technological obsolescence or even time.
Reader Feedback: Page 1 of 1
Latest Cloud Developer Stories
Subscribe to the World's Most Powerful Newsletters
Subscribe to Our Rss Feeds & Get Your SYS-CON News Live!
SYS-CON Featured Whitepapers
Most Read This Week