yourfanat wrote: I am using another tool for Oracle developers - dbForge Studio for Oracle. This IDE has lots of usefull features, among them: oracle designer, code competion and formatter, query builder, debugger, profiler, erxport/import, reports and many others. The latest version supports Oracle 12C. More information here.
Cloud Expo on Google News
Cloud Expo & Virtualization 2009 East
Smarter Business Solutions Through Dynamic Infrastructure
Smarter Insights: How the CIO Becomes a Hero Again
Windows Azure
Why VDI?
Maximizing the Business Value of Virtualization in Enterprise and Cloud Computing Environments
Messaging in the Cloud - Email, SMS and Voice
Freedom OSS
Stairway to the Cloud
Sun's Incubation Platform: Helping Startups Serve the Enterprise
Cloud Computing & Enterprise IT: Cost & Operational Benefits
How and Why is a Flexible IT Infrastructure the Key To the Future?
Click For 2008 West
Event Webcasts
Building the Next-Generation Datacenter - A Detailed Guide / Stage 3
Automation and orchestration

In parts one and two of this article, we provided an overview of the CA Technologies virtualization maturity life cycle, and focused on server consolidation and infrastructure optimization. IT organizations that have successfully consolidated and optimized their virtual infrastructures face a unique set of virtualization management challenges. Server provisioning that used to take weeks can now be achieved in minutes, and results in increased virtualization adoption within the business. This increased adoption results in 'VM sprawl' (the problem of uncontrolled workloads), increased provisioning and configuration errors, and the lack of a detailed audit trail - all of which significantly increase the risk of service downtime.

Organizations that try to tackle this problem with increased manpower will fail to get their hands around the problem. In addition, IT managers / CIOs don't want expensive IT staff to do mundane, repetitive tasks, but instead focus their time on important strategic initiatives. In this third part of the article, we focus on the automation and orchestration capabilities that are extremely essential to tackle VM sprawl, reduce provisioning errors, improve audit capabilities, and achieve the significant savings in OpEx promised by server virtualization.

Control VM Sprawl
Organizations face multiple challenges when trying to automate and orchestrate their virtual environments and obtain the reduction in OpEx achievable by server virtualization. These include:

  • Faster provisioning of standardized servers / applications into heterogeneous virtual and cloud environments
  • Process integration across heterogeneous platforms, applications and IT groups
  • Standardized configuration and compliance

The following section addresses the tasks and capabilities required to incorporate automation and orchestration capabilities within the virtual environment, thus helping control VM sprawl and reduce OpEx.

Project Plan
The following is a high-level plan for a sample project to automate application provisioning and build associated orchestrations. The timelines and tasks in Table 1 present a broad outline for a lab management project with approval orchestration, showback, and the ability to test composite applications spanning multiple VMs. Other sample projects could be an automated self-service reservation management system, production / staging environment management, demos on demand capability, educational labs, etc. The IT capabilities required for these projects are very similar, but the design and workflows required will be different. The 3-4 person implementation team suggested for the project is expected to be proficient in project management, virtualization design and deployment, and systems management.

Table 1: Automation & Orchestration project plan

A successful automation and orchestration project necessitates a structured approach that should consist of the following high-level tasks. Each task includes key objectives and possible challenges, articulates a successful outcome, and more.

System Design
A lab management system enables IT organizations to provide a Web-based self-service reservation system so that users can reserve and deploy customized server and virtual machine instances without administrator intervention. The system design begins with application/systems consultants interviewing IT administrators and users to better understand the business requirements and workflows. The requirements should be captured, analyzed, and refined over multiple interviews and/or white-boarding sessions, and result in the development of comprehensive workflows. A well-defined checklist should be used to identify important details such as:

  • Usage characteristics, roles and access entitlements of the various users
  • Operating system / other software needs and system maintenance requirements
  • Approval workflows, reporting needs, HA/DR requirements, etc.

The system design phase should result in the creation of a comprehensive project plan that clearly details the deliverables, defines timelines, contingency plans, etc. and is approved by all the key business and IT stakeholders.

Resource Pool Deployment
The lab management system will be required to serve several departments within the organization - each of which may have different availability requirements. Resource pools are a very easy and convenient way for IT administrators to manage departmental requirements. Setting up resource pools involves:

  • Defining resource pools to better manage and administer the system for different departments / organizations. Resource pool definitions should consider service level / Quality of Service (QoS) requirements of the applications supported by the resource pools, HA and BCDR requirements, etc.
  • Attaching appropriate compute, network and storage resources to the resource pool
  • Integrating with performance monitoring products to consume data on usage thresholds and perform dynamic balancing of the resource pools

Careful planning during resource pool design and deployment will significantly reduce manual administration requirements and help desk calls during regular operations.

VM Template and Lifecycle Management
Template-based provisioning capabilities are present in all automation products. This task involves creating VM templates, defining a default lifecycle for provisioning and de-provisioning VMs, etc. Careful consideration should be given to the following during this phase:

  • Software license requirements and integration with asset management products, if necessary
  • Integration with identity management products to import user and role information and providing a personalized experience to the users
  • Setting up template availability rules for different user roles, and orchestrating workflow, if necessary

A properly configured VM lifecycle significantly improves the user experience, reduces help desk calls, and helps control / arrest virtual sprawl.

Workflow Orchestration
Workflow orchestration goes hand in hand with the automation system, allowing organizations to design, deploy and administer the automation of manual, resource-intensive and often inconsistent IT operational procedures. For the lab management system discussed here, workflow orchestration will incorporate:

  • Design of essential workflows such as reservation / access approvals, system availability / change notifications, etc.
  • Integration with relevant enterprise systems such as email, identity management / LDAP, asset management, etc., to enable the workflow
  • Execution of the workflow while maintaining insight into the process, audit records, and other details for administration and compliance

A good orchestration engine will speed the delivery of IT services while helping to remove manual errors. Defining, automating and orchestrating processes across organizational silos that use disparate systems helps improve productivity while also enforcing standards.

Showback Configuration
Showback is essential to inform users about the cost of their system reservation and report on their usage. It's different from chargeback, which integrates with financial systems to provide a comprehensive bill to the business units requesting resources. Showback provides users with a comprehensive view of their costs depending on the reservation options, duration / time of reservation, etc. It also allows administrators to generate detailed usage reports by Lines of Business (LOB), geographical location, asset type, etc.

During the showback configuration task, reservation options should be evaluated and costs assigned to the different options and services offered in the lab management system. The system should either be orchestrated to get these details from other financial / asset management software or approximate values should be derived from previous metrics available within the IT organization.

Monitoring, Production Testing, and Final Deliverables
The monitoring and production testing for this project should include comprehensive QA testing and beta rollouts if possible. The final deliverable should document the system design, deployment, testing and orchestration details for knowledge transfer. It should include:

  • An architecture and design guide that will document client business requirements combined with best practices guidelines
  • An assembly, configuration and testing guide that will enable building the system in accordance to the abovementioned architecture and design guide

Formal user focused training customized to the architecture referenced above will facilitate knowledge transfer of final design and usage policies/procedures as well as level set knowledge base among the entire user group.

In Part 3, we focused on tackling problems such as 'VM sprawl' (the problem of uncontrolled workloads), increased provisioning and configuration errors, and the lack of a detailed audit trail - all of which significantly increase the risk of service downtime. In Part 4, the final part of this article, we will focus on building and maintaining a dynamic datacenter - an agile IT environment that is service oriented, scalable, and secure.

About Birendra Gosai
Birendra Gosai has a Masters degree in Computer Science and over ten years of experience in the enterprise software industry. He has worked extensively on data warehousing, network & systems management, and security management technologies. He currently works in the virtualization management business at CA Technologies. You can view his blogs at:, or follow him on Twitter @BirendraGosai.

In order to post a comment you need to be registered and logged in.

Register | Sign-in

Reader Feedback: Page 1 of 1

Latest Cloud Developer Stories
"Space Monkey by Vivent Smart Home is a product that is a distributed cloud-based edge storage network. Vivent Smart Home, our parent company, is a smart home provider that places a lot of hard drives across homes in North America," explained JT Olds, Director of Engineering, an...
Enterprises are striving to become digital businesses for differentiated innovation and customer-centricity. Traditionally, they focused on digitizing processes and paper workflow. To be a disruptor and compete against new players, they need to gain insight into business data and...
In this presentation, you will learn first hand what works and what doesn't while architecting and deploying OpenStack. Some of the topics will include:- best practices for creating repeatable deployments of OpenStack- multi-site considerations- how to customize OpenStack to inte...
DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI, Machine Learning and WebRTC to ...
Most DevOps journeys involve several phases of maturity. Research shows that the inflection point where organizations begin to see maximum value is when they implement tight integration deploying their code to their infrastructure. Success at this level is the last barrier to at-...
Subscribe to the World's Most Powerful Newsletters
Subscribe to Our Rss Feeds & Get Your SYS-CON News Live!
Click to Add our RSS Feeds to the Service of Your Choice:
Google Reader or Homepage Add to My Yahoo! Subscribe with Bloglines Subscribe in NewsGator Online
myFeedster Add to My AOL Subscribe in Rojo Add 'Hugg' to Newsburst from CNET Kinja Digest View Additional SYS-CON Feeds
Publish Your Article! Please send it to editorial(at)!

Advertise on this site! Contact advertising(at)! 201 802-3021

SYS-CON Featured Whitepapers