Bick Group

David Linthicum

Subscribe to David Linthicum: eMailAlertsEmail Alerts
Get David Linthicum via: homepageHomepage mobileMobile rssRSS facebookFacebook twitterTwitter linkedinLinkedIn

Related Topics: Security Journal, SOA & WOA Magazine

SOA & WOA: Article

The Value of Inter-Domain Infrastructure Technology for SOA

Optimizing the value of SOA

In my recent predictions for 2009, I pointed out:  

"There will be a larger focus on inter-domain SOA technology, or highly scalable and secure middleware technology that will provide scalable service and information access between the instances of SOAs within the enterprise, and perhaps intercompany as well. The fact is that much of the SOA solutions out there can't scale much past a single problem domain, thus this technology will become key to the strategic success of SOA."

As SOA moves from the project level to the enterprise, SOA architects and practitioners quickly realize the need to consider common services and data management issues. Today we seek the right approaches and the proper enabling technology and standards to provide our enterprises with a common scalable and secure mechanism that ensures all instances of SOAs within the enterprise have the technology-independent infrastructure they need in support of the business. In essence, the architects need the freedom to select whatever best-of-breed technology is right for their project requirements and still be able to depend upon common service and information management infrastructure that is technology and vendor-agnostic. 

Enterprise Service Buses, or ESBs, held the initial promise to provide core information integration and services sharing for the enterprise. This did, indeed, work at the micro-domain, or project levels. However, the use of ESBs to address the larger issues around core and common enterprise-side SOA infrastructure quickly proved to be technology that was unfit for the purpose when working within the micro-domains. While ESBs are great at core integration and service sharing efforts within sub-domains, they need a more specialized and highly scalable infrastructure to drive SOA at enterprise, or macro-domain levels. 

The fact is that an inter-domain technology is required to address the core issues with service and information sharing that needs to occur in and between SOA problem domains, this according to a recent report released by Forrester. Moreover, Joseph Natoli of Intel, in his recent blog post, highlighted the need for a "Right-Sized" SOA: "Key to this advice is making architecture and technology decisions which are purpose fit and ‘right sized' to the key business problems of connecting SOA across the enterprise..."   Indeed, this technology is strategic in nature, and becomes the most important link within the enterprise, thus it must support features and functions that live up to the expectations of business.

The best way to look at the value of this technology is to understand the return on investment (ROI) that may be gained by using this approach and technology. What are the core benefits to the business, or, more important, what is the cost incurred by the business if this technology is not leveraged? It's an interesting journey to the business realities. 

Approaching ROI
The most practical approach is to look at the cost of moving forward with the existing approaches and technology solutions. Once that's understood, it's then helpful to look at the impact of leveraging the inter-domain SOA technology, and determine the impact on the effectiveness of the architecture, and thus the impact on the business. It should be noted that all enterprises and domains are different, and you'll have to adjust your approach and data points accordingly. 

Since this is a very complex issue with many different variables that are dependent upon the specific issues of the enterprise or problem domain, it's helpful to use a more simplistic but valid approach to calculating the ROI of leveraging this technology.

To that end we need to estimate a few key pieces of data:

  • Architectural inefficiencies of the "As Is" approach and technology solution in terms of impactful dollars, or cost, per year on the business.
  • Architectural efficiencies as the "To Be" approach and technology solution in terms of impactful dollars, or value, per year on the business, minus the cost of the "To Be" or inter-domain SOA technology. 
  • Degree of complexity, which is typically (but not always) based on the number of services and database attributes under management. 
  • Degree of reuse, which is based upon the number of services reused within and outside of the micro-domain, or single SOA instance. 
  • Soft issues such as the ability for the new approach and technology to bring efficiencies to the IT solutions that increase customer satisfaction, employee morale, business intelligence, or other things that are not as easy to define as hard numbers. 

The Cost of "As Is"
Those who approach SOA today have a tendency to approach a strategic architectural problem using tactical approaches and technology. The end result is an instance of an efficient architecture that lacks holistic value for the enterprise. In essence, the better these problem domains can share information and services, the more value they bring to the business. That's core to our analysis here.

This is not to say that an enterprise-wide SOA is not built by many projects, or that it does not address many problem domains, only that the end goal is to create something that has a common value to the enterprise, and thus the business. 

This architecture in the narrow micro-architecture or micro-domain level SOAs typically has the following attributes:

  • Lack of security.
  • Lack of scalable access to common services.
  • Lack of scalable access to common data.
  • Lack of a common technological approach.
  • Lack of proven scalability.
  • Lack of a common SOA governance strategy.

The fact is that a mere instance of a SOA has a tendency to solve specific tactical problems, and not address the architecture issues of the enterprise. These narrow domains are a great start, but must be combined to form an enterprise-wide solution that addresses the requirements of the business, not just a department or a particular set of business processes.

Moreover, within these micro-domains, security is typically an afterthought, or is implemented only within a particular stovepipe. The lack of a common security strategy around core services and core data can leave the enterprise vulnerable. Thus, a common security infrastructure needs to be a high priority, a security strategy that spans the enterprise. 

In addition to security, there needs to be a common approach to dealing with services and information, typically abstracted from existing information systems such as ERPs, core databases, business intelligence, or core enterprise system APIs. 

While the number and types of interfaces are numerous, there needs to be a mediation layer between those interfaces, no matter how primitive, one that governs how the services and information should be addressed logically within the architecture. In other words, the mediation layer should take highly normalized and unstructured information and bind that information to new abstract schemas that make much more logical sense to the business systems that leverage them, such as a single representation of customer data, order information, or a product.

While providing this common infrastructure has clear advantages, all of this is for naught if the infrastructure won't provide the required scalability. While there may be four systems accessing the same service within a single SOA micro-domain, if that service is accessed by all 150 enterprise systems simultaneously, scalability and reliability becomes more of a concern, and something that more tactical technology is not set up to handle. Indeed, the use of SOA provides a higher degree of reuse and agility, but the sharing of services has to meet Service Level Agreements (SLAs) of the consumers. 

Finally, you need to consider SOA governance in the mix. While leveraging traditional runtime and design-time SOA governance technology is fine for smaller domains, enterprise-wide SOA governance must manage both policies and services at a high transaction level, and not become the bottleneck. 

Understanding these limitations, you need to assign a specific dollar amount, per year, that each of the issues addressed above is costing the business. For example, within a particular enterprise, the cost of the inefficiencies are as shown in Table 1.

Again, these costs are determined through analysis of each issue and compared with the current state of the architecture, also considering if the architecture was "perfectly optimized" and thus each issue eliminated. In other words, how bad are things now versus how good they could be, and what is this costing us? Or, the analysis of the existing architecture and technology solutions, at the micro-domain level, were they to expand to an enterprises level. 

The Value of "To Be"
Considering the point made in the previous section, we need to focus on how to create more holistic and enterprise-wide solutions that are more strategic. The questions are: What is the right approach? What is the right technology? How much money will this save us?

In starting out, you need to consider the core concepts of the approach. In essence you're looking at the architecture as layers. The micro layers deal with the business solution, or the ability to assemble services and information into processes or composite applications to address the company's business needs. Moving down, you have the micro-domain services, or those services that are only specific to a single domain, such as a logistics process built for the shipping department, a service from the mainframe, or perhaps a service externalized by a SaaS provider.

We have many instances of SOA that exist in many domains. They all have services under management, and most have services that have value for the entire enterprise, and thus should be shareable, in a secure and scalable way, within the enterprise. 

Therein is the essence of the approach, or placing these services into a layer of technology underneath these micro-domains that provides for scalable and secure access to both services and information by any number of consumers. In other words, a technology that functions like a network router, making sure that the services are available to those who need them, just like packets within a network. Thus we have an Enterprise Service Router, or ESR. ESRs make micro-domains, or strategic enterprise-wide SOA possible. 

The ESR would be the core layer of the architecture, providing a common services provisioning and execution platform of sorts that's able to meet the needs of all instances of SOA within the enterprise, or micro-domains, no matter what technology or standards were selected to solve the problem, or no matter what legacy technology exists. Basically, this is a common technology-agnostic approach that does not box the SOA architects into a specific set of technologies or standards, and provides a highly scalable and secure access and management component to common services and information. 

There are several advantages to this approach:

  • Cost savings through economies of scale, by leveraging a common services and data management infrastructure
  • Strategic advantage of agility, since the services may be mixed and matched in a highly scalable and secure way, as needed, to address the requirements of the business
  • The ability to leverage the technology you currently have in place, and not force the business into costly and risky application and data migrations
  • Strategic advantage of process and service re-use, a core value of SOA
  • Reduce complexity but provide a common services deployment and access mechanism that's the same throughout the enterprise
  • Ability to leverage existing assets, which does not require changes to existing systems and information

So, using a similar model as we defined earlier, we can express this value as shown in Table 2.

Of course, the value would change year-to-year, and other data points should be considered, but the general idea is the same. Thus, the idea is to understand the cost impact of the "As Is" when compared to an architecture that's approaching optimal ("To Be"), and that's the cost of doing nothing. Moreover, this is the impactful value of the "To Be" architecture, or the cost of implementing a solution that also approaches optimal. I'll bring all of this information together next, in a high-level business case. 

Creating Your Business Case for Inter-Domain SOA Technology
You'll find that the cost of the inefficiencies of "As Is" architecture is roughly the same as the value of the "To Be" architecture, leveraging a common inter-domain technology solution, such as an ESR. We determine the figures twice to understand the value of eliminating problems, and the value when those problems are eliminated. If they don't balance within 30 percent, perhaps you need to recheck your analysis, or the technology solution leveraged. Keep in mind that nothing is ever perfect, and you can approach optimization within enterprise architecture, and not achieve it. You just have to get as close as you can. 

In addition, you need to consider the other variables we discussed earlier, including degree of complexity, which becomes a multiplier of both cost and value. In essence, the more complex your architecture, the more cost it will incur if inefficient, and the more value it will bring if optimized. Typically, this is going to be .50 to 1.5, as complexity multipliers. 

As with complexity, you need to do the same with the degree of reuse, which is the number of services reused within and outside of the micro-domain. Look at this as a percentage, with a services reuse percentage of 15-15 present not uncommon. You would express this as a multiplier as well, typically .95 to 1.05 depending on the number of services reused. Some enterprises reuse very few services, some reuse a great deal. It depends on the needs of the business and the architecture. 

While the analytical issues, as we've already defined, may create a compelling business case unto themselves, the soft issues are typically where the real value is, albeit they are difficult to define. However, there is indeed a huge upside impact in providing a more effective and reactive IT architecture that's able to keep both the customers and the employees happy. The way that you approach this is very dependent upon the business you're in, but the value is huge.

The fact of the matter is that SOA has little value within a small department-level problem domain, or what we called a micro-domain in this article. Thus, in order to obtain the value of SOA, we need to put together a strategy to share both services and information enterprise-wide, or in the macro-domain. This is where your business case comes into play as an important first step.

The best way to approach this is to understand your own business drivers, and put a plan in place to address SOA at both the micro- and macro-domains, which means addressing each domain and the business issues in an incremental way. Moreover, you must also address the information and service sharing that needs to occur within and between the separate domains, and whatever technology that has been deployed there. The ESR should be scalable, secure, and reliable, and be standards and technology agnostic. Just as super highways connect towns, you must connect the various islands of information technology within the enterprise, and thus optimize the value of SOA. 


More Stories By David Linthicum

David Linthicum is the Chief Cloud Strategy Officer at Deloitte Consulting, and was just named the #1 cloud influencer via a recent major report by Apollo Research. He is a cloud computing thought leader, executive, consultant, author, and speaker. He has been a CTO five times for both public and private companies, and a CEO two times in the last 25 years.

Few individuals are true giants of cloud computing, but David's achievements, reputation, and stellar leadership has earned him a lofty position within the industry. It's not just that he is a top thought leader in the cloud computing universe, but he is often the visionary that the wider media invites to offer its readers, listeners and viewers a peek inside the technology that is reshaping businesses every day.

With more than 13 books on computing, more than 5,000 published articles, more than 500 conference presentations and numerous appearances on radio and TV programs, he has spent the last 20 years leading, showing, and teaching businesses how to use resources more productively and innovate constantly. He has expanded the vision of both startups and established corporations as to what is possible and achievable.

David is a Gigaom research analyst and writes prolifically for InfoWorld as a cloud computing blogger. He also is a contributor to “IEEE Cloud Computing,” Tech Target’s SearchCloud and SearchAWS, as well as is quoted in major business publications including Forbes, Business Week, The Wall Street Journal, and the LA Times. David has appeared on NPR several times as a computing industry commentator, and does a weekly podcast on cloud computing.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.