At this point, we begin the architectural assessment proper, to find out more about how “things work better when they work together” within architecture itself. We start with the “primary context” – the desired or actual context at the time-horizon we chose in the previous phase as the point to or from which we would construct our roadmap of “from here to there.” Usually we would do the “to-be” assessment first, but in some cases – and our example-project is one of them – it’s better to start with the “as-is.”
Select relevant architecture viewpoints that will enable us to demonstrate how the stakeholder concerns are addressed in the overall architecture.
Select the relevant tools and techniques to be used in association with the selected viewpoints.
Check the project purpose with the overall business strategy, business architecture, etc.
Develop baseline-architecture for primary context.
Select reference-models, views, viewpoints, and notational standards.
Create and update primary-context architecture models.
Review primary-context architecture against qualitative criteria.
Finalize building-blocks for the architectural scope.
Conduct checkpoint-review for stakeholders.
The reality, of course, is rarely as simple as that. In principle, those are the steps we need to follow; but in practice, it’s almost never the neat straight-line sequence shown in those idealized process-diagrams, but something more like a ball of wool after the kitten has chased it across the floor a few times. We use the term “iterative” more as a euphemism than anything else: “chaotic mess” might be a more accurate term, given how it often feels…
In the early stages especially, the one thing we’ll discover is that much, if not most, of what we’ve been told – or will be told – will turn out to be out-of-date, or incomplete, or just plain wrong. Seeming certainties often aren’t. Every stakeholder has their own views, which each usually turn out to be only one side of a much more complex story: as Edward de Bono once put it, “everyone is always right, but no-one is ever right.” And somehow, we have to make sense from all of this, and derive something out of it that others can use. But that is our task here: it’s our responsibility.
Don’t start from “solutions!” – focus instead on the problem-domain |
Much of the time, though, that injunction against solutions is not quite right. We do need a real usable solution at some point: the danger is about premature fixation on any putative solution, rather than all solutions as such. In practice, we’ll often need to create a temporary “solution” to give our stakeholders something to argue about and tell us that it’s wrong – which it probably is, at first. But that “wrongness” then gives something else to test, iterating toward a solution that does do what our stakeholders need.
Yet the point here is that during most of this iterative process, we’ll be “in the wrong” – and many of our stakeholders will be very quick to tell us so, too. Which is not pleasant – but that’s what the work demands. In fact there’s a very simple test here: if it doesn’t feel uncomfortable, we’re probably not doing the job properly. That’s something to think about while we’re working, anyway.
Main project: “To-Be” Assessment of Architecture
business-purpose: use architecture to enhance architecture practice sponsor (primary stakeholder): us breadth of coverage: architecture, plus anywhere architecture affects level of detail: anything we can usefully cover in the time available architecture domains: mainly architecture itself time-horizons: to-be as primary, as-is as comparison asset re-use: available architecture tools, techniques and methods |
how do we use architecture to assess the architecture of architecture? feels like spinning in circles – no traction, no place to start… |
The short answer is “follow the process”: do it by the book, but be ready to do something else at any time, as long as it seems to make sense within the sense of the whole, then return to the structure of the process once that moment of certainty is lost.
Step 1: Develop Baseline Architecture for “To-Be” Context
primary scope: mainly layers row-3 (“system”) to row-5 (“deploy”); capabilities to tackle all types of problems; implemented by people assets: information and links with people functions: how architecture skills and capabilities link into services locations: may be physical, virtual, and/or relational capabilities: architecture-capabilities and support-services events: relational “people-events,” others for real-time needs decisions: many different types at every different layer |
It’s quite probable that, as yet, we don’t have anything about architecture itself in the information-stores, because most people won’t think of architecture as a subject for architecture. But if we do have any, we note that information, and perhaps build a small set of views and reference-models if it seems useful. In any case, we’ll only need to do this once, as a known baseline to return to if we get lost during the various iterations of the assessment.
It’s a body of knowledge about structure, story, purpose, and value.
It’s used in decision-making throughout the enterprise.
It’s used to guide designs, of any type, that would contribute in practical and effective ways toward the aims of the organization and enterprise.
We’ll use that as an initial baseline.
Step 2: Select Reference-Models, Views, Viewpoints, and Notational Standards
Five-domain context-space mapping
Five systems-theory principles
Five-elements lifecycle
Four-dimension segment-model
That should give us enough to start with for now.
Step 3: Create and Update “To-Be” Architecture Models
Here we expand the baseline architecture into a comprehensive architecture for the iteration context – in other words, the architecture of architecture.
We won’t do this in much detail here – just enough to get started, because the real changes will occur as we apply it in practice over the coming days, weeks, months, and years. What we look for here are ideas or themes that would describe our “architecture of architecture,” and core requirements for that capability within the enterprise.
This aspect of assessment is mainly about sensemaking, and is also going to be iterative and somewhat chaotic – so, at the start, we deliberately allow it to be “chaotic,” a free flow of ideas, and then allow some kind of structure to emerge from there.
Initially there is only Reality, “the deep unknown,” before we’ve started any sensemaking.
We begin sensemaking in the Not-known to collect new information, iterating back-and-forth between there and Ambiguous to identify usable patterns.
We iterate between Ambiguous and Complicated to derive designs.
We simplify designs – especially for software, or anything for real-time – by iterating between Complicated and Simple.
But we never forget that the real world is actually Reality.
The outcome of this is that we need our practices to reflect where architecture sits within the overall functions of innovation and change: it’s clear that it must have a large element of sensemaking as a precursor to design.
Next, compare against the systems-theory principles.
First of these is rotation, which is clearly central to much of our work: we rotate between multiple views and viewpoints, or work our way through checklists. We will want to use this both in any architecture that we create, and in the processes of architecture itself. In terms of context-space mapping, it’s a Simple-domain technique: quick and easy, but with the risk that we have no certain means within the technique itself to assess whether the checklist is complete, or is the right one to use in that context. So while we will collect many different “rotations” for our architecture toolkit – another addition to our requirements-list – we would also need other techniques to select the appropriate ones for each context.
The architecture-development process is another “rotation,” in that it provides a step-by-step sequence to follow – though note that it, in effect, defines a default set of steps, rather than the sequence that we would actually follow in practice. So again, other techniques would be needed to decide when to deviate from the default path, and when to return to it.
The next systems-theory principles are reciprocation and resonance, which, in practice, act as a matched pair, mainly in the Complicated domain. These will form a much-valued part of the architectural assessment toolkit, particularly to model dependencies, feedback-loops, and delays to optimize balance and effectiveness across the enterprise. But they may not apply that much within architecture itself: it might be useful to model some of the loops and delays in the architecture process, but that’s probably all that we would do.
The final pair of systems-theory principles, recursion and reflexion, are fundamentally important to architecture itself – perhaps a key part of what distinguishes architecture from design. In terms of context-space mapping, they sit mainly in the Ambiguous domain, though also spread to other domains from there – for example, one of the key benefits of using recursion is that it can make designs a great deal simpler. The kind of architecture approach we’re using here is itself highly recursive, applying the same basic principles in every part and at every level of the context and enterprise, while the architectural notion of the unifying parti represents a highly desirable example of reflexion.
Architecture has its own Process activities, though it’s not much involved in those of others elsewhere in the enterprise; but there would need to be significant attention paid to “bottom-up” themes coming from the production contexts, and also to metrics and the like both for and from the Performance phase. Note too that this five-element lifecycle is also an important example of architectural recursion – the same elements repeat at every level and in every context.
Sally Bean: “The elusive enterprise architect” (skillsets for architects): - communicator and change-agent - visual system-thinker and modeler with foresight - fast learner - principled pragmatist - incisive consultant and troubleshooter - “big picture” thinker |
Architects also need to be consummate generalists, because they need to be able to link together every possible aspect of the enterprise, talk with anyone, and communicate meaningfully with the specialists in each area. (Soft-skills and EQ will often be even more important here than hard-skills and IQ.) The architects will usually need knowledge in breadth rather than depth – the respective specialists will handle most of the latter, although most enterprise-architects will also come from a specialist domain themselves. But even though the architect’s depth of knowledge in any one skill may be quite low – sometimes just a basic understanding of key principles and technical terms – the sheer range of skills that need to be learned at the full enterprise-level scope may take literally decades to acquire: so despite the claims of some training-providers, true competency in architecture is not something that can be picked up in a simple one-week workshop!
On assets, we’ve already listed the tangible information used in architecture: items such as glossary and thesaurus, governance-records, risks and opportunities, requirements, and many, many models. But in some ways, what’s even more important is the intangible information (a composite of virtual and relational asset, in framework terms): all those conversations and workshops and whiteboard-sessions that are so central to stakeholder-engagement and architecture practice.
in essence architecture comes down to a single idea: things work better when they work together – role of architecture’s is to ensure that things work better together over all of the respective scope (in principle, scope for enterprise-architecture is entire enterprise) |
If the only available architecture capabilities and competences are in IT, then ‘enterprise-architecture’ will appear to be IT-specific, and so on. Yet, to extend our enterprise-architecture to the whole business and beyond, we don’t need to change the architecture functions as such: we just need to extend the available capabilities – the range of skills experiences included within the architecture.
Architecture locations may be physical, virtual, or relational, but the latter are by far the most important of these – as in the old adage that “it’s not what you know but who you know,” and how and where to find those people. In the same way, we’ll also need to know how and where to find the right information, the right decisions, and so on. But for architecture itself, we most need to know the decision-makers – which, in practice, comes down to real people, and hence the locations of those people.
The events for architecture itself, again, are mostly “people-events” – relational events. (There may also be a few time-based events such as regular scheduled reviews.) These connections may come in many forms – emails, task-requests, and many, many meetings – but the notion of an “event” that triggers a request for action is useful here.
In principle, the decisions assessed and acted on by architecture should again be able to cover the entire enterprise scope, at every level, from “universals” to real-time action and review. The architecture will need some explicit means to describe the purpose, role, dependencies, and jurisdictions of any or every decision in scope – the domains of the base-frame (Simple, Complicated, Ambiguous, Not-known) being one such categorization we might use for this. We would also need mechanisms to enable us to create a complete audit-trail for any decision, all the way back to the core-“universals” for the enterprise.
For each of these entities in scope – assets, functions, locations, capabilities, events, decisions – we would need a complete, fully maintained RACI matrix (responsible, accountable, consulted, informed) of all related stakeholders. (That’s an ideal to aim for, anyway, though it may be impossible to achieve in practice.) This would tell us who would be affected by any architectural issue, who we should engage as active stakeholders in any assessment or review, and what clashes are likely where responsibilities and accountabilities overlap.
Given the models we started with, this would complete the first pass of the assessment. It might well be useful to loop back to the start and quickly scan through again to see if any other themes or ideas come up. In any case, we should document the results in the project-diary.
Step 4: Review “To-Be” Architecture Against Qualitative Criteria
The usual suggestion for this is that the core qualitative concern for capabilities is performance-management. Yet in practice, that’s only one of the concerns here: we also need to add “universals” such as security, health and safety, business ethics, knowledge management, and the like.
For each of these, we need to identify appropriate critical success factors (CSFs) and metrics for key performance-indicators (KPIs). Which is not going to be easy, because the whole point of architecture is that it’s about linking everything together – hence, in principle at least, its success can only be measured in terms of the whole.
Many of these metrics and suchlike will depend on the industry and enterprise, so I won’t attempt to list them here; but the final lists should be documented in the project-diary, as usual.
Step 5: Finalize Building-Blocks for Architectural Scope
This is a step that we will probably have to skip over here, because it’s not practicable in this context.
The “by the book” notion of Architectural Building Blocks and Solution Building Blocks, as patterns for re-use, is very useful in most parts of architecture. But architecture itself depends almost entirely on people-based capabilities – otherwise known as “skills” – and the concept of “re-use” doesn’t work in the same way with people as it does with software or machines or other physical “things.” One important reason is that people embody skills in very different ways to those in which we build capabilities into machines or software; another is that most of the architect’s skills are in the “uncertainty” domains, which are naturally not amenable to simple re-use. Either way, probably best for now to document it as “not applicable,” and move on.
Step 6: Conduct Checkpoint-Review for Stakeholders
- suitable reference-models, standards, techniques for architecture - central role of sensemaking; role of architecture vs. design - checklists and other “rotations” for the assessment toolkit - fluency in sensemaking to select checklists, views and “rotations” - fluency in identifying recursion, reflexion, and similar patterns - fluency in strategic assessment (Purpose phase) - fluency in “soft-skills”/people-skills (People phase) - fluency in analysis and modeling skills (Preparation phase) - familiarity and practice with architecture methodology (Process) - appropriate performance-metrics for architecture (Performance) - assets: workspace, computer, whiteboard, etc. (physical); information-sources and information-stores (virtual); access to people (relational); executive support for architecture (aspirational) - functions: processes for architecture, including governance, quality, process-improvement, engagement, and delivery - locations: meeting-spaces (physical); strong social-networks across and beyond organization (relational) - capabilities: generalist-level skills for all competencies across enterprise scope; specialist-level skills in architecture itself - events: contexts and interface-specs for architecture-events - decisions: categories for decision-types; facility for dependency/validation “audit-trails” for any decision (or other entity) - RACI matrices associated with all architectural entities - appropriate set of metrics (KPIs), etc., and success-factors |
If necessary, we could loop back to the preceding step 3 to re-assess our architecture-models and the list of requirements we’ve derived from them.
Once we’re comfortable with that, we’re ready to move on to do the same kind of assessment with our current or “as-is” context for “the architecture of architecture.” Before we do that, though, we need to do the first assessment for our example-project.
Example Project: “As-Is” Assessment for the Bank
What should we do to assess the organization’s architecture of respect? That’s the challenge here…
We have a pair of workshops planned for this day: one for the executive-team, the other for frontline workers. That’ll be important, because those are likely to be our main information-sources for this project – there’s not much else to be had. But let’s at least start off doing it “by the book,” and see what happens from there. We’re using the “as-is” as the primary time-horizon, because the overall aim is to recreate in the future the respect that existed in the past but does not exist now – so the place where we need to focus most of our attention is on what’s changed between past and present.
Step 1: Develop Baseline Architecture for “As-Is” Context
This is short and sweet – or not-sweet, rather, because as yet we have no information available from which to derive that baseline.
In principle, we could derive at least a partial baseline from publicly available documentation such as the organization’s annual report, together with some quick interviews with relevant stakeholders. In this case, however, it would have taken several days to do it, which we didn’t have available to us, and we didn’t have the permission to do it anyway.
Step 2: Select Reference-Models, Views, Viewpoints, and Notational Standards
Five-domain context-space mapping
Five systems-theory principles
Five-elements lifecycle
Segments-model framework
Ideally, we would model for a wide range of viewpoints, both inside and outside the organization. Realistically, though, we’ll have to make do with whatever viewpoints we can derive from that pair of workshops, together with any information we can glean from other sources about the views of “outsiders.”
Step 3: Create and Update “As-Is” Architecture Models
The first stage of the assessment is the two workshops: we’ll then develop suitable models from the results.
Workshop for Executive-Team
This is organized as a half-day offsite session for the executive and other senior staff. Just under thirty people in all, of whom barely a third arrive on time – the remainder drift in over the next half-hour or so, without apology. Many of them ignore the no-phones rule for the session – including the CEO, who seems to be up and down like a jack-rabbit following one phone-call after another. The CIO even keeps her laptop open throughout the session, pounding away on an endless stream of supposedly urgent emails.
The theme of “respect” provides some interesting views into the overall context. While it’s clear that professional respect between them is more than adequate, that’s not reflected in their mutual actions: people talking over each other, others talking among themselves, while someone is supposedly presenting to the whole group, and, of course, the ubiquitous iPhones and excuse-me-I-just-have-to-take-this-call. There are a few displays of oversized egos, of course, but overall there’s not as much political infighting as we’ve seen in other organizations, which ought to be a good sign – yet it seems extraordinarily difficult to get them to work together as a team. In that sense, respect is a serious problem here, right down to the way the senior management work with each other – or don’t work with each other, more accurately.
must exclude any consideration of “solutions” during the assessment phase – document any ideas and sketches, but don’t discuss! |
Instead, we simply take note of whatever information comes up, and hold back on any assessment until later.
Workshop for Operations Staff
This second workshop is a much larger affair, several hundred staff happily crammed into a local theater. For this we’ve joined with another team who have been running a more conventional organizational-development program involving music, group-work, and so on. It’s also all in the local language, so we would otherwise only have been able to work through a translator – whereas here we’re able to slip our questions into the overall mix, and note what comes up as a result.
There are staff here from almost every area of bank operations: tellers from main branches and in-store franchises, back-office staff, call-center workers, a few technical-support people. What becomes clear straight away, if masked by the laughter brought on by the skilled presenter, is that there are huge conflicts here, many of them caused by conflicting goals set by management for each group and business-unit. For example, one team’s bonus is based on how much they cross-sell credit-cards to clients, while another team’s is based on how much they reduce clients’ over-credit. And all frontline staff – both customer-facing and call-center – are now bearing the brunt of customers’ ire at the bank’s response to the current worldwide “credit crunch,” suddenly switching from an apparent policy of throwing credit-cards around like confetti, to endlessly haranguing every cardholder to pull back on their credit. At the executive level, the figures may look good, for now at least, but at the front-line no-one is happy… and that definitely does not augur well for the future.
Again, no “solutions” at present; yet it’s noticeable that the simple fact of being heard seems to have made a real difference to the way these operations-folks now view their work.
Follow-On Assessment
We start with context-space mapping.
Bank rules are usually structured for compliance and audit purposes. In principle they’re not particularly complicated, of course – but they’re often so vast, due to the nature of the controls, that they end up being experienced as complicated anyway.
Next, the systems-theory principles.
It’s clear that both recursion and reflexion are in play here, because the overall respect-problems and stress-symptoms are all too evident throughout the organization and enterprise (recursion), and can be seen in almost any point within it and from outside it (reflexion).
There’s evidence of failure to apply rotation, a consistent overview from every perspective – instead, each person seems to view the enterprise solely from their own standpoint, without much sense of the whole, or expressed feeling of belonging to a whole.
And there’s also not much evidence of reciprocation, in that the organization seems to have a very one-sided, even self-centric view of its relationship with its market: in the CEO’s eyes at least, “shareholder-value” comes first, with clients’ needs a very distant second. The market-model suggests that this would lead to a very destructive resonance feedback-loop that would lead to spiralling damage to the bank’s reputation – exactly as reported and as we’ve also seen for ourselves in those two workshops.
On to the five-elements lifecycle review.
This we can summarize direct from the executive workshop: the main emphasis is on Preparation and Process phases, with some on whole-system use of Performance, but nothing like enough of Purpose or People to provide much-needed balance. Seriously lopsided, in other words, if not unusually so for a commercial organization – but the longer-term impacts of that imbalance are now starting to show.
And finally, architectural entities in scope, in segments-model terms.
Almost all of this is about people, values, and feelings – or, in architectural terms, relational-assets (links with real people), “universals” (values), and the audit-trails of items and interactions (particularly feelings) that link them together. Architecturally, what’s missing here is an explicit description of values to which everything can be anchored – the vision, or, as one of our other clients put it, “the totem-pole to unite the tribes.” Just what that would be is far from clear at present: all that is clear is that “shareholder-value” isn’t it, if only because that’s of no interest to the bank’s clients from whom that supposed “shareholder-value” would ultimately be derived.
- for phase B/C: will need to identify policies, rules, and regulations that would apply to detail-assessment and implementation - for phase B (as-is): use POSIWID to assess implied-“purpose” of current systems |
Policies, rules, and regulations may not apply until we start some kind of implementation – which may not happen in this case, and may not be our responsibility anyway. But we note an interesting clash of cultures: this country’s culture places a strong emphasis on the family, the collective, whereas that of the parent-company builds everything around the individual – and most of the bank’s metrics and bonus-structures reflect the values of the parent, not this place. That in itself might be a source of problems that need further exploration.
POSIWID is an acronym coined by the cyberneticist Stafford Beer, to describe the relationship between purpose and practice: “the purpose of a system is [expressed in] what it does.” In effect, the bank is a “system” whose current effective purpose is to create the problems that we’d seen in that assessment. No one designed it to create those problems, of course – though “design” is actually a key source of the problems here, because these issues cannot be resolved by tackling them piecemeal, but only by tackling them as a whole, as a single unified system. That doesn’t mean that we should try to do everything at once – that’s impossibly disruptive, and it never works anyway. What it does mean is that we need to think architecturally, in terms of the architecture of the enterprise, not just the organization. And one key item that’s most notable by its absence, perhaps, is the lack of any meaningful enterprise-scope vision – so that might well be a good place to start work.
But that’s a “solution” – and all would-be solutions should be shelved until we get to the appropriate point, which is not here. For now, though, we’ve finished this part of the assessment: time to move on.
Step 4: Review “As-Is” Architecture Against Qualitative Criteria
To the CEO, it seems, almost the only thing that matters is the quarterly figures. But that won’t work well enough in this context – not least because money won’t buy respect. The whole focus of this exercise is qualitative, not quantitative – but it’s still far from clear yet as to which qualities we’ll need to focus on. Something we’d need to note in the project-diary, but otherwise just keep going.
Step 5: Finalize Building-Blocks for Architectural Scope
If we were to do this “by the book,” we should look for re-usable building-blocks at this point. But once again that building-blocks concept doesn’t quite make sense here, because almost all of this is about people rather than “things.” Again, probably something best left to review in the next phase.
Step 6: Conduct Checkpoint-Review for Stakeholders
We finished all of the preceding review within about half an hour after the second workshop ended. Our client – the bank’s change-manager – was still helping the main presenter to pack up at that point, so we’re able to discuss the assessment so far. He’s very pleased with what sees, so we get his go-ahead for the next phase – the “to-be” assessment.
Application
How do you do architectural-assessment at present? What techniques, toolsets, and methods do you use?
How do you avoid “premature fixation” on a solution during the assessment phase of architecture?
How would you assess the architecture of architecture itself?
If you’re already doing enterprise-architecture, what domains of the enterprise does this architecture cover? How does it identify core elements such as capabilities value-streams and suchlike? If it does not describe all elements of the organization and key elements of the extended-enterprise, what assets, functions, locations, capabilities, events, and decisions would be needed for it to expand outward to cover that full scope? What are or would be the consequences to the organization if it does not fully cover that scope?
How would you use architecture to tackle a big-picture business-issue such as “to enhance respect in the marketplace”? (Or – as in the case of a real business metric used by one of our government clients – “to increase the number of days between bad headlines in the newspaper”?) Where would you start? What planning and governance would you need for the assessment itself?
What do you see if you apply POSIWID to your own organization’s context and scope? If “the purpose of the system is what it does,” what would you do, from an architectural perspective, to create change in that purpose, and why?
Summary
In this chapter, we explored the step-by-step process to derive an “as-is” or “to-be” perspective for the architecture. In the main project, we were able to do this in a straightforward way, following the steps as intended, in this case, for a desired-future “to-be” perspective. By contrast, the example project emphasized the “as-is” context, and also highlighted the types of challenges – particularly the people-related issues – that so often arise in real-world architecture when we’re trying to capture the information we need about what’s actually going on. The “Application” section at the end of the chapter showed how to apply all of this in your own work-context.
The main deliverables for the day were the respective assessments for either “as-is” or “to-be.” The connections with people, and their engagement in the architecture, were also an important, if often under-recognized, deliverable.
In the next chapter, we’ll see how to do the same kind of assessment to derive a “to-be” perspective for the architecture.