APPENDIX A
BUILDS Evaluation Rubric
The 30-question evaluation rubric that follows is the sum of the six five-question sets appearing at the end of those chapters in which the BUILDS framework is presented.
Business Value
1. Have you conducted a value proposition analysis for adopting this new technology? Does the new technology fit your business needs?
2. Have you identified any problems in adopting this new technology?
3. Does adopting this emerging technology open up new opportunities for your organization? Have you assessed these opportunities?
4. Will you have a risk management plan in place when these technologies are adopted?
5. Have you gathered case studies of other companies in your industry that have adopted this technology that you can present to your executive team?
User Experience
6. Do you have a thorough analysis of the affordances of this technology? What new capabilities does it offer your users?
7. Has your company carried out an observational (ethnographic) study of how users would employ this technology?
8. Has your team carried out a use case analysis for your company for this technology? Who are the primary, secondary, and tertiary users, and how would each category of users employ this technology?
9. Does this technology collect enough data to allow it to be personalized for each user? Have you gathered feedback from users on how this technology can be iterated and improved?
10. Is the technology supplying a high-polish end user experience comparable to consumer technologies that they may be familiar with and use at home?
Impact
11. Is the emerging learning technology accessible for persons with a disability? Does it have any obvious biases or barriers for specific groups (for example, groups based on gender, race, or culture)?
12. Would the adoption of this technology introduce new work experiences into your company? Does it allow for mobile learning?
13. How would the adoption of this technology change your company’s organizational structure?
14. Does this technology introduce ethical issues or problems (such as at-risk populations, privacy, or control)?
15. Is this emerging technology environmentally friendly and sustainable?
Learning
16. Does this technology support both intuitive (experiential) and rational (instructional) ways of learning?
17. Is this technology flexible enough to support many different kinds of learning activities?
18. Has this technology been specifically designed for workplace learning?
19. Does this technology support individual and group learning? Does it embrace collaborative and collective learning?
20. Does this technology allow for a wide range of assessment tools, including support for organizational analytics and learning analytics?
Dependencies
21. What supporting technology needs to be in place to successfully deploy and use this emerging technology?
22. What dependencies (both new and interesting or potentially disastrous) are introduced when this emerging technology is combined with existing technologies in your organization?
23. What sorts of change management, communication plans, and executive support need to be put into place to successfully launch this new technology?
24. How secure is this technology? Do you have a strategy for handling the user’s private information? Do you have solid backup technologies and processes in place?
25. How will your users deal with being highly dependent on this new technology if there are service outages or other infrastructure problems?
Signals
26. Do you have at least one person in your company who is assigned to gathering signals about the future of emerging technologies?
27. Are signals about emerging technologies regularly distributed and discussed throughout your company?
28. Have you assessed where this emerging technology is on its developmental curve?
29. Has someone analyzed the trends for this technology to see whether it is a fad or a long-term shift?
30. Do you regularly develop scenarios and strategies to anticipate change over the next five years?