Bringing Subjective Values To Objective Assessment
The Artificial Intelligence Trust Quotient Series, Part Two: Values
Making Values A Part Of Technology Assessment
The values of an organization are - for many - critical to successful outcomes for all their stakeholders, whether customers, employees, investors, or regulators. From personal experience, I have worked, and stopped working with organizations based on my perception of their commitment to their stated values. They are intensely subjective and even where the language used aligns between organizations, definitions and interpretation may not.
Someone outside of that organization, as in this case building an assessment tool, will find defining the values an organization adopts and what they mean in context is hard. Given this subjectivity, one-size-fits all use of values in an assessment is challenging, if not impossible, without making unwelcome judgements about those values.
Allowing for that subjectivity is, however, possible and it is a core feature of the Artificial Intelligence Trust Quotient (AI-TQ). Working from the intent behind including values in the assessment, the question that needs to addressed is simple:
“Whatever the outcome of other assessments of this technology solution, does it align with, sustain and enhance our organization’s values for all our stakeholders?”
Values Depend On The Organization
The AI-TQ does not attempt to impose any specific set of values on organizations using it. Doing so would be to assert the values of a third party. It does assert that values are an important part of any organization’s fabric and sets an expectation that they will be assessed as part of the process. As discussed, what those values are and their meaning is purely a judgment for the assessor. They could be solely grounded in financial metrics such as revenue and profit, or encompass far broader objectives such as minimizing climate impact, or promoting workplace equity.
By taking this approach, the AI-TQ aims to provide organizations the opportunity to ensure that their stated values are incorporated into its assessment of technology: without attempting prior judgment of those values.
Bringing Your Own Values To The AI-TQ
The AI-TQ allows for configuration to adapt the assessment to the organization using it. In the case of values, the assessment requires a minimum of three values statements to complete the section which are each scored against three criteria:
Alignment - does this technology align with the value in question? Could it be seen as potentially damaging to this value?
On-going Protection - does on-going use of the technology enforce the value over time? What is the potential for divergence?
Extend - does this technology help share and promote the value? For example, amongst customers or suppliers.
While there is no maximum number of values that could be added, many organizations have a single digit number (often around five) of value statements. Generally keeping the number of value statements around this will offer the right balance of breadth and detail.
Coming Next To The AI-TQ: Source of Truth
This research is part of a series that will culminate in the official launch of the Artificial Intelligence Trust Quotient (AI-TQ) assessment. Next in the series is “Source of Truth” - a closer look at the fuel of AI, data.
Also, my thanks and appreciation for the feedback and comments on this research so far! It is immensely valuable to me, and I look forward to more.
