Title:
Validity of AI-generated One-off Questionnaires for Organizational Transformation

Authors:
Dr. Jan van de Poll, Yang Yong, Nicole van de Weijer, Netherlands

Abstract:

Strategic decision-making is a precise craft that usually happens under time pressure. And often, the data for such decision-making is not (enough) available in the corporate data warehouse: you have to ask employees. This employee polling is usually very time-consuming. In this study, a novel approach is developed that couples artificial intelligence (AI) and a specific survey scale format to make one-off questionnaires in near real-time. We tested such AI-generated one-off questionnaires in 23 strategic situations where almost 7,000 employees provided nearly 6 million answers. Six statistical parameters assess the validity and reliability of the questionnaires. Our test results reveal that the developed methodology saves time and produces valid survey outcomes. Our finding, as a rule-of-thumb, is that, above a sample size of 100 respondents, AI-generated one-off questionnaires are scoring well on the selected validity/reliability parameters. Consequently, the developed technique could be employed successfully in generating valid and reliable one-off questionnaires for organizational transformation.