Beyond Human-in-the-Loop: Designing Accountable Organizations for AI-Augmented Decision-Making — The HILO-A Framework

Paper ID: EIJTEM_2026_13_3_200-213

Author's Name: Ignacio Bonasa Alzuria

Volume: 13

Issue: 3

Year: 2026

Page No: 200-213

Abstract:

Artificial intelligence is moving from the edge of organizational life into its decision core. Systems that once supported people now classify, rank, predict, recommend, generate, and in some settings execute actions. This shift creates a management problem that cannot be solved by model accuracy alone: organizations must decide where machine intelligence may act, where human judgment must remain consequential, and who is accountable when a decision is produced by a hybrid human–AI chain. To address the gap between high-level governance principles and operational decision rights, this paper proposes the Human-in-the-Loop Organizational Architecture (HILO-A), a conceptual management framework built around five connected layers: Data, Algorithm, Human Judgment, Decision, and Accountability. It also introduces four modes of human–AI interaction—Assisted Intelligence, Augmented Intelligence, Supervised Automation, and Autonomous Execution—and a Decision Criticality Matrix based on impact, reversibility, uncertainty, and ethical sensitivity. The paper is deliberately managerial rather than purely technical. It treats AI adoption as a redesign of decision rights, escalation paths, exception handling, and responsibility. The framework is positioned alongside current governance thinking, including the NIST AI Risk Management Framework, the OECD AI Principles, and the European Union AI Act. The central proposition is that mature AI organizations will not be defined by maximum automation, but by the quality with which they allocate intelligence and responsibility. HILO-A offers a practical vocabulary and implementation protocol for managers who need to make that allocation explicit, auditable, and adaptable.

Keywords: Artificial Intelligence; Human-in-the-Loop; AI Governance; Organizational Design; Decision-Making; Management Architecture; Human–AI Collaboration; Accountability; System Design.

References:

Autio, C., Schwartz, R., Dunietz, J., Jain, S., Stanley, M., Tabassi, E., Hall, P., & Roberts, K. (2024). Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile (NIST AI 600-1). National Institute of Standards and Technology. https://doi.org/10.6028/NIST.AI.600-1
European Parliament & Council of the European Union. (2024). Regulation (EU) 2024/1689 laying down harmonised rules on artificial intelligence (Artificial Intelligence Act). Official Journal of the European Union.
International Organization for Standardization & International Electrotechnical Commission. (2023). ISO/IEC 42001:2023 Information technology — Artificial intelligence — Management system. ISO.
National Institute of Standards and Technology. (2023). Artificial Intelligence Risk Management Framework (AI RMF 1.0) (NIST AI 100-1). https://doi.org/10.6028/NIST.AI.100-1
OECD. (2024). OECD AI Principles (updated 2024). Organisation for Economic Co-operation and Development.
Parasuraman, R., & Riley, V. (1997). Humans and automation: Use, misuse, disuse, abuse. Human Factors, 39(2), 230–253.
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000). A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man, and Cybernetics—Part A: Systems and Humans, 30(3), 286–297.
Raisch, S., & Krakowski, S. (2021). Artificial intelligence and management: The automation–augmentation paradox. Academy of Management Review, 46(1), 192–210.
Shneiderman, B. (2022). Human-Centered AI. Oxford University Press.
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., Teevan, J., Kikin-Gil, R., & Horvitz, E. (2019). Guidelines for human-AI interaction. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems.
Dellermann, D., Ebel, P., Söllner, M., & Leimeister, J. M. (2019). Hybrid intelligence. Business & Information Systems Engineering, 61, 637–643.
Jarrahi, M. H. (2018). Artificial intelligence and the future of work: Human-AI symbiosis in organizational decision making. Business Horizons, 61(4), 577–586.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015). Algorithm aversion: People erroneously avoid algorithms after seeing them err. Journal of Experimental Psychology: General, 144(1), 114–126.
Glikson, E., & Woolley, A. W. (2020). Human trust in artificial intelligence: Review of empirical research. Academy of Management Annals, 14(2), 627–660.
High-Level Expert Group on Artificial Intelligence. (2019). Ethics Guidelines for Trustworthy AI. European Commission.
Lee, J. D., & See, K. A. (2004). Trust in automation: Designing for appropriate reliance. Human Factors, 46(1), 50–80.
Logg, J. M., Minson, J. A., & Moore, D. A. (2019). Algorithm appreciation: People prefer algorithmic to human judgment. Organizational Behavior and Human Decision Processes, 151, 90–103.
OECD. (2024). Recommendation of the Council on Artificial Intelligence: OECD AI Principles, updated 2024. Organisation for Economic Co-operation and Development.
Sundar, S. S. (2020). Rise of machine agency: A framework for studying the psychology of human–AI interaction. Journal of Computer-Mediated Communication, 25(1), 74–88.
Tabassi, E. (2023). Artificial Intelligence Risk Management Framework (AI RMF 1.0), NIST AI 100-1. National Institute of Standards and Technology. https://doi.org/10.6028/NIST.AI.100-1
Jussupow, E., Benbasat, I., & Heinzl, A. (2024). An integrative perspective on algorithm aversion and appreciation in decision-making. MIS Quarterly, 48(4), 1575–1590.
Lu, J. G., et al. (2024). AI aversion or appreciation? Meta-analytic evidence for a capability-personalization framework. Academy of Management Proceedings, 2024(1). https://doi.org/10.5465/AMPROC.2024.18332abstract
Moritz, J. M., Pomrehn, L., Steinmetz, H., & Wehner, M. (2023). A meta-analysis and review about the (un)fairness perceptions of algorithmic decision-making. Academy of Management Proceedings, 2023(1). https://doi.org/10.5465/AMPROC.2023.15483abstract
Schaap, G., Bosse, T., & Hendriks Vettehen, P. (2024). The ABC of algorithmic aversion: Not agent, but benefits and control determine the acceptance of automated decision-making. AI & Society, 39, 1947–1960.
Haupt, M., Freidank, J., & Haas, A. (2025). Consumer responses to human-AI collaboration at organizational frontlines: Strategies to escape algorithm aversion in content creation. Review of Managerial Science, 19, 377–413.
Corrêa, A. M., Garsia, S., & Elbi, A. (2025). Better together? Human oversight as means to achieve fairness in the European AI Act governance. Cambridge Forum on AI: Law and Governance, 1, e29. https://doi.org/10.1017/cfl.2025.10010
OECD. (2025). Governing with Artificial Intelligence: The State of Play and Way Forward in Core Government Functions. OECD Publishing. https://doi.org/10.1787/795de142-en
Embedding AI governance in organizations: A multi-level approach to responsible AI use. (2025). Procedia Computer Science, 270, 4144–4154. https://doi.org/10.1016/j.procs.2025.09.539
Exploring collaborative decision-making: A quasi-experimental study of human and generative AI interaction. (2024). Technology in Society, 78, 102662. https://doi.org/10.1016/j.techsoc.2024.102662
On the (non-) reliance on algorithms—A decision-theoretic account. (2024). Journal of Mathematical Psychology, 119, 102844. https://doi.org/10.1016/j.jmp.2024.102844

View PDF