Next Article in Journal
Optimization Method of Interrupted Sampling Frequency Shift Repeater Jamming Based on Group Teaching Optimization Algorithm
Next Article in Special Issue
Illumination and Shadows in Head Rotation: Experiments with Denoising Diffusion Models
Previous Article in Journal
Secure and Efficient Federated Learning Schemes for Healthcare Systems
Previous Article in Special Issue
Pre-Service Teachers’ Assessment of ChatGPT’s Utility in Higher Education: SWOT and Content Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Framework for Integrating Generative AI in Developing Competencies for Accounting and Audit Professionals

by
Ionuț-Florin Anica-Popa
1,*,
Marinela Vrîncianu
1,
Liana-Elena Anica-Popa
1,
Irina-Daniela Cișmașu
2 and
Cătălin-Georgel Tudor
1
1
Department of Management Information Systems, Bucharest University of Economic Studies, 010374 Bucharest, Romania
2
Department of Financial and Economic Analysis and Valuation, Bucharest University of Economic Studies, 010374 Bucharest, Romania
*
Author to whom correspondence should be addressed.
Electronics 2024, 13(13), 2621; https://doi.org/10.3390/electronics13132621
Submission received: 12 June 2024 / Revised: 30 June 2024 / Accepted: 2 July 2024 / Published: 4 July 2024
(This article belongs to the Special Issue Generative AI and Its Transformative Potential)

Abstract

:
The study aims to identify the knowledge, skills and competencies required by accounting and auditing (AA) professionals in the context of integrating disruptive Generative Artificial Intelligence (GenAI) technologies and to develop a framework for integrating GenAI capabilities into organisational systems, harnessing its potential to revolutionise lifelong learning and skills development and to assist day-to-day operations and decision-making. Through a systematic literature review, 103 papers were analysed, to outline, in the current business ecosystem, the competencies’ demand generated by AI adoption and, in particular, GenAI and its associated risks, thus contributing to the body of knowledge in underexplored research areas. Positioned at the confluence of accounting, auditing and GenAI, the paper introduces a meaningful overview of knowledge in the areas of effective data analysis, interpretation of findings, risk awareness and risk management. It emphasizes and reshapes the role of required skills for accounting and auditing professionals in discovering the true potential of GenAI and adopting it accordingly. The study introduces a new LLM-based system model that can enhance its GenAI capabilities through collaboration with similar systems and provides an explanatory scenario to illustrate its applicability in the accounting and audit area.

1. Introduction

The rapid development and disruptive progress in Artificial Intelligence (AI), which is dramatically transforming many aspects of employees’ personal and professional lives, is raising questions in academia and business about the new skills needed by accounting and auditing (AA) professionals [1,2,3] as they integrate AI solutions into their day-to-day work [4,5,6]. Recent studies have pointed out that Big4 firms report significantly higher expertise in using AI than other AA companies [7,8], hence the role of these technologies in creating critical competitive advantages in the current context [9]. Statistical figures reinforce this idea, with AI in the accounting services market being estimated at USD 1.56 billion in 2024 and expected to reach USD 6.62 billion by 2029, with a compound annual growth rate (CAGR) of 33.5% for the forecast period 2024–2029 [10].
A new entrant in the AI technologies group, Generative Artificial Intelligence (GenAI), holds significant potential to transform the field of accounting and auditing, with the academic and business communities investigating its applicability in the AA sphere [5]. Accountants and auditors who can combine knowledge, skills and competencies required by the profession with those using GenAI products will benefit from the opportunity to increase the efficiency and accuracy of their work results [11]. Studies on the adoption of innovative technologies, including AI, in accounting and auditing have focused on topics of interest, such as the impact on the profession [12,13,14], changes in learning programs and the need for advanced skills of accountants and financial auditors [4,15] or the assessment of AI acceptance in accounting [16]. Researchers have highlighted the correlation between the use of emerging technologies in these areas and the skills development of AA professionals. Considering that GenAI will impact the way humans assimilate and process information and knowledge [17,18], the skills needed by accountants in the coming years should encompass both technical and social abilities [19].
Large consulting firms in the accounting and auditing industry are showing increased interest in integrating AI technologies [7,20], and recent research has pointed to significant progress in their use in most business processes in organizations [21,22]. To our knowledge, there are no studies that have addressed both the leveraging of GenAI in accounting and auditing and the emergence of new competency requirements for AA professionals in relation to integrating GenAI into their activities. In attempting to contribute to filling the existing gaps in the specialised literature, in this work, we aimed to address the following research questions:
RQ1. What knowledge, skills and competencies are needed by accounting and auditing professionals to effectively harness Generative Artificial Intelligence, and what are the risks of using it in this area?
RQ2. How can organisations integrate Generative Artificial Intelligence capabilities into information systems to develop the competencies of accounting and audit professionals?
We consider that GenAI can demonstrate its effectiveness in accounting and auditing when its users have both the competencies to manage it and the advanced analytical skills to interpret the results generated, using critical thinking to filter and evaluate them to make informed decisions. Therefore, this study starts from the premise that the widespread AI solutions and GenAI adoption in the AA domain generate the need to encourage and direct human resources towards improving and enriching skills. This premise aligns with the vision of international bodies that promote close cooperation between governments and stakeholders so that people are equipped with the necessary competencies that enable them to use and interact effectively with AI systems [23].
The main objectives of this study are (1) to identify the competencies, skills and knowledge required by accounting and auditing professionals to operate AI/GenAI systems effectively and (2) to provide a framework that can be used to integrate LLM-based GenAI systems into AA domain.
Considering the revealed aspects, the research is structured as follows: the first section presents the results of the literature review; the second describes the applied research methodology; the third includes the research results, picturing the framework for integrating Generative Artificial Intelligence in the development of accounting and auditing professionals’ competencies; and the fourth focuses on discussions and research limitations. Conclusions, contributions, implications and future research directions of the research are drawn at the end of the article.

2. Literature Review

2.1. Generative Artificial Intelligence

Although the term “artificial intelligence” was first introduced in 1956 as part of the Dartmouth Summer Research Project on Artificial Intelligence by John McCarthy, Marvin Minsky, Nathaniel Rochester and Claude Shannon, there is arguably a consensus on the current importance of Artificial Intelligence systems with learning, reasoning and adaptive capabilities [24].
A subset of AI is Generative Artificial Intelligence, defined as a technology that provides human-like responses in the form of text, images and video content using Deep Learning (DL) and Natural Language Processing (NLP) models [25], following the requests formulation [26]. Unlike traditional AI systems, which use predefined datasets and rule-based programming [27], GenAI can generate novel, original content to provide answers to complex and diverse queries [28]. The launch of OpenAI’s ChatGPT chatbot has paved the way for significant progress in AI. The integration of DL and language models based on the Generative Pre-Training Transformer (GPT) architecture significantly expands the capabilities of these programs [29], which replicates the activity of the human brain in the process of learning and developing the responses provided for the requests sent [30].
Large Language Models (LLMs) represent a particular type of GenAI trained on large datasets using advanced DL techniques to analyse and understand patterns and structures, creating the prerequisites for generating similar items [18,31,32]. LLMs serve as a “base model” and provide a starting point for the development of more advanced and complex models [27,33,34]. LLM models are increasingly used in content generation, information retrieval in unstructured data, data conversions, data organisation or detailed data analysis, addressing diverse business needs.
For the use of LLM-based systems, two techniques are known and harnessed in practice: fine-tuning and prompt engineering [35,36]. Fine-tuning is the technique by which a pre-trained model is adapted to a particular domain by training it further on a task-focused dataset. It involves improving the model by learning from the specified dataset. Prompting, on the other hand, is considered a more straightforward technique that does not involve modifying the model but only adjusting the way it is queried to guide it in the right direction [37]. The prompt can be a word, a sentence or phrase, a list of instructions or possible input data that has the effect of generating a relevant response in the context created [38]. Various strategies regarding the prompting technique of LLM-based systems are highlighted in research studies and used in practice: Zero-Shot—prompting a task in a way that LLM can understand and generate an appropriate response without explicit input, Role-Playing—simulating a profession-specific role along with the formulation of the prompt to solve the task for greater contextualization [39] and Chain-of-Thoughts (CoT) prompting—requesting to solve a task accompanied by prompting on providing the reasoning steps [40,41]. Masikisiki et al. [42] illustrated the use of the CoT technique as a method to train LLM-based system users to efficiently train models to obtain more relevant results. From another perspective, CoT can bring the benefit of understanding the reasoning of solving a complex problem by the LLM-based system user, thus contributing to the skills or knowledge development in the domain they are interested in.
Floridi [43] presented the concept of AI2AI, which involves the ability of LLM-based systems to collaborate and form connections with other similar systems, thus enabling interoperability for more relevant responses. On the other hand, LLM-based systems can generate plausible answers that may sometimes be incorrect, a phenomenon known as AI Hallucination, due to the biased (incomplete or incorrect) data sources on which LLMs are modelled/trained. To manage this problem, one solution that has proven viable is to combine the capabilities of LLM-based systems with external sources [44]. LLM-based GenAI systems have revolutionary potential, which can become disruptive through significant impact on society and organisations [32].

2.2. New Competencies Requirements for Accounting Professionals and Auditors in the AI-Integrating Context

2.2.1. Insights from the Academic Literature

The competencies of an organization’s staff are crucial, often serving as a key factor for competitive advantage [45]. From a management theory perspective, one of the pioneers of competency research is David McClelland, who described competency as “a symbol for an alternative approach to traditional tests of in-smartness” [46]. A landmark is the definition of competence as a characteristic of a person, which can be a trait, a skill, an aspect of self-image or social role, or a set of knowledge that a person uses [47].
Recently, a government initiative [48] has defined AI Skills for Business, grouped into four categories—cognitive, functional, personal/behavioural and ethical—to support organisations in developing strategies to upskill staff using AI solutions in their daily work. In accounting and auditing, various studies have highlighted the correlation between professionals’ competencies and the extent to which they use innovative technologies in their activities. Andreassen [49] mapped current skills of accountants and identified new ones, such as (i) statistical knowledge for preparing data or interpreting predictive models; (ii) performance analysis and client segmentation; (iii) monitoring IT system integrations and electronic exchange of accounting data between systems. Hence, the key role of AA professionals is to adopt and exploit the benefits of these technologies. Arguing the need to reshape skills of the accounting professionals, [50] discussed courses integrating elements of AI and RPA, taught at a US public university.
As the accountant’s tasks and expertise are taken over by technology, the accountant’s remit becomes narrower and more specialised, with the evolution of the accounting profession necessitating a scope expansion of technical skills [51]. The emergence of inter-professional competencies has led accountants to move towards other roles close to their identity, which, until recently, did not fit into their specific duties. It is also becoming imperative for auditors to acquire new technical skills for obtaining and interpreting financial audit results using modern technologies [52] and to focus on innovative supporting tools that imply the assumption of a continuous learning process [53]. Mathisen and Nerland [54] confirmed that newly adopted technologies play a crucial role in financial auditing by raising awareness, mobilizing for learning at work, facilitating learning and developing auditors’ competencies. Mancini et al. [55] assessed smart technologies and mapped the set of Knowledge, Skills, Abilities (KSAs) required to manage decision-supporting information by leveraging AI, Big Data and Blockchain. Noordin et al. [56] explored external auditors’ perception of using Artificial Intelligence (AI) and its contribution to audit quality. The study highlighted the significance of engaging skilled accounting and auditing professionals to incorporate AI into audit tasks, thereby minimizing the related risks. Consequently, auditors should enhance their technical capabilities, irrespective of the type of audit firm they are employed by. Similarly, in a study aimed at assessing individual factors that may contribute to the effectiveness of fraud risk assessment among external auditors, Ridzuan et al. [57] evaluated the crucial role of digital technology skills in enhancing this ability.
Among profession-specific skills in financial auditing, critical thinking is considered essential when using IT technologies. It is important to interpret the results obtained using AI through the lens of professional reasoning. Sceptical thinking and mental representations, which can be fostered by training skills in the sphere of ‘problem solving’, are also valued [58,59].
Although emerging technologies appear to have improved the efficiency and effectiveness of audit work [60], there is the risk that some professional skills be diminished due to the use of AI technologies in specific activities [61]. Over-reliance on AI could lead auditors to neglect professional judgement, resulting in the risk of missing findings, misdiagnosing and misinterpreting data identified by AI.
Possessing technical skills is a sine qua non in the GenAI adoption and associated risk management [62,63]. Their perishable nature leads organisations to generally prefer human resources that primarily possess soft skills: communication, flexibility, teamwork, personal branding, proactive problem-oriented thinking, motivation and confidence [64,65]. Unlike technical skills, social skills are more closely related to personal characteristics and are more difficult to obtain or develop over time.

2.2.2. Professional Accounting Bodies Perspective

The first professional accounting bodies (PABs) were established in the second half of the 19th century in the United Kingdom and obtained Royal Charter status, which implies they are given the right to regulate their activities and decide the process and criteria for membership [66,67].
Today, most national and international professional accountancy bodies are part of the International Federation of Accountants (IFAC), which comprises more than 180 professional accountancy organizations in more than 135 jurisdictions, representing millions of professional accountants [68]. Professional accounting bodies exert significant influence on accounting and business activity and play a crucial role in shaping professional direction, being considered the profession’s principal guardians [69].
At the same time, tertiary accounting education relies on the accreditation of professional accounting bodies to certify that their graduates have developed the skills, knowledge and competencies needed to enter the accountancy profession [67]. On the other hand, the close and deep relationship of PABs with universities and higher education has some difficulties due to the increasing number of accounting professional interns employed directly by school [66].
For the analysis of the competencies recommended by professional regulatory and standard-setting bodies, three global and three nationally recognised organisations with significant influence on AA and accounting professionals were selected [69]. The Association of Chartered Certified Accountants (ACCA), with over 500,000 members and students; the Chartered Institute of Management Accountants (CIMA), with over 650,000 members and students; and the Institute of Management Accountants (IMA), with over 140,000 members, are international professional bodies that work continuously with industry experts and employers to ensure consistency between their requirements and recommended competencies. The American Institute of Certified Public Accountants (AICPA), established in 1887, having nowadays over 430,000 members; the Institute of Chartered Accountants in England and Wales (ICAEW), established in 1880; and the first PAB, established in 1854, the Institute of Chartered Accountants of Scotland (ICAS), are national professional bodies whose recommendations are based on extensive research, consultation with industry experts and analysis of evolving regulatory and market requirements. CIMA and AICPA have jointly developed the Chartered Global Management Accountant (CGMA) accreditation.
A synoptic table of the main classes of competencies considered by each professional body was drawn up in Table 1.
Following the analysis of the competency’s classes recorded in the consulted documents, it was observed that competencies from the field of integrated technologies were explicitly included in the AA area: “Technical competence”—ICAEW, AICPA and ICAS, “Data, Digital and Technology”—ACCA, “Digital skills”—AICPA, “Technology and Analytics”—IMA. Moreover, as the year of document publication is more recent, two classes of skills in the digital area in the same framework have even been identified (AICPA, 2022: “Technical skills” and “Digital skills”) [72]. All these align with the academic literature review insights. Reviewing the considerations on newly emerging requirements for accountants’ and auditors’ competencies generated by the integration of AI/GenAI/LLM solutions, it was found that there are no clear formulations regarding them in the specialized literature. Therefore, the positioning of the present research in this area aims to fill existing gaps, enriching the body of knowledge in the investigated field and providing benchmarks for addressing and shaping the development and learning plans of AA professionals at the organisational level.

2.3. Risks of Using AI in the Accounting and Auditing Professions

With the relatively recent emergence of GenAI technologies, its use in accounting and auditing exposes organisations [75] to specific risks.
The risk of maladjustment revealed in the literature arises because of accountants’ and auditors’ non-compliance with the requirements of using new IT [76,77]. Burns and Igou [76] noted that, under AI exploitation, users are often forced to adapt to intrusive interfaces, which can be perceived as a threat to privacy by violating certain social norms or boundaries. In these situations, flexibility, proactive thinking and adaptability are essential.
Tasks and competencies for accounting professions will undertake major changes, keeping “core” roles and tasks continuing to exist in the future, with the difference that they will be executed by AI technology [63,78]. There will also be new roles where collaboration with AI solutions will be necessary. Korzynsky et al. [18] consider AI Prompt Engineering as one of the future mandatory digital competencies when using GenAI. There is a major risk that poor prompt choice and formulation will render a GenAI-based system ineffective, which could influence the relevance and consistency of the results provided by AI models.
A significant risk for AI applications in general, and GenAI in particular, is algorithmic bias. Machine Learning algorithms identify patterns in the available data on which human decision-makers base their choices. If the pattern emerges due to a bias, the algorithms will amplify it and alter the results, exacerbating patterns of discrimination and the risk of ethical violations. In practice, the main instances of discrimination attributed to AI are caused by the following technical biases [79,80]: (i) bias generated by the distribution of the data used in model training, which does not respect the actual distribution of the data; (ii) sampling bias—resulting from the erroneous sizing of the sample used in model training; (iii) labelling bias—generated by the lack of diversity in the group of people labelling the training sample, with the data being altered by the biases of the labeller; (iv) proxy bias—generated by the inclusion of variables that are not directly related to the category being learned; (v) gender bias—induced by an algorithm that leads to gender discrimination; (vi) race bias—generated by an algorithm that leads to race discrimination. Interaction with the user can generate, in some situations, automation bias or confirmation bias, i.e., the tendency to more readily validate the results provided by an AI system under unconsciously developed automatisms [79]. Kirk et al. [81] showed that LLM can produce unethical, racist and sexist comments.
Another risk revealed in the literature [82,83] is that of the atrophy of people’s skills—deskilling—who make decisions based more on the results provided by AI applications and less on their professional reasoning. Risks considered major are those associated with the security of accounting information [84], requiring accountants and auditors to be aware of and apply measures to ensure it. Understanding the mechanisms for encrypting data, anonymising sensitive and confidential information, securing networks and identifying potential threats and vulnerabilities is essential in maintaining data security. The authors of [85] also reported the potential of AI-enabled data analytic-driven audit tools to alter audit processes and raise concerns about their uncontrolled use by novice-level auditors. The adoption of AI systems may also involve legal risks to data privacy, requiring verification of compliance with the European Parliament’s General Data Protection Regulation (GDPR), laws addressing discrimination (e.g., the US Civil Rights Act of 1964), any clauses in customer contracts, intellectual property regulations and personal information protection legislation adopted in some countries [86].
Following the scientific investigation, it appears that the relationship between the risks associated with the use of GenAI and the competencies of AA professionals may represent a future research direction, with the topic not being explored in the literature probably because of its novelty. The results confirm the necessity and usefulness of including, in the framework, elements that support organisations in their efforts to increase AA professionals’ risk awareness, which can create the conditions for the development of specific KSAs.

3. Materials and Methods

The methodological approach was based on the Systematic Literature Review (SLR), which is considered a rigorous method for identifying, evaluating and synthesizing the existing body of knowledge in published materials by researchers and practitioners [87]. Embedding ideas advanced by Massaro [88] regarding the conduct of literature research in accounting into the three-stage model adapted from [87] investigating AI in the Industry 4.0 era, the study began with developing a general plan to guide the research, as shown in Figure 1.
The area of research includes topics such as AI, GenAI, LLM and the required competencies in accounting and auditing. The next phase involved defining a twofold purpose of the study, aligned with the research questions to facilitate the orientation of the sources selection, the research running and the achievement of the study results. To answer the question “RQ1. What knowledge, skills and competencies are needed by accounting and auditing professionals to effectively leverage Generative Artificial Intelligence and what are the risks of using it in this field?”, it was decided to conduct a search of the most recent papers in the Web of Science Core Collection, combined with an investigation of the business literature—an adapted PRISMA flow diagram (Figure 2).
The key concepts used in the design of the logical expression for locating relevant references in the emerging areas, executed at the level of titles, keywords and abstracts (topic) were determined: ((“artificial intelligence” or “machine learning” or “deep learning” or AI or NLP or LLM or GPT or RPA) and ((competence*) or (skill*) or (knowledge*)) and (accountant or accountants or auditor or auditors))).
To improve the validity, reliability and rigor of the study contributions and conclusions, we also analysed documents produced by three global organisms and three national bodies, representative for the development of accounting and auditing professional standards and certifications: ACCA, CIMA, and IMA, respectively, and AICPA, ICAEW and ICAS (Table 1).
In the next step, the eligibility conditions—explicit inclusion and exclusion criteria—of the sources identified in the search were defined to create the prerequisites for an objective selection and a meaningful assessment of the research materials’ relevance (Table 2). These criteria were derived from the study objectives and guided by the research questions.
Applying the constraints resulted in obtaining an initial sample of 137 WoS-indexed articles, as can be seen in Table 3, the number of papers has increased significantly since 2019 due to both the novelty and rapid expansion of GenAI throughout the business world.
Each research team member checked the credibility and relevance of the identified references. Articles that did not address professional accounting and auditing skills concerning adopted AI technologies were eliminated. The final sample for our SLR includes 103 studies, a number considered relevant for an SLR approach [90].
Based on the SLR results, the second research question—“RQ2. How can organisations integrate Generative Artificial Intelligence capabilities into information systems to develop the skills of accounting and auditing professionals?”—redirected the scientific investigation to detect the consequences of the GenAI systems adoption on the competencies’ development of accounting and auditing professionals and their assistance needs in current activities and decision-making processes. This effort finally resulted in developing a framework for integrating a GenAI-based system into the organisational environment. The sources considered relevant for the topic, and the main results extracted and harnessed in the construction of the proposed model were presented in Table 4, Table 5 and Table 6, as in [91,92].
The tables presenting the main sources and findings selected for the study were organised by the search method used and arranged from the most recent to the oldest. Table 4 is more focused on our topics of AI/Gen AI adoption in the AA field, the need for AA professionals for new skills and competencies, the associated risks and the deduced research gaps.
Table 5 highlights a selection of the sources providing more technical findings related to LLM-based GenAI tools.
Table 6 lists the publications issued by international and national professional standard-setting bodies. These publications were reviewed to identify the core competencies and gaps resulting from the integration of emerging technologies in the AA domain. Five additional reports were included to demonstrate findings related to the AI-enhanced market for AA services, its impact on productivity and AI-related strategies for upskilling staff.

4. Results

To answer the first research question, we identified in the academic literature a set of core competencies for using GenAI in accounting and auditing, and we structured them into two categories:
  • Cross-disciplinary skills:
    -
    digital skills (data analytics skills, skills in extracting, managing and centralising the datasets provided to the system) [49,52,55];
    -
    prompt engineering skills (train the AI according to specific user needs) [37,78];
    -
    soft skills (communication and motivational capabilities, a holistic understanding of processes, project management skills [78], sceptical thinking and problem-solving) [58,59].
  • Profession-specific competencies:
    -
    transformation of accounting science on report creation, interpretation and authentication [6];
    -
    analysing historical internal structured data, collecting and selecting the data used for valuation [78];
    -
    forecasting and making audit decisions [25];
    -
    risk identification, risk assessment and risk mitigation [78];
    -
    the preparation of reporting elements; good accounting and business ethics knowledge; understanding of how the AI makes its decisions; supporting the management team in strategic planning and investment decisions [78].
In line with the trend of new disruptive technologies, the scientific literature highlights the growing need for advanced technical skills in the accounting and auditing profession, as opposed to the competencies frameworks established by professional accounting bodies (PABs). Looking ahead, it seems necessary for the PABs to update the competence of their underlying frameworks.
Analysing the context of using GenAI in the accounting and audit field, the main risks identified in the reviewed literature are the following:
-
deskilling risks and their effects [82,83];
-
model and bias risk [80];
-
risks associated with the security of accounting information [84];
-
risks related to AI-automated accounting functions [63];
-
unethical, racist and sexist content generation by LLMs [81].
Considering the second research question, corroborating the literature review results, a framework was developed for integrating LLM-based GenAI systems with the IT systems of organisations providing accounting and auditing services. This approach aims to increase organisational performance by (1) automating repetitive tasks; (2) identifying anomalies, inconsistencies and potential risks in accounting records; (3) streamlining decision-making by providing data, information and predictive analyses; (4) continuously monitoring and complying with current accounting and auditing regulations; (5) developing organisational memory and improving organisational learning.
Although there are papers that have discussed the design of effective generative AI systems, such as [93], which proposed a GenAI conversational system model for pedagogical purposes, or [94], focusing on designing LLM-based agents for facilitating discussions, we have not encountered specific studies proposing a framework for effectively integrating generative artificial intelligence in accounting and auditing.

4.1. Framework for Integrating LLM-Based Internal GenAI System

The proposed model builds upon research conducted by [27,33,96,97,98], in the field of integrating GenAI in various domains. This research is supported by the engineered prompting and fine-tuning techniques analysed and described by [35,36,37,38]. It also incorporates Floridi’s research [43] on AI-type inter-system communication (AI2AI) and Piktus’s research [44] on combining the capabilities of LLM-based systems with external data sources. These contributions helped define some of the framework’s main components.
The core element of our framework for integrating GenAI into the accounting and auditing field, the Knowledge Consolidator, plays a pivotal role in an LLM-based system. This component is an original contribution designed to continuously consult both external (websites, public or private databases, etc.) and internal (databases, data repositories, organisational memory, etc.) data sources. The need to integrate the Knowledge Consolidator component in the proposed framework is supported by prior research [99,100,101], which investigated the relationship between knowledge generation and AI-based models. Thus, AI can generate knowledge that can improve the reasoning of generative models and their compositional capabilities. In the framework, Knowledge Consolidator is designed to continuously extract and integrate information or knowledge into the System Data Source component, ensuring its relevance and up to date.
Consequently, the LLM-based internal GenAI system has three main components: the Large Language Model (LLM), the System Data Source and the Knowledge Consolidator (Figure 3).
Following user requests, the System Data Source is queried by the LLM, providing answers or executing requested actions.
The way the user interacts with the LLM-based internal GenAI system is as follows:
  • The user addresses a question or requests an action to be performed and, if necessary, provides additional data to refine the context.
  • The system processes the text from the request and analyses any data provided to identify what the user wants or needs to do.
  • If applicable, the system queries internal sources based on the requirements/requests and data provided by the user.
  • Based on the processed text and data provided by the user or information obtained from internal sources using System Data Source, the system generates and displays a response or performs the requested action.
  • The user provides feedback on the system’s response or action, which is used to learn and improve the internal GenAI system’s performance over time by adjusting the processes of understanding, generating responses or taking the required action.

4.2. Extended LLM-Based Internal GenAI System

The framework described (Figure 3) could be further enhanced, resulting in an Extended LLM-based internal GenAI system that includes four main components: Filtering (Security) Layer, Large Language Model (LLM), System Data Source and Knowledge Consolidator (Figure 4). The Knowledge Consolidator component behaves the same way as the original internal LLM-based GenAI system.
The Extended LLM-based internal GenAI system has two major improvements:
  • The Filtering (Security) Layer, whose main role is to ensure the security and confidentiality of internal data and not to allow data and information to be transmitted externally by filtering queries and data transmitted outside the organisation. Considering that a significant part of the data managed by accountants and auditors is sensitive or confidential, it is mandatory to implement a filtering layer that prevents intentional or accidental transmission outside the internal system.
  • Continuous interaction with other LLM-based GenAI systems to improve the quality of the provided answers. This interaction enriches and extends the System Data Source by incorporating data from these systems.
Following user requests, the LLM queries the system data source and other LLM-based GenAI systems to provide answers or execute requested actions.
The way the system interacts with the user is as follows:
  • The user addresses a question or requests an action to be performed, possibly providing data to the system.
  • The system processes the user request and any related data.
  • The Filtering (Security) Layer performs filtering of it and of data provided by the user, sending to the LLM component two requests:
    (i)
    a prompt containing the request and the data submitted by the user that will be used to consult the system’s data sources as well as internal and external sources;
    (ii)
    a prompt in which any confidential elements and data provided by the user have been removed from the request.
  • To understand the context of the user’s request, the extended LLM-based internal GenAI system analyses related data provided by several advanced techniques.
  • If necessary, the system formulates a request to internal or external sources based on the requirements and data provided by the user.
  • The system consults in parallel:
    (i)
    System Data Source based on processed text and user-supplied data.
    (ii)
    Internal or external sources.
    (iii)
    Other external LLM-based GenAI systems based on text processed and filtered by the Filtering (Security) Layer component. These systems can be public or non-public. Non-public systems can be accessed based on an inter-organisational cooperation agreement and represent a component of the learning process through exchanging knowledge, experience and resources.
  • The system generates and displays a response or performs the requested action.
  • The user provides feedback on the response received from the system or the undertaken action, which is used for learning and improving the performance of the internal system over time by adjusting the processes of understanding, generating responses or taking the required action. Depending on the organisation’s policy, the system may also provide feedback to the consulted external LLM-based GenAI systems.
Figure 5 shows the process of using (modus operandi) the LLM-based internal GenAI system in terms of the competencies leveraged and knowledge gained. The response returned by the system will be subject to a content check and analysed by the person using it. Professional judgement will be the key competence to detect certain anomalies or vulnerabilities in the output. At this stage, the same set of profession-specific competencies will be called upon [70,71,72,73,74], coupled with others which fall within the sphere of personal cognitive skills, such as critical thinking [58]. Also, in the category of cognitive competencies, the ability to recognise and be aware of the risks associated with the results obtained [79,84,86] will enable the accountant or auditor to qualify them as acceptable or inappropriate. The use of Chain-of-Thoughts and Role-Playing techniques [40,41] in the prompting stage can have positive effects in increasing the relevance of GenAI system responses to user expectations.
The validation stage of the outputs provided by the system can result in either accepting the answer or refining the prompt and restarting the process [37]. In the latter case, the LLM will receive feedback concerning why the response cannot be considered acceptable. The new knowledge generated by the LLM-based system will be capitalised and can form an important basis for developing employees’ professional skills and competencies.

5. Discussion

Although GenAI is attracting interest from researchers and practitioners because of its vast potential to revolutionise lifelong learning and competencies development, only a few studies are addressing how to integrate GenAI into accounting and auditing. Integrating LLM-based GenAI into organisational information systems is a novel element that contributes to the accounting and auditing research field. This framework enables human-machine collaborations, focusing on AA professionals’ competencies, upskilling and reskilling and fostering a culture of continuous learning.

5.1. An Explanatory Scenario

To help readers better understand the proposed framework outlined above, we will illustrate its underlying functional logic with a descriptive example of a hypothetical financial audit mission.
The Audit Services is a company that provides financial audit services. During the audit mission, daily, each team member enters relevant data and information into the internal system. After the completion of the mission, a meeting is scheduled to discuss the main issues encountered and how they were solved. The relevant data, information and knowledge are recorded in the internal system. On the other hand, the company has a tool (Knowledge Consolidator) that continuously performs three main tasks: (1) collects data from the internet (online databases, news sites, competitors’ sites, social media and other relevant portals); (2) extracts and transforms data, information and knowledge from the internal system; and (3) feeds data sources into the system based on the results of (1) and (2). At the same time, the company has some agreements with other companies in different industries to interconnect their LLM-based GenAI external systems to enhance the capabilities of the internal GenAI system.
A new audit mission has been started for Best Transport Services that provides domestic and international transportation services by trucks. Helen (one of the team leaders of the audit mission) will formulate a few questions to addressed in the GenAI system. The first question may be, “What are the sensitive issues in auditing a company from the transportation area?”. The system will query the system’s data source and communicate with the other LLM-based GenAI external systems to provide the best answers to the question. Based on the answer received, Helen will further address two questions: “Has the Best Transport Services been involved in major road events in the last year?”, “How many transport vehicles have been insured in the last year?”. Assuming the answers were “Best Transport Services has been involved in two major events, both abroad” and “Best Transport Services has insured 59 trucks”, Helen can require more data and documents related to these events, and, on the other hand, she can ask for more data on the company’s transport vehicle insurance process, insurance policies and payments to insurance companies.
In the pre-audit stage, Helen receives from the transport company the set of financial documents for the audited period in electronic format (many of them in datasheet format). Since the quality of the training data heavily influences the outputs, she organises them into datasets with financial significance that she will use in the LLM-based GenAI system training process. Helen will ask the LLM-based GenAI system what correlations can be identified between the analysed incidents and the company’s operational activity regarding costs and possible reductions in orders from clients. By analysing the reasoning used and provided by the GenAI system based on the LLM, Helen will remove the inconclusive results by leveraging her expertise in the audit field. Helen will use fine-tuning techniques to address in-depth questions about specific aspects. This will involve highlighting various data sources (internal and/or external) such as insurance prices, the bonus-malus system of partner insurance companies, the history of previous incidents or similar situations at companies in the same field of activity. The system will be able to identify new correlations and provide conclusions in the analysed case. At the same time, Helen will enter the final audit report into the system along with relevant feedback regarding the information received from the GenAI system. Building this knowledge base will allow the system to handle future queries on similar matters more effectively.
Figure 6 illustrates the described scenario using a Business Process Modeling and Notation (BPMN) diagram to help understand how the LLM-based GenAI integrates in the hypothetical financial audit mission.

5.2. Benefits of Integrating LLM-Based GenAI Systems in Developing Competencies for Accounting and Audit Professionals

According to McKinsey (2023) [95], the impact of GenAI on productivity has the potential to generate the equivalent from USD 2.6 trillion to USD 4.4 trillion annually and increase the impact of artificial intelligence by 15–40 percent.
Leveraging the proposed framework, it is possible to build an internal GenAI system based on LLM, which fulfils a dual role: (1) redefining how AA professionals can acquire new knowledge and develop necessary skills and (2) assisting them in their current professional activities and during decision-making processes.

5.2.1. Redefining How AA Professionals Can Acquire New Knowledge and Develop Necessary Skills

GenAI has the potential to determine the increase in labour productivity [95], which is significantly influenced by employees’ learning and development [102]. Among the benefits offered by the internal GenAI system in the process of learning and development of employees’ skills are:
  • Providing personalised learning pathways following the analysis of each employee’s KSA, learning preferences and career goals [103,104,105].
  • Preparation of learning materials by reviewing a significant volume of internal and external resources and selecting those relevant to each employee [106].
  • Adaptive learning, by dynamically adjusting the difficulty level and pace of presentation of learning materials according to the learner’s progress and performance [107], which can lead to a stimulation of the creativity of each employee [104].
  • Assessing employees’ skills and knowledge by various means, providing timely and actionable feedback on performance [104,108]. Because feedback supports learning achievement [104], it is a huge benefit for employees to receive valuable and timely feedback.
  • Virtual coaching and mentoring throughout the learning process (interactive conversations and simulations that allow employees to practice and hone their skills) [109,110]. In 2012, the McKinsey Global Institute (MGI) estimated that knowledge workers spent about 20% of their time to search and to gather information [95]. GenAI’s support can drastically reduce this time, followed by a significant increase in employee efficiency and effectiveness.
  • Continuous learning and knowledge capitalisation by facilitating the exchange of information, best practices and lessons learned, enriching organisational memory [111,112].
On the other hand, there are concerns regarding the propagation of misinformation by GenAI systems [105,113], continuous monitoring of the answers provided by the GenAI system and the feedback provided by the employees is mandatory.

5.2.2. Assisting Current Activities and Decision-Making Processes

The benefits of targeted GenAI systems converge towards:
  (i).
Information retrieval and synthesis based on employee’s expertise and requirements [110].
 (ii).
Assistance during the decision-making process [114], while, at the same time, allowing for transparency (GenAI system’s decision-making process is visible to employees) and explainability (GenAI system’s decisions are easy to understand by employees) [115].
(iii).
Collaboration and communication across the organisation, fostering a collaborative environment [116].
(iv).
Automation and support for routine/repetitive tasks, assistance, recommendations and suggestions [111].
This study has several limitations worth noting. Due to the paper topic’s novelty, the sample of academic articles obtained from the search in the WoS database was not as extensive as expected. In addition, searching the literature sources, choosing terms in the search string and using exclusion criteria were based on subjective assessments and carry the risk of not identifying all relevant publications. Future research should consider increasing the sample size for more reliable and generalisable results.
Moreover, the reviewed papers on the GenAI topic focus mainly on the technical aspects of this disruptive technology. While this is valuable for understanding the fundamental principles of LLM-based system components, a potential limitation is the absence of information regarding their real-world implementation and outcomes.

6. Conclusions

The labour market is continuously adapting to changes in the business environment, looking for professionals with skills appropriate to the diversified contexts generated by AI technologies in organisations. The literature review analysis confirms a demand for new skills in the AA labour market. Research on the competencies needed by accounting and audit (AA) professionals has examined academic and technological perspectives, focusing on the skills required for graduates and the impact of AI/GenAI technologies on the labour market [77].
The integrative approach of GenAI technology in accounting and auditing represents an original contribution to the body of knowledge with theoretical and practical implications. Based on the proposed framework, an internal LLM-based GenAI system can, in our opinion, support AA professionals by reshaping the way they acquire knowledge and skills and assisting them in their professional activities and decision-making processes. It can improve analytical understanding and awareness of how GenAI can work with the accounting and auditing profession, representing, in our view, a starting point in integrating this innovative technology into operational and decision-support activities.
On the theoretical side, the study provides insights into the requirements for new skills accountants and auditors need to leverage GenAI technologies in their professional work. Equally, the elements of the framework for integrating GenAI can be adapted to the specific contexts of related (tax, valuation, business analysis) or different areas. The paper also brings to the fore the benefits of lifelong learning, which converge towards developing competencies by capitalising on the knowledge resulting from the use of GenAI at the organisational level. The practical implications of the research are positioned in the accounting–auditing–GenAI confluence area. The proposed framework offers insight into the complexity and nature of GenAI technology, as well as the skills required to manage it.
Answering the first research question, the paper reveals the necessity for professional training of staff to develop competencies aimed at (i) elaborating effective prompts for information, (ii) interpreting answers, (iii) awareness and correct treatment of the risks involved and (iv) reconfiguring the role of technical and social competencies that AA professionals could use in specific or decision-making activities, compared to other competencies considered so far as a priority.
Upcoming research could study the discrepancies between the demand and supply of competencies related to the accounting and auditing professions in the GenAI integration context. Equally, modelling organisational learning tools dedicated to the accountability of AA professionals regarding the risks associated with the GenAI use may raise the interest of both researchers and practitioners in the future. Furthermore, developing new domain ontologies, with the capability to integrate and leverage the results of the LLM-based GenAI system and to systematically enrich organisational acquis, could constitute another direction of future research. Such tools could ensure a meaningful knowledge base for daily operations and a real-time platform for continuous learning for both young professionals and experienced specialists in the accounting and audit area.

Author Contributions

Conceptualization, I.-F.A.-P., M.V., L.-E.A.-P., I.-D.C. and C.-G.T.; methodology, M.V. and L.-E.A.-P.; resources, I.-F.A.-P., M.V., L.-E.A.-P., I.-D.C. and C.-G.T.; writing—original draft preparation, I.-F.A.-P., M.V., L.-E.A.-P., I.-D.C. and C.-G.T.; writing—review and editing, I.-F.A.-P., M.V., L.-E.A.-P., I.-D.C. and C.-G.T.; supervision, I.-F.A.-P. and C.-G.T. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Data are contained within the article. The original contributions presented in the study are included in the article, further inquiries can be directed to the corresponding author/s.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Al-Hattami, H.M. University Accounting Curriculum, IT, and Job Market Demands: Evidence From Yemen. Sage Open 2021, 11, 215824402110071. [Google Scholar] [CrossRef]
  2. Tavares, M.C.; Azevedo, G.; Marques, R.P.; Bastos, M.A. Challenges of Education in the Accounting Profession in the Era 5.0: A Systematic Review. Cogent Bus. Manag. 2023, 10, 2220198. [Google Scholar] [CrossRef]
  3. Grosu, V.; Cosmulese, C.G.; Socoliuc, M.; Ciubotariu, M.-S.; Mihaila, S. Testing Accountants’ Perceptions of the Digitization of the Profession and Profiling the Future Professional. Technol. Forecast. Soc. Chang. 2023, 193, 122630. [Google Scholar] [CrossRef]
  4. Jackson, D.; Michelson, G.; Munir, R. Developing Accountants for the Future: New Technology, Skills, and the Role of Stakeholders. Account. Educ. 2023, 32, 150–177. [Google Scholar] [CrossRef]
  5. Zhao, J.; Wang, X. Unleashing Efficiency and Insights: Exploring the Potential Applications and Challenges of ChatGPT in Accounting. J. Corp. Account. Financ. 2024, 35, 269–276. [Google Scholar] [CrossRef]
  6. Friedrich, M.P.A.; Zanievicz, M.; Cadorna Venturini, J.; Eduardo Schuster, W. Epistemological thinking about accounting in the era of artificial intelligence. Rev. Gestão Organ. 2022, 15, 180–197. [Google Scholar] [CrossRef]
  7. Munoko, I.; Brown-Liburd, H.L.; Vasarhelyi, M. The Ethical Implications of Using Artificial Intelligence in Auditing. J. Bus. Ethics 2020, 167, 209–234. [Google Scholar] [CrossRef]
  8. Kommunuri, J. Artificial Intelligence and the Changing Landscape of Accounting: A Viewpoint. Pac. Account. Rev. 2022, 34, 585–594. [Google Scholar] [CrossRef]
  9. Fotoh, L.E.; Lorentzon, J.I. The Impact of Digitalization on Future Audits. J. Emerg. Technol. Account. 2021, 18, 77–97. [Google Scholar] [CrossRef]
  10. Mordor Intelligence. AI In Accounting Market Size & Share Analysis—Growth Trends & Forecasts (2024–2029); 2024. Available online: https://www.mordorintelligence.com/industry-reports/artificial-intelligence-in-accounting-market (accessed on 20 March 2024).
  11. Vasarhelyi, M.A.; Moffitt, K.C.; Stewart, T.; Sunderland, D. Large Language Models: An Emerging Technology in Accounting. J. Emerg. Technol. Account. 2023, 20, 1–10. [Google Scholar] [CrossRef]
  12. Rawashdeh, A. A Deep Learning-Based SEM-ANN Analysis of the Impact of AI-Based Audit Services on Client Trust. J. Appl. Account. Res. 2023, 25, 594–622. [Google Scholar] [CrossRef]
  13. Han, H.; Shiwakoti, R.K.; Jarvis, R.; Mordi, C.; Botchie, D. Accounting and Auditing with Blockchain Technology and Artificial Intelligence: A Literature Review. Int. J. Account. Inf. Syst. 2023, 48, 100598. [Google Scholar] [CrossRef]
  14. Zhang, C.; Zhu, W.; Dai, J.; Wu, Y.; Chen, X. Ethical Impact of Artificial Intelligence in Managerial Accounting. Int. J. Account. Inf. Syst. 2023, 49, 100619. [Google Scholar] [CrossRef]
  15. Aldredge, M.; Rogers, C.; Smith, J. The Strategic Transformation of Accounting into a Learned Profession. Ind. High. Educ. 2021, 35, 83–88. [Google Scholar] [CrossRef]
  16. Vărzaru, A.A. Assessing Artificial Intelligence Technology Acceptance in Managerial Accounting. Electron. 2022, 11, 2256. [Google Scholar] [CrossRef]
  17. Nguyen, T.-M.; Malik, A. Impact of Knowledge Sharing on Employees’ Service Quality: The Moderating Role of Artificial Intelligence. Int. Mark. Rev. 2022, 39, 482–508. [Google Scholar] [CrossRef]
  18. Korzynski, P.; Mazurek, G.; Altmann, A.; Ejdys, J.; Kazlauskaite, R.; Paliszkiewicz, J.; Wach, K.; Ziemba, E. Generative Artificial Intelligence as a New Context for Management Theories: Analysis of ChatGPT. Cent. Eur. Manag. J. 2023, 31, 3–13. [Google Scholar] [CrossRef]
  19. Al-Htaybat, K.; von Alberti-Alhtaybat, L.; Alhatabat, Z. Educating Digital Natives for the Future: Accounting Educators’ Evaluation of the Accounting Curriculum. Account. Educ. 2018, 27, 333–357. [Google Scholar] [CrossRef]
  20. Rodgers, W.; Al-Shaikh, S.; Khalil, M. Protocol Analysis Data Collection Technique Implemented for Artificial Intelligence Design. IEEE Trans. Eng. Manag. 2024, 71, 6842–6853. [Google Scholar] [CrossRef]
  21. Chen, B.; Wu, Z.; Zhao, R. From Fiction to Fact: The Growing Role of Generative AI in Business and Finance. J. Chin. Econ. Bus. Stud. 2023, 21, 471–496. [Google Scholar] [CrossRef]
  22. Al Naqbi, H.; Bahroun, Z.; Ahmed, V. Enhancing Work Productivity through Generative Artificial Intelligence: A Comprehensive Literature Review. Sustainability 2024, 16, 1166. [Google Scholar] [CrossRef]
  23. OECD Recommendation of the Council on OECD Legal Instruments Artificial Intelligence. 2019. Available online: https://oecd.ai/en/ai-principles (accessed on 10 June 2024).
  24. Arrieta, A.B.; Díaz-Rodríguez, N.; Del Ser, J.; Bennetot, A.; Tabik, S.; Barbado, A.; Garcia, S.; Gil-Lopez, S.; Molina, D.; Benjamins, R.; et al. Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI. Inf. Fusion 2020, 58, 82–115. [Google Scholar] [CrossRef]
  25. Li, Q.; Liu, J. Development of an Intelligent NLP-Based Audit Plan Knowledge Discovery System. J. Emerg. Technol. Account. 2020, 17, 89–97. [Google Scholar] [CrossRef]
  26. Jovanovic, M.; Campbell, M. Generative Artificial Intelligence: Trends and Prospects. Computer 2022, 55, 107–112. [Google Scholar] [CrossRef]
  27. Yu, P.; Xu, H.; Hu, X.; Deng, C. Leveraging Generative AI and Large Language Models: A Comprehensive Roadmap for Healthcare Integration. Healthcare 2023, 11, 2776. [Google Scholar] [CrossRef] [PubMed]
  28. Lim, W.M.; Gunasekara, A.; Pallant, J.L.; Pallant, J.I.; Pechenkina, E. Generative AI and the Future of Education: Ragnarök or Reformation? A Paradoxical Perspective from Management Educators. Int. J. Manag. Educ. 2023, 21, 100790. [Google Scholar] [CrossRef]
  29. Dwivedi, Y.K.; Kshetri, N.; Hughes, L.; Slade, E.L.; Jeyaraj, A.; Kar, A.K.; Baabdullah, A.M.; Koohang, A.; Raghavan, V.; Ahuja, M.; et al. Opinion Paper: “So What If ChatGPT Wrote It?” Multidisciplinary Perspectives on Opportunities, Challenges and Implications of Generative Conversational AI for Research, Practice and Policy. Int. J. Inf. Manag. 2023, 71, 102642. [Google Scholar] [CrossRef]
  30. Sahoo, S.; Kumar, S.; Abedin, M.Z.; Lim, W.M.; Jakhar, S.K. Deep Learning Applications in Manufacturing Operations: A Review of Trends and Ways Forward. J. Enterp. Inf. Manag. 2023, 36, 221–251. [Google Scholar] [CrossRef]
  31. Victor, B.G.; Sokol, R.L.; Goldkind, L.; Perron, B.E. Recommendations for Social Work Researchers and Journal Editors on the Use of Generative AI and Large Language Models. J. Soc. Soc. Work Res. 2023, 14, 563–577. [Google Scholar] [CrossRef]
  32. Ooi, K.-B.; Tan, G.W.-H.; Al-Emran, M.; Al-Sharafi, M.A.; Capatina, A.; Chakraborty, A.; Dwivedi, Y.K.; Huang, T.-L.; Kar, A.K.; Lee, V.-H.; et al. The Potential of Generative Artificial Intelligence Across Disciplines: Perspectives and Future Directions. J. Comput. Inf. Syst. 2023, 1–32. [Google Scholar] [CrossRef]
  33. Khan, M.S.; Umer, H. ChatGPT in Finance: Applications, Challenges, and Solutions. Heliyon 2024, 10, e24890. [Google Scholar] [CrossRef]
  34. Dowling, M.; Lucey, B. ChatGPT for (Finance) Research: The Bananarama Conjecture. Financ. Res. Lett. 2023, 53, 103662. [Google Scholar] [CrossRef]
  35. Lv, K.; Yang, Y.; Liu, T.; Gao, Q.; Guo, Q.; Qiu, X. Full Parameter Fine-Tuning for Large Language Models with Limited Resources. arXiv 2023, arXiv:2306.09782. [Google Scholar] [CrossRef]
  36. Trad, F.; Chehab, A. Prompt Engineering or Fine-Tuning? A Case Study on Phishing Detection with Large Language Models. Mach. Learn. Knowl. Extr. 2024, 6, 367–384. [Google Scholar] [CrossRef]
  37. White, J.; Fu, Q.; Hays, S.; Sandborn, M.; Olea, C.; Gilbert, H.; Elnashar, A.; Spencer-Smith, J.; Schmidt, D.C. A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT. arXiv 2023, arXiv:2302.11382. [Google Scholar] [CrossRef]
  38. Căliman, A.; Pop, M. Today Software Magazine; 2024. Available online: https://www.todaysoftmag.ro/article/4038/strategii-pentru-o-inginerie-eficienta-a-prompturilor (accessed on 10 June 2024).
  39. Kong, A.; Zhao, S.; Chen, H.; Li, Q.; Qin, Y.; Sun, R.; Zhou, X.; Wang, E.; Dong, X. Better Zero-Shot Reasoning with Role-Play Prompting. arXiv 2023, arXiv:2308.07702. [Google Scholar] [CrossRef]
  40. Wei, J.; Wang, X.; Schuurmans, D.; Bosma, M.; Ichter, B.; Xia, F.; Chi, E.; Le, Q.; Zhou, D. Chain-of-Thought Prompting Elicits Reasoning in Large Language Models. arXiv 2022, arXiv:2201.11903. [Google Scholar] [CrossRef]
  41. Miao, J.; Thongprayoon, C.; Suppadungsuk, S.; Krisanapan, P.; Radhakrishnan, Y.; Cheungpasitporn, W. Chain of Thought Utilization in Large Language Models and Application in Nephrology. Med (B Aires) 2024, 60, 148. [Google Scholar] [CrossRef] [PubMed]
  42. Masikisiki, B.; Marivate, V.; Hlophe, Y. Investigating the Efficacy of Large Language Models in Reflective Assessment Methods through Chain of Thought Prompting. In Proceedings of the 4th African Human Computer Interaction Conference, East London South Africa, 27 November 2023; ACM: New York, NY, USA, 2023; pp. 44–49. [Google Scholar]
  43. Floridi, L. AI as Agency Without Intelligence: On ChatGPT, Large Language Models, and Other Generative Models. Philos. Technol. 2023, 36, 15. [Google Scholar] [CrossRef]
  44. Piktus, A. Online Tools Help Large Language Models to Solve Problems through Reasoning. Nature 2023, 618, 465–466. [Google Scholar] [CrossRef]
  45. Cardy, R.L.; Selvarajan, T.T. Competencies: Alternative Frameworks for Competitive Advantage. Bus. Horiz. 2006, 49, 235–245. [Google Scholar] [CrossRef]
  46. McClelland, D.C. Testing for Competence Rather than for “Intelligence”. Am. Psychol. 1973, 28, 1–14. [Google Scholar] [CrossRef]
  47. Boyatzis, R. The Competent Manager; Wiley: Hoboken, NJ, USA, 1982. [Google Scholar]
  48. The Alan Turing Institute. AI Skills for Business Competency Framework Https://Www.Turing.Ac.Uk/Skills/Collaborate/Ai-Skills-Business-Framework; The Alan Turing Institute: London, UK, 2023. [Google Scholar]
  49. Andreassen, R.-I. Digital Technology and Changing Roles: A Management Accountant’s Dream or Nightmare? J. Manag. Control 2020, 31, 209–238. [Google Scholar] [CrossRef]
  50. Ng, C. Teaching Advanced Data Analytics, Robotic Process Automation, and Artificial Intelligence in a Graduate Accounting Program. J. Emerg. Technol. Account. 2023, 20, 223–243. [Google Scholar] [CrossRef]
  51. Moore, W.B.; Felo, A. The Evolution of Accounting Technology Education: Analytics to STEM. J. Educ. Bus. 2022, 97, 105–111. [Google Scholar] [CrossRef]
  52. Meredith, K.; Blake, J.; Baxter, P.; Kerr, D. Drivers of and Barriers to Decision Support Technology Use by Financial Report Auditors. Decis. Support. Syst. 2020, 139, 113402. [Google Scholar] [CrossRef]
  53. Salijeni, G.; Samsonova-Taddei, A.; Turley, S. Big Data and Changes in Audit Technology: Contemplating a Research Agenda. Account. Bus. Res. 2019, 49, 95–119. [Google Scholar] [CrossRef]
  54. Mathisen, A.; Nerland, M. The Pedagogy of Complex Work Support Systems: Infrastructuring Practices and the Production of Critical Awareness in Risk Auditing. Pedagog. Cult. Soc. 2012, 20, 71–91. [Google Scholar] [CrossRef]
  55. Mancini, D.; Lombardi, R.; Tavana, M. Four Research Pathways for Understanding the Role of Smart Technologies in Accounting. Meditari Account. Res. 2021, 29, 1041–1062. [Google Scholar] [CrossRef]
  56. Noordin, N.A.; Hussainey, K.; Hayek, A.F. The Use of Artificial Intelligence and Audit Quality: An Analysis from the Perspectives of External Auditors in the UAE. J. Risk Financ. Manag. 2022, 15, 339. [Google Scholar] [CrossRef]
  57. Mat Ridzuan, N.I.; Said, J.; Razali, F.M.; Abdul Manan, D.I.; Sulaiman, N. Examining the Role of Personality Traits, Digital Technology Skills and Competency on the Effectiveness of Fraud Risk Assessment among External Auditors. J. Risk Financ. Manag. 2022, 15, 536. [Google Scholar] [CrossRef]
  58. Plumlee, R.D.; Rixom, B.A.; Rosman, A.J. Training Auditors to Perform Analytical Procedures Using Metacognitive Skills. Account. Rev. 2015, 90, 351–369. [Google Scholar] [CrossRef]
  59. Andiola, L.M.; Downey, D.H.; Earley, C.E.; Jefferson, D. Wealthy Watches Inc.: The Substantive Testing of Accounts Receivable in the Evolving Audit Environment. Issues Account. Educ. 2022, 37, 37–51. [Google Scholar] [CrossRef]
  60. Jemine, G.; Puyou, F.-R.; Bouvet, F. Technological Innovation and the Co-Production of Accounting Services in Small Accounting Firms. Account. Audit. Account. J. 2024, 37, 280–305. [Google Scholar] [CrossRef]
  61. Westermann, K.D.; Bedard, J.C.; Earley, C.E. Learning the “Craft” of Auditing: A Dynamic View of Auditors’ On-the-Job Learning. Contemp. Account. Res. 2015, 32, 864–896. [Google Scholar] [CrossRef]
  62. Aldemİr, C.; Uçma Uysal, T. AI COMPETENCIES FOR INTERNAL AUDITORS IN THE PUBLIC SECTOR. Edpacs 2024, 69, 3–21. [Google Scholar] [CrossRef]
  63. Norzelan, N.A.; Mohamed, I.S.; Mohamad, M. Technology Acceptance of Artificial Intelligence (AI) among Heads of Finance and Accounting Units in the Shared Service Industry. Technol. Forecast. Soc. Change 2024, 198, 123022. [Google Scholar] [CrossRef]
  64. Cardon, P.; Fleischmann, C.; Logemann, M.; Heidewald, J.; Aritz, J.; Swartz, S. Competencies Needed by Business Professionals in the AI Age: Character and Communication Lead the Way. Bus. Prof. Commun. Q. 2023, 27, 223–246. [Google Scholar] [CrossRef]
  65. Dean, S.A.; East, J.I. Soft Skills Needed for the 21st-Century Workforce. Int. J. Appl. Manag. Technol. 2019, 18, 17–32. [Google Scholar] [CrossRef]
  66. Duff, A.; Hancock, P.; Marriott, N. The Role and Impact of Professional Accountancy Associations on Accounting Education Research: An International Study. Br. Account. Rev. 2020, 52, 100829. [Google Scholar] [CrossRef]
  67. Timpson, M.; Bayerlein, L. Accreditation without Impact: The Case of Accreditation by Professional Accounting Bodies in Australia. Aust. Account. Rev. 2021, 31, 22–34. [Google Scholar] [CrossRef]
  68. IFAC. 2024. Available online: https://www.ifac.org/who-we-are/our-purpose (accessed on 10 June 2024).
  69. Andon, P.; Clune, C. Governance of Professional Accounting Bodies: A Comparative Analysis. Account. Audit. Account. J. 2021, 34, 1769–1801. [Google Scholar] [CrossRef]
  70. ICAEW; ACA. Qualification Professional Development Ladders. 2018. Available online: https://www.icaew.com/-/media/corporate/files/for-current-aca-students/training-agreement/professional-development-overview.ashx (accessed on 10 June 2024).
  71. ACCA. ACCA Competency Framework. 2020. Available online: https://www.accaglobal.com/content/dam/ACCA_Global/qual/competencyframework/ACCA-competency-framework-how-and-when-to-use-2020.pdf (accessed on 10 June 2024).
  72. AICPA; CIMA; CGMA. Competency Framework. 2022. Available online: https://us.aicpa.org/content/dam/cgma/resources/tools/downloadabledocuments/cgma-competency-framework.pdf (accessed on 10 June 2024).
  73. ICAS. ICAS Mapping Our New Competencies. 2023. Available online: https://www.icas.com/__data/assets/pdf_file/0005/617018/RPE-Timeline-and-Competencies_21-08-23.pdf (accessed on 10 June 2024).
  74. IMA. IMA Management Accounting Competency Framework. 2023. Available online: https://prodcm.imanet.org/-/media/IMA/Files/Home/Career-Resources/Management-Accounting-Competencies/IMA-Framework-11-28-23.ashx (accessed on 10 June 2024).
  75. Thottoli, M.M. Leveraging Information Communication Technology (ICT) and Artificial Intelligence (AI) to Enhance Auditing Practices. Account. Res. J. 2024, 37, 134–150. [Google Scholar] [CrossRef]
  76. Burns, M.B.; Igou, A. “Alexa, Write an Audit Opinion”: Adopting Intelligent Virtual Assistants in Accounting Workplaces. J. Emerg. Technol. Account. 2019, 16, 81–92. [Google Scholar] [CrossRef]
  77. Kroon, N.; do Céu Alves, M.; Martins, I. The Impacts of Emerging Technologies on Accountants’ Role and Skills: Connecting to Open Innovation—A Systematic Literature Review. J. Open Innov. Technol. Mark. Complex. 2021, 7, 163. [Google Scholar] [CrossRef]
  78. Leitner-Hanetseder, S.; Lehner, O.M.; Eisl, C.; Forstenlechner, C. A Profession in Transition: Actors, Tasks and Roles in AI-Based Accounting. J. Appl. Account. Res. 2021, 22, 539–556. [Google Scholar] [CrossRef]
  79. Uscov, S.; Groza, A. Cât de inteligent este Artificial Intelligence Act? Curierul Judic. 2022, 2, 70–83. [Google Scholar]
  80. Schwartz, R.; Vassilev, A.; Greene, K.; Perine, L.; Burt, A.; Hall, P. Towards a Standard for Identifying and Managing Bias in Artificial Intelligence; Special Publication (NIST SP); National Institute of Standards and Technology: Gaithersburg, MD, USA, 2022. [Google Scholar] [CrossRef]
  81. Kirk, H.; Jun, Y.; Iqbal, H.; Benussi, E.; Volpin, F.; Dreyer, F.A.; Shtedritski, A.; Asano, Y.M. Bias Out-of-the-Box: An Empirical Analysis of Intersectional Occupational Biases in Popular Generative Language Models. arXiv 2021, arXiv:2102.04130. [Google Scholar] [CrossRef]
  82. Arnold, V.; Collier, P.A.; Leech, S.A.; Rose, J.M.; Sutton, S.G. Can Knowledge Based Systems Be Designed to Counteract Deskilling Effects? Int. J. Account. Inf. Syst. 2023, 50, 100638. [Google Scholar] [CrossRef]
  83. Samiolo, R.; Spence, C.; Toh, D. Auditor Judgment in the Fourth Industrial Revolution. Contemp. Account. Res. 2024, 41, 498–528. [Google Scholar] [CrossRef]
  84. Zhu, C.; Guan, Y. The Risks and Countermeasures of Accounting Artificial Intelligence. In Proceedings of the 2022 3rd International Conference on Electronic Communication and Artificial Intelligence (IWECAI), Zhuhai, China, 14–16 January 2022; IEEE: Piscataway, NJ, USA, 2022; pp. 358–361. [Google Scholar]
  85. Koreff, J.; Baudot, L.; Sutton, S.G. Exploring the Impact of Technology Dominance on Audit Professionalism through Data Analytic-Driven Healthcare Audits. J. Inf. Syst. 2023, 37, 59–80. [Google Scholar] [CrossRef]
  86. Mökander, J. Auditing of AI: Legal, Ethical and Technical Approaches. Digit. Soc. 2023, 2, 49. [Google Scholar] [CrossRef]
  87. Chen, W.; He, W.; Shen, J.; Tian, X.; Wang, X. Systematic Analysis of Artificial Intelligence in the Era of Industry 4.0. J. Manag. Anal. 2023, 10, 89–108. [Google Scholar] [CrossRef]
  88. Massaro, M.; Dumay, J.; Guthrie, J. On the Shoulders of Giants: Undertaking a Structured Literature Review in Accounting. Account. Audit. Account. J. 2016, 29, 767–801. [Google Scholar] [CrossRef]
  89. Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Akl, E.A.; Brennan, S.E.; et al. The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews. BMJ 2021, 372, n71. [Google Scholar] [CrossRef]
  90. Donthu, N.; Kumar, S.; Mukherjee, D.; Pandey, N.; Lim, W.M. How to Conduct a Bibliometric Analysis: An Overview and Guidelines. J. Bus. Res. 2021, 133, 285–296. [Google Scholar] [CrossRef]
  91. Ndlovu, S.G. Private Label Brands vs National Brands: New Battle Fronts and Future Competition. Cogent Bus. Manag. 2024, 11, 2321877. [Google Scholar] [CrossRef]
  92. Tiron-Tudor, A.; Deliu, D. Big Data’s Disruptive Effect on Job Profiles: Management Accountants’ Case Study. J. Risk Financ. Manag. 2021, 14, 376. [Google Scholar] [CrossRef]
  93. Wölfel, M.; Shirzad, M.B.; Reich, A.; Anderer, K. Knowledge-Based and Generative-AI-Driven Pedagogical Conversational Agents: A Comparative Study of Grice’s Cooperative Principles and Trust. Big Data Cogn. Comput. 2023, 8, 2. [Google Scholar] [CrossRef]
  94. Dong, Y.; Ding, S.; Ito, T. An Automated Multi-Phase Facilitation Agent Based on LLM. IEICE Trans. Inf. Syst. 2024, 107, 426–433. [Google Scholar] [CrossRef]
  95. McKinsey The Economic Potential of Generative AI: The Next Productivity Frontier. 2023. Available online: https://www.mckinsey.com/capabilities/mckinsey-digital/our-insights/the-economic-potential-of-generative-ai-the-next-productivity-frontier (accessed on 10 June 2024).
  96. Nazir, A.; Wang, Z. A Comprehensive Survey of ChatGPT: Advancements, Applications, Prospects, and Challenges. Meta-Radiol. 2023, 1, 100022. [Google Scholar] [CrossRef]
  97. Roumeliotis, K.I.; Tselikas, N.D. ChatGPT and Open-AI Models: A Preliminary Review. Future Internet 2023, 15, 192. [Google Scholar] [CrossRef]
  98. Bansal, G.; Chamola, V.; Hussain, A.; Guizani, M.; Niyato, D. Transforming Conversations with AI—A Comprehensive Study of ChatGPT. Cogn. Comput. 2024. [Google Scholar] [CrossRef]
  99. Seo, J.; Oh, D.; Eo, S.; Park, C.; Yang, K.; Moon, H.; Park, K.; Lim, H. PU-GEN: Enhancing Generative Commonsense Reasoning for Language Models with Human-Centered Knowledge. Knowl. Based Syst. 2022, 256, 109861. [Google Scholar] [CrossRef]
  100. Sumbal, M.S.; Amber, Q. ChatGPT: A Game Changer for Knowledge Management in Organizations. Kybernetes 2024. [Google Scholar] [CrossRef]
  101. Aksamija, A.; Yue, K.; Kim, H.; Grobler, F.; Krishnamurti, R. Integration of Knowledge-Based and Generative Systems for Building Characterization and Prediction. Artif. Intell. Eng. Des. Anal. Manuf. 2010, 24, 3–16. [Google Scholar] [CrossRef]
  102. Orlova, E. Dynamic Regimes for Corporate Human Capital Development Used Reinforcement Learning Methods. Mathematics 2023, 11, 3916. [Google Scholar] [CrossRef]
  103. Mathew, R.; Stefaniak, J.E. A Needs Assessment to Support Faculty Members’ Awareness of Generative AI Technologies to Support Instruction. TechTrends 2024. [Google Scholar] [CrossRef]
  104. Mazzullo, E.; Bulut, O.; Wongvorachan, T.; Tan, B. Learning Analytics in the Era of Large Language Models. Analytics 2023, 2, 877–898. [Google Scholar] [CrossRef]
  105. Lucas, H.C.; Upperman, J.S.; Robinson, J.R. A Systematic Review of Large Language Models and Their Implications in Medical Education. Med. Educ. 2024. [Google Scholar] [CrossRef]
  106. Borah, A.R.; Nischith, T.N.; Gupta, S. Improved Learning Based on GenAI. In Proceedings of the 2024 2nd International Conference on Intelligent Data Communication Technologies and Internet of Things (IDCIoT), Bengaluru, India, 4–6 January 2024; IEEE: Piscataway, NJ, USA, 2024; pp. 1527–1532.
  107. Shimizu, I.; Kasai, H.; Shikino, K.; Araki, N.; Takahashi, Z.; Onodera, M.; Kimura, Y.; Tsukamoto, T.; Yamauchi, K.; Asahina, M.; et al. Developing Medical Education Curriculum Reform Strategies to Address the Impact of Generative AI: Qualitative Study. JMIR Med. Educ. 2023, 9, e53466. [Google Scholar] [CrossRef] [PubMed]
  108. Salinas-Navarro, D.E.; Vilalta-Perdomo, E.; Michel-Villarreal, R.; Montesinos, L. Designing Experiential Learning Activities with Generative Artificial Intelligence Tools for Authentic Assessment. Interact. Technol. Smart Educ. 2024. [Google Scholar] [CrossRef]
  109. Hemachandran, K.; Verma, P.; Pareek, P.; Arora, N.; Rajesh Kumar, K.V.; Ahanger, T.A.; Pise, A.A.; Ratna, R. Artificial Intelligence: A Universal Virtual Tool to Augment Tutoring in Higher Education. Comput. Intell. Neurosci. 2022, 2022, 1410448. [Google Scholar] [CrossRef] [PubMed]
  110. Kramer, L.L.; ter Stal, S.; Mulder, B.C.; de Vet, E.; van Velsen, L. Developing Embodied Conversational Agents for Coaching People in a Healthy Lifestyle: Scoping Review. J. Med. Internet Res. 2020, 22, e14058. [Google Scholar] [CrossRef] [PubMed]
  111. Hendriksen, C. Artificial Intelligence for Supply Chain Management: Disruptive Innovation or Innovative Disruption? J. Supply Chain. Manag. 2023, 59, 65–76. [Google Scholar] [CrossRef]
  112. Cui, Y.G.; van Esch, P.; Phelan, S. How to Build a Competitive Advantage for Your Brand Using Generative AI. Bus. Horiz. 2024, in press. [Google Scholar] [CrossRef]
  113. Perera Molligoda Arachchige, A.S. Large Language Models (LLM) and ChatGPT: A Medical Student Perspective. Eur. J. Nucl. Med. Mol. Imaging 2023, 50, 2248–2249. [Google Scholar] [CrossRef] [PubMed]
  114. Singh, K.; Chatterjee, S.; Mariani, M. Applications of Generative AI and Future Organizational Performance: The Mediating Role of Explorative and Exploitative Innovation and the Moderating Role of Ethical Dilemmas and Environmental Dynamism. Technovation 2024, 133, 103021. [Google Scholar] [CrossRef]
  115. Ferrara, E. Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies. Sci 2023, 6, 3. [Google Scholar] [CrossRef]
  116. Makridakis, S.; Petropoulos, F.; Kang, Y. Large Language Models: Their Success and Impact. Forecasting 2023, 5, 536–549. [Google Scholar] [CrossRef]
Figure 1. Overview of research methodology.
Figure 1. Overview of research methodology.
Electronics 13 02621 g001
Figure 2. PRISMA flow diagram. Adapted from [89].
Figure 2. PRISMA flow diagram. Adapted from [89].
Electronics 13 02621 g002
Figure 3. Framework for integrating an LLM-based internal GenAI system.
Figure 3. Framework for integrating an LLM-based internal GenAI system.
Electronics 13 02621 g003
Figure 4. Framework on the integration of an extended LLM-based internal GenAI system.
Figure 4. Framework on the integration of an extended LLM-based internal GenAI system.
Electronics 13 02621 g004
Figure 5. The correlation between competencies and results for using LLM-based internal GenAI system in accounting and auditing.
Figure 5. The correlation between competencies and results for using LLM-based internal GenAI system in accounting and auditing.
Electronics 13 02621 g005
Figure 6. BPMN diagram for the explanatory scenario.
Figure 6. BPMN diagram for the explanatory scenario.
Electronics 13 02621 g006
Table 1. Synopsis of core competencies.
Table 1. Synopsis of core competencies.
Professional BodyClasses of Competencies
ICAEW (2018)Ethics and professionalism; communication; teamwork; decision-making; problem-solving; adding value; technical competence [70]
ACCA (2020)Ethics and professionalism; data, digital and technology; strategy and innovation; leadership and management; stakeholder relationship management; governance, risk and control; corporate and business reporting; financial management; management accounting; taxation; audit and assurance; advisory and consultancy [71]
AICPA & CIMA (2022)Technical skills; business skills; people skills; leadership skills; digital skills [72]
ICAS (2023)Ethics and integrity; communications; teamwork and leadership; personal effectiveness; problem-solving and decision-making; technical competence [73]
IMA (2023)Strategy, planning and performance; reporting and control; business acumen and operations; technology and analytics; leadership; professional ethics and values [74]
Table 2. Inclusion and exclusion criteria.
Table 2. Inclusion and exclusion criteria.
Criteria TypeReason for Inclusion/Exclusion
Inclusion Criteria(I1) The paper focuses on the need for the AA professional’s competencies in AI/GenAI area (expected or required by the market).
(I2) The paper focuses on the risks regarding AI/GenAI inclusion in AA domain.
(I3) The paper focuses on GenAI/LLM in AA domain.
(I4) The paper is a journal article, conference article or book chapter.
(I5) The paper is published in English.
(I6) The paper is published between 2018 and 2024.
Exclusion Criteria(E1) No full text available.
(E2) The paper does not address/focus on AA professional’s competencies in relation to adopted AI technologies.
(E3) The paper is only loosely related to AI/GenAI competencies for AA domain.
Table 3. Articles WoS by publication year.
Table 3. Articles WoS by publication year.
Year2018201920202021202220232024Total
Papers Number451426294514137
Table 4. Articles selected from the WoS database, included in the final sample.
Table 4. Articles selected from the WoS database, included in the final sample.
ReferenceArticle TitlePublicationMain Findings
Samiolo, et al., 2024 [83]Auditor Judgment in the Fourth Industrial RevolutionContemporary Accounting ResearchSkills-related risks
Norzelan, et al., 2024 [63]Technology Acceptance of Artificial Intelligence (AI) among Heads of Finance and Accounting Units in the Shared Service IndustryTechnological Forecasting and Social ChangeAI acceptance in finance and accounting; risk assessment
Arnold, et al., 2023 [82]Can Knowledge Based Systems Be Designed to Counteract Deskilling Effects?International Journal of Accounting Information SystemsRisks of deskilling; knowledge-based systems implications in supporting accounting professionals
Rawashdeh, 2024 [12]A Deep Learning-Based SEM-ANN Analysis of the Impact of AI-Based Audit Services on Client TrustJournal of Applied Accounting ResearchAI-based audit services, perceived quality, value, attitude, satisfaction and trust
Munoko, et al., 2020 [7]The Ethical Implications of Using Artificial Intelligence in AuditingJournal of Business EthicsAccounting and auditing industry interest in AI adoption
Thottoli, 2024 [75]Leveraging information
communication technology (ICT)
and artificial intelligence (AI) to
enhance auditing practices
Accounting Research JournalPotential benefits and risks associated with AI and information communication technology (ICT) adoption in auditing
Jemine, et al., 2024 [60]Technological innovation and the co-production of accounting services in small accounting firmsAccounting Auditing & Accountability JournalImpact of emerging information technologies onto small accounting firms and professionals’ competencies
Grosu, et al., 2023 [3]Testing accountants’ perceptions of the digitization of the profession and profiling the future professionalTechnological Forecasting and Social ChangeChallenges, knowledge and skills required to face technological evolution
Rodgers, et al., 2023 [20]Protocol Analysis Data Collection Technique Implemented for Artificial Intelligence DesignIEEE Transactions on Engineering ManagementImpact of the lack of an AI framework, IFRS knowledge, and legislation conflict on AA standards implementation; AI-based support for protocol analysis, benefits and designed features
Koreff, et al., 2023 [85]Exploring the Impact of Technology Dominance on Audit Professionalism through Data Analytic-Driven Healthcare AuditsJournal of Information SystemsPotential of AI-enabled data analytic-driven audits tools to alter audit missions and derived concerns for their uncontrolled use by novice-level auditors
Ng, 2023 [50]Teaching Advanced Data Analytics, Robotic Process Automation, and Artificial Intelligence in a Graduate Accounting ProgramJournal of Emerging Technologies in AccountingReshaping skill sets needed in the accounting profession by designing courses that incorporate RPA and AI at a public university (USA)
Kommunuri, 2022 [8]Artificial Intelligence and the Changing Landscape of Accounting: A ViewpointPacific Accounting ReviewThe impact of AI and ML on the accounting skills environment
Andiola, et al., 2022 [59]Wealthy Watches Inc.: The Substantive Testing of Accounts Receivable in the Evolving Audit EnvironmentIssues in Accounting EducationAwareness of technologies used in audit practice; the case of students practicing scepticism and applying professional judgment using AI and RPA tools
Friedrich, et al., 2022 [6]Epistemological Thinking about Accounting in the Era of Artificial IntelligenceRevista Gestao OrganizacionalLinks between accounting science and disruptive technologies; transformation of accounting science on report creation, interpretation and authentication
Fotoh and Lorentzon, 2021 [9]The Impact of Digitalization on Future AuditsJournal of Emerging Technologies in AccountingCompetitivity framework for audit profession; need for new capabilities, skills and business models incorporating digital technologies
Mancini, et al., 2021 [55]Four Research Pathways for Understanding the Role of Smart Technologies in AccountingMeditari Accountancy ResearchMapping KSAs required to manage decision-supporting information by leveraging AI and other new technologies.
Leitner-Hanetseder, et al., 2021 [78]Profession in Transition: Actors, Tasks and Roles in AI-Based AccountingJournal of Applied Accounting ResearchChanges for competencies for accounting professions and “core” roles; AI-based accounting context (mixed AI and human accounting teams).
Kirk, et al., 2021 [81]Bias Out-of-the-Box: An Empirical Analysis of Intersectional Occupational Biases in Popular Generative Language ModelsAdvances in neural information processing systemsRisks of producing unethical, racist and sexist comments
Andreassen, 2020 [49]Digital Technology and Changing Roles: A Management Accountant’s Dream or Nightmare? Journal of Management ControlAccountant new skills
Li and Liu, 2020 [25]Development of an Intelligent NLP-Based Audit Plan Knowledge Discovery SystemJournal of Emerging Technologies in AccountingGenerative Artificial Intelligence overview
Plumlee, et al., 2015 [58]Training Auditors to Perform Analytical Procedures Using Metacognitive SkillsThe Accounting ReviewNew skills required for auditors
Table 5. Selection of articles identified via other methods and some findings relevant to the proposed framework.
Table 5. Selection of articles identified via other methods and some findings relevant to the proposed framework.
ReferenceArticle TitlePublicationMain Findings
Wölfel, et al., 2024 [93]Knowledge-Based and Generative-AI-Driven Pedagogical Conversational Agents: A Comparative Study of Grice’s Cooperative Principles and TrustBig Data and Cognitive ComputingGenerative Language Models (GLMs), PEdagogical conversational Tutor with generative AI component and adaptation
Dong, et al., 2024 [94]An Automated Multi-Phase Facilitation Agent Based on LLMIEICE Transactions on Information and SystemsLLM-based agent implementation; large-scale discussion support systems
Trad and Chehab, 2024 [36]Prompt Engineering or Fine-Tuning? A Case Study on Phishing Detection with Large Language ModelsMachine Learning and Knowledge ExtractionPrompt Engineering process; tailoring LLM to particular tasks
White, et al., 2023 [37]A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTArXivChatGPT; Prompt Engineering
Floridi, 2023 [43]AI as Agency Without Intelligence: On ChatGPT, Large Language Models, and Other Generative Models. Philosophy & TechnologyAI systems, AI2AI interoperability; “Confederated AI”
Piktus, 2023 [44]Online Tools Help Large Language Models to Solve Problems through ReasoningNatureLLM-based systems and external data sources; how to improve LLMs’ output
Wei, et al., 2022 [40]Chain-of-Thought Prompting Elicits Reasoning in Large Language Models International Review of Economics & FinanceChain-of-Thoughts (CoT) prompting-requesting and providing the reasoning steps.
Table 6. Reports published by professional bodies, other research institutes and companies.
Table 6. Reports published by professional bodies, other research institutes and companies.
ReferenceArticle TitleOrganisation NameMain Findings
IMA, 2023 [74]IMA Management Accounting Competency Framework Core competencies considered by each professional body; analysing the gap associated with newly emerging requirements for accountants’ and auditors’ competencies generated by the integration of AI/GenAI/LLM solutions
ICAS, 2023 [73]ICAS Mapping Our New Competencies
AICPA & CIMA, 2022 [72]CGMA Competency Framework
ACCA, 2020 [71]ACCA Competency Framework
ICAEW, 2018 [70]ACA Qualification Professional Development Ladders
Mordor Intelligence, 2024 [10]AI In Accounting Market Size & Share Analysis—Growth Trends & Forecasts (2024–2029)Mordor IntelligenceAnalysis of the AI in the accounting services market
McKinsey, 2023 [95] The economic potential of generative AI: The next productivity frontierMcKinseyThe impact of GenAI on productivity
Alan Turing Institute, 2023 [48]AI Skills for Business Competency FrameworkAlan Turing InstituteDeveloping strategies to upskill staff using AI solutions
Schwartz, et al., 2022 [80]Towards a Standard for Identifying and
Managing Bias in Artificial Intelligence
National Institute of Standards and TechnologyTechnical biases and discrimination instances attributed to AI
OECD, 2019 [23]Principles for trustworthy AIOECDCooperation governments-stakeholders so that people hold the necessary competencies to interact effectively with AI tools
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Anica-Popa, I.-F.; Vrîncianu, M.; Anica-Popa, L.-E.; Cișmașu, I.-D.; Tudor, C.-G. Framework for Integrating Generative AI in Developing Competencies for Accounting and Audit Professionals. Electronics 2024, 13, 2621. https://doi.org/10.3390/electronics13132621

AMA Style

Anica-Popa I-F, Vrîncianu M, Anica-Popa L-E, Cișmașu I-D, Tudor C-G. Framework for Integrating Generative AI in Developing Competencies for Accounting and Audit Professionals. Electronics. 2024; 13(13):2621. https://doi.org/10.3390/electronics13132621

Chicago/Turabian Style

Anica-Popa, Ionuț-Florin, Marinela Vrîncianu, Liana-Elena Anica-Popa, Irina-Daniela Cișmașu, and Cătălin-Georgel Tudor. 2024. "Framework for Integrating Generative AI in Developing Competencies for Accounting and Audit Professionals" Electronics 13, no. 13: 2621. https://doi.org/10.3390/electronics13132621

APA Style

Anica-Popa, I.-F., Vrîncianu, M., Anica-Popa, L.-E., Cișmașu, I.-D., & Tudor, C.-G. (2024). Framework for Integrating Generative AI in Developing Competencies for Accounting and Audit Professionals. Electronics, 13(13), 2621. https://doi.org/10.3390/electronics13132621

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop