Can ChatGPT answer your clients’ questions?

AI such as ChatGPT is changing the world as we know it. As a practitioner, can it help you better serve your clients, support your staff, and prepare you and your practice for the future? Let’s first take a look at what ChatGPT is as we attempt to answer these questions. We will then provide an example of a conversation between this powerful AI chatbot and a hypothetical client and let you be the judge.

Natural language processing (NLP) researchers have created chatbots and conversational AI systems such as ChatGPT to deliver more “human” responses to human prompts. These tools are based on enormous datasets.

ChatGPT can answer technical tax questions, draft letters and responses, generate contracts, and suggest checklists. It can also answer CPA Exam questions, produce social media posts, and “brainstorm” ideas you can use as a springboard. It can be an amazing time saver. ChatGPT’s responses are almost instantaneous. It can also remember previous responses and build off of suggested modifications, enhancing previous replies.

ChatGPT has many potential applications for accountants, like writing Microsoft Power BI formulas, VBA code, and DAX. It can produce invoice, contract, and audit report templates and summarize financial reports. ChatGPT can also help accountants analyze large amounts of financial data to reveal trends, patterns, and anomalies, helping accountants spot risks and opportunities. Based on historical data, ChatGPT can also predict trends and financial outcomes.

Even if you are not currently using ChatGPT, your clients, staff, and colleagues likely are, so you need to understand the potential pros and cons of this powerful and pervasive tool.

Caution is needed when using ChatGPT

ChatGPT has great promise but must be used with caution: Not everything it produces is accurate.

ChatGPT generates responses based on words a user inputs and then uses those words to project a conversational answer using related words that it finds in its dataset. This can lead to some very interesting — and incorrect — responses. For example, one of this article’s authors submitted questions from his accounting exam into the tool, and a 46% grade was the result, even though the average score for live test takers was almost 84%. Stack Overflow, a Q&A sharing site for programmers, has gone so far as to ban ChatGPT-generated code because of the potential for errors.

In another example of AI’s fallibility, a recent live publicity effort by Alphabet/Google introducing its new Bard AI system went horribly wrong when it gave a wrong answer related to the James Webb space telescope. The company lost 10% in stock valuation (over $100 billion in market value) that day.

This tool also reflects the biases of the datasets it is based on and does not provide the sources of its data. Companies have already filed lawsuits seeking compensation for data they claim belongs to them that was used by the AI platform.

Additionally, the dataset ChatGPT uses is fixed, with the latest information coming from 2021 or prior. As an example, it has no knowledge of Russia’s invasion of Ukraine. More significantly for CPAs, it is not familiar with tax law updates (subsequent to 2021) or recent stock market activities.

Putting ChatGPT to the test

Some early adopters of ChatGPT assert that it may make certain professions related to content creation, such as programmers, professors, and journalists, obsolete. Are CPAs at risk? How well can ChatGPT answer clients’ questions? We ran a small experiment to find out.

An article on key questions clients should ask their CPA was published on TheStreet financial news and financial literacy website. On Feb. 4, 2023, we posed two of those questions to ChatGPT to see how it would do. Let’s look at the results.

Q: Should I itemize my deductions or take the standard deduction?

A: The decision on whether to itemize your deductions or take the standard deduction depends on several factors. If the total of your itemized deductions, such as mortgage interest, state and local taxes, charitable contributions, and medical expenses, among others, is greater than the standard deduction for your filing status, then you should itemize your deductions. If the total of your itemized deductions is less than the standard deduction, then it would be more advantageous for you to take the standard deduction.

It’s important to note that the standard deduction has increased since the Tax Cuts and Jobs Act of 2017, which may make it more beneficial for you to take the standard deduction instead of itemizing your deductions. Additionally, it’s recommended to consult a tax professional or use tax preparation software to determine the best option for your specific tax situation.Top of Form

Q: What deductions or credits are available that I may be missing?

A: There are many deductions and credits that you may be eligible for but are missing, as many taxpayers are unaware of all the tax benefits available to them. Some common deductions and credits that you may be missing include:

1. State and local taxes (SALT)
2. Mortgage interest
3. Charitable contributions
4. Medical and dental expenses
5. Student loan interest
6. Retirement contributions
7. Child and dependent care expenses
8. Adoption expenses
9. Energy-efficient home improvements
10. Job search expenses
11. Moving expenses
12. Educator expenses
13. Health Savings Account (HSA) contributions
14. Earned Income Tax Credit (EITC)

It’s important to keep accurate records and receipts of all your expenses throughout the year to ensure you claim all the deductions and credits you’re eligible for. It’s also recommended to consult a tax professional or use tax preparation software to determine which deductions and credits you’re eligible for.

ChatGPT is still no substitute for a human CPA

As can be seen from the above experiment, ChatGPT’s responses are often inadequate — rather than being insightful, they are overly superficial and neglect important details. To implement the suggestions, a client would still need professional assistance. Although ChatGPT is an invaluable resource for offering fundamental direction and information, it is not a suitable substitute for the CPA’s professional expertise. Clients may think AI chat platforms are all-knowing, but it is your job to help your clients understand their appropriate, and inappropriate, use.

In March, OpenAI released version four of ChatGPT, which reportedly uses 1 trillion parameters, or six times more data than version three, and competitors are not sleeping on their prospects. Alphabet/Google has Bard and two other platforms still in development. Meta/Facebook, along with Amazon and IBM, has its own initiatives, and many private companies beyond the majors have viable offerings.

This is just the beginning. Although OpenAI announced that GPT-5 is not expected in the immediate future, with the abundance of vendors jumping into the space, new challenges and opportunities will not be in short supply. Hang on for the ride.

— Scott Dell, CPA, DBA, is an assistant professor of accounting at Francis Marion University in Florence, S.C. Mfon Akpan, CGMA, DBA, is an assistant professor of accounting at Methodist University in Fayetteville, N.C. To comment on this article or suggest another article, contact joaed@aicpa.org.