Data analysis may seem like a technical role on a surface level, but the reality of the job is nuanced and vital to most business and technical operations. The analysis process involves more than crunching numbers; it requires an understanding of the human elements behind the data. Whether it’s analyzing customer behavior or detecting fraudulent activity, a human data analyst’s ability to empathize and understand the motivations, emotions and interests of others can lead to compelling insights. Insights can go beyond what is immediately apparent in the raw data and require an element of human judgment and understanding that AI currently lacks.
No doubt, AI can process massive amounts of data and provide quantitative analysis. It cannot understand the nuances of human behavior, cultural subtleties or the complexities of human motivations and aspirations. Human factors often have a significant effect on data and are areas where human analysts excel.
Generative AI tools such as ChatGPT and Bard can simulate text generation to a human-like standard, and they have the potential to automate some of the tasks that data analysts currently execute and perform. But, Generative AI also has limitations, such as its inability to understand the full context of data. As a result, data analysts must interpret the results of Generative AI and make decisions based on the data.
Current abilities and limits of Generative AI
Generative AI cannot perform the nuanced work of analysts. Analyst work requires a synthesis of visual, numerical, and tacit knowledge, which analysts cannot convey through text alone. The training data that Generative AI models use limits the text that they can generate. Generative AI also cannot analyze raw data or produce original visualizations, and any insights it provides come from language patterns in the training data.
Another concern with Generative AI models is accuracy. Without human oversight, the text outputs from AI can contain logical gaps, biased perspectives, and definite factual errors it inherits from the training data. Accuracy depends on the quality and diversity of the source material and training data. Biased or inaccurate training data causes the data sets to be biased or inaccurate as well.
AI Models struggle to keep up with the real world and datasets, etc: Training or retraining a model takes a great deal of computing power, time and resources. As the all aspects of global culture, technology, data and commerce changes, the AI model falls behind until it’s retrained. Even GPT-4 is only trained on data up to 2021. The irony is ChatGPT has little insight into its effects on business, culture and the economy and since its launch in November 2022.
Generative AI models also lack the critical thinking skills and insight to question the validity or relevance of its source material, which is an essential skill for a data analyst. A core component of data literacy is checking the quality of data sources and identifying potential biases.
As a result of limitations, g\Generative AI models should not be a substitute for human analysts. Instead, the models are an impactful tool to help analysts generate text, identify patterns and explore data. With human oversight, Generative AI models can be a vital asset. Without human engagement though, they mostly produce repetitive, systematic and formulaic summaries of their existing knowledge.
How Generative AI affects the Analyst role
It will be some time before AI replaces human analysts because of its current limitations. But certainly, human analysts can utilize AI as a valuable assistant in their work right now.
Given the right information, AI can propose data structures such as tables, especially for analytic schemas. Although AI can identify patterns within data and suggest tables, the task of defining efficient and effective data structures often needs human intervention.
AI can struggle to get it right the first time because it does not have the same understanding of the data as a human analyst. An analyst understands the core nature of the data, its relationships and how to best model it for a specific use case.
Human analysts often are wrong on the first iteration too, but they start with a stronger understanding of the problem.
One interesting use of AI is to recommend analytical methods. Analysts must validate the suitability of a suggested method for the problem, account for business needs, data constraints and possibly even budget constraints for development and storage.
Generative AI can suggest code to extract, clean and analyze data, which can greatly help automate some repetitive tasks. But for the most part, It lacks the deep understanding of context, business goals and interdependencies required to design complex, scalable and maintainable code architectures. It can help an analyst who may need to work in multiple languages or diverse architectures, generating helpful code for quick review.
Suppose an AI system is analyzing customer purchase data to increase sales. It sifts through massive data sets and identifies a pattern: Customers who buy a laptop often also buy a wireless mouse. Consequently, the AI recommends that bundling the products together in a promotional offer might lead to increased sales.
Smart analysts can use AI as a tool to augment their abilities rather than perceive it as a threat to their roles. With new insight, analysts can prompt the AI again and see if it has more, or similar, recommendations.
The near-term future of AI in Data Analysis
AI can enhance — rather than replace — the role of data analysts. Analysts can dedicate more time to strategic work as automation helps carry out routine data tasks. But AI is not accountable for its own errors. Responsibility and mistakes still rest with humans.
Human conclusions, coupled with a healthy dose of skepticism, experience and business acumen, continue to be indispensable assets AI cannot replace.
Smart analysts can use AI as a powerful tool to augment their abilities rather than perceive it as a threat to their roles.
Certainly, AI can automate repetitive tasks, provide insights into large data sets, help draft initial reports, write code and propose potential routes for analysis. As AI advances, the industry might look forward to more sophisticated assistance in data analysis. AI can suggest potential data sources, generate effective test data, or drive operational and tactical decisions.
Even if Generative AI reduces the number of analysts required, the key role of the human analyst remains. Their knowledge and expertise of the specific context, ability to apply critical thinking and deep understanding of human needs is critical, even with new advances. The human analyst’s role is not obsolete. It’s more essential to ensure their organization harnesses Generative AI’s power and potential effectively and responsibly.
Company Contact Information:
Thomas J. Canova