What’s Holding Back AI in Financial Services?

What’s Holding Back AI in Financial Services?

The financial services industry is currently navigating a peculiar paradox where immense confidence in artificial intelligence strategies coexists with a stark inability to move most projects beyond the pilot phase. Despite organizations reporting that their return on investment from AI has either met or exceeded expectations, a significant “implementation gap” has emerged, revealing a deep disconnect between the sector’s ambitious vision for AI and its present operational reality. This situation indicates that while the value of AI is clearly recognized, the majority of institutions are struggling with foundational challenges that prevent them from scaling these promising experiments into full, enterprise-wide deployments that can deliver transformative value. The journey from small-scale trials to operationalizing AI at scale is proving to be far more complex than anticipated, demanding a fundamental rethink of data governance, IT infrastructure, and operational strategy.

The Data Dilemma as AI’s Biggest Bottleneck

The primary obstacle hindering the widespread adoption of AI in finance is a pervasive data crisis. An overwhelming 92% of decision-makers within the sector, the highest proportion of any industry surveyed, acknowledge that improving data quality is an absolute prerequisite for successful AI implementation. The core principle of any AI model is that its efficacy is fundamentally tied to the quality of the data it is trained on. However, this critical understanding is starkly contrasted by a concerning lack of faith in their own data assets. A mere 43% of financial organizations report being fully confident in the accuracy and completeness of their data, the lowest level recorded across all industries. This profound data readiness deficit stands as the single most significant factor preventing AI projects from transitioning from proof-of-concept to production, as unreliable or incomplete data introduces an unacceptable level of risk in a highly regulated and risk-averse environment.

In response to this critical bottleneck, the financial services sector is beginning to orchestrate a strategic pivot toward more robust data governance and infrastructure. Recognizing that clean, reliable data is the essential fuel for any advanced AI engine, a substantial 76% of financial organizations are now making concrete plans to establish a dedicated AI data repository by 2028. This forward-looking initiative represents more than just a technical upgrade; it signals a long-term strategic commitment to building a trustworthy and accessible data foundation. Establishing such repositories is seen as a non-negotiable step toward developing the kind of dependable and auditable AI systems required to drive future innovation, enhance customer experiences, and maintain a competitive edge. The industry understands that without this foundational work, the full transformative potential of AI will remain tantalizingly out of reach, stuck in a perpetual cycle of experimentation.

Untangling the Web of IT Complexity

Compounding the industry’s data challenges is the staggering complexity of its existing IT environments. In the race to support an ever-expanding portfolio of digital services, real-time transaction processing, and emerging AI workloads, financial institutions have inadvertently accumulated a large and fragmented collection of monitoring and management tools. The average IT team in the sector now juggles 13 different observability tools from nine separate vendors, creating a chaotic and inefficient operational landscape. This “tool sprawl” results in significant operational blind spots, limits comprehensive visibility across critical applications and networks, and severely hampers the speed of decision-making and issue resolution. This tangled web of disparate systems not only increases operational costs but also creates a fragile foundation that is ill-equipped to support the rigorous demands of enterprise-scale AI initiatives, which require unified visibility and seamless data correlation to function effectively.

Faced with this overwhelming complexity, a powerful and decisive trend toward simplification and consolidation is sweeping through the financial services industry. A remarkable 96% of organizations are now actively engaged in efforts to consolidate their IT operations tools and vendors. This movement is not merely a cost-cutting exercise but a strategic imperative to regain control and create a more resilient, observable, and AI-ready infrastructure. Underscoring the urgency of this shift, 95% of these institutions are considering new vendors as part of their consolidation efforts, the highest level among all industries. This signals a strong willingness to abandon long-standing legacy relationships in favor of modern, integrated platforms that can provide the unified visibility needed to reduce operational risk and unlock the full potential of AI at an enterprise scale.

Shifting Focus to a Stronger Foundation

As artificial intelligence initiatives within financial services begin to mature, the industry’s strategic focus is logically shifting from the AI models themselves to the underlying infrastructure that must support them. The movement and accessibility of AI data have emerged as paramount concerns, with 94% of organizations now viewing it as a critical component of their overall strategy. Given that this data is frequently distributed across a hybrid environment of public clouds, on-premises data centers, edge computing locations, and co-location facilities, the performance, security, and reliability of the network have become decisive factors for success. Consequently, a high-performing and resilient network is no longer considered a commodity but is now recognized by 81% of respondents as an essential prerequisite for any serious and scalable AI endeavor, forming the bedrock upon which future innovations will be built.

To effectively manage this intricate and distributed technological landscape, financial firms are leading the charge in the adoption of open standards like OpenTelemetry. This framework is proving instrumental in taming complexity by enabling consistent data collection and correlation across incredibly diverse IT domains, which is a prerequisite for building trustworthy and auditable AI systems in such a complex and regulated environment. The survey data reveals that 92% of financial firms are already leveraging OpenTelemetry to achieve a more unified view of their operations. Furthermore, a near-unanimous 99% of respondents agree that this standard helps reduce vendor lock-in, providing crucial flexibility, while 97% view it as a critical foundation for enabling future AI-driven automation and ensuring long-term scalability and resilience.

From Ambition to Actionable Reality

The industry’s journey revealed that tactical, day-to-day operational frictions also contributed significantly to the implementation gap. With employees spending 41% of their working week on unified communications platforms, persistent performance issues became a major drain on productivity. These tools accounted for 16% of all IT support tickets, with an average resolution time of 41 minutes, creating a constant drag on an industry where time and efficiency directly impact financial outcomes. These seemingly minor inefficiencies, combined with the chaos of tool sprawl, highlighted a foundational weakness. It became clear that success with AI was not just about advanced algorithms but about building a simplified, observable, and high-performing operational backbone. By confronting these challenges head-on through the consolidation of tools, the establishment of robust data governance, and the adoption of open standards, the financial services sector finally positioned itself to bridge the chasm between its significant AI ambitions and a tangible, operational reality.

Subscribe to our weekly news digest.

Join now and become a part of our fast-growing community.

Invalid Email Address
Thanks for Subscribing!
We'll be sending you our best soon!
Something went wrong, please try again later