AI & Technology

How AI is reshaping intelligence gathering – and why human judgement is becoming even more critical

By Nico Dekens, Certified Instructor, SANS Institute

AI is reshaping open-source intelligence (OSINT) – the analysis of publicly available data by cybersecurity teams, law enforcement, journalists and more – increasing both the volume of information available and the challenge of making sense of it. 

Today, analysts have access to more data, more sophisticated tools and faster workflows than at any point in the field’s history. Yet despite these advances, producing reliable intelligence is becoming increasingly difficult, with ongoing challenges around determining which information can truly be trusted. 

The pressure is coming from several directions at once. The volume of available information has skyrocketed but it demands more careful filtering and verification. Online platforms are becoming more fragmented, impeding open access. AI-generated content is flooding digital channels, obscuring signal with noise, and threat actors are rapidly adopting AI-led tactics. Combined with an ongoing skills gap across the industry, these trends are placing significant pressure on intelligence professionals. 

The reality is that more output does not necessarily mean better intelligence, and a polished AI-generated summary is not the same as validated understanding. As organisationsembrace AI-powered workflows, there is a growing risk that collection is being mistaken for analysis, and efficiency mistaken for insight. 

Intelligence still depends on human judgement 

OSINT begins with collecting information, and although it is widely accessible it is also raw, unverified. It only becomes intelligence once it has been assessed, validated and contextualised. The value of OSINT has never been in gathering the most data; it has always been in making sense of it. 

Recent geopolitical conflicts have demonstrated this clearly. Vast quantities of open-source material may be available to anyone with an internet connection, but only a small number of analysts consistently turn that information into reliable intelligence. Their advantage comes not from access to data, but from their ability to verify sources, separate signal from noise and apply disciplined analytical thinking. 

As AI becomes embedded within intelligence workflows, the OSINT community is increasingly dividing into two broad approaches. Some practitioners rely heavily on automated tools to search, interpret and reach conclusions. Others use AI as an accelerator while maintaining direct engagement with source material and retaining responsibility for analytical judgement. 

AI won’t replace analysts, but it may break them first 

The greatest risk posed by AI is not that analysts suddenly become obsolete. A more immediate concern is that critical thinking skills gradually erode as professionals become increasingly reliant on machine-generated outputs. 

Under the AI-driven ‘speed mandate’, analysts are expected to operate at machine speed while processing machine-scale volumes of information. At the same time, they must contend with an ever-growing stream of AI-generated articles, social media posts, images and videos – much of it deliberately designed by adversaries to overwhelm. Cutting through thatsynthetic fog – and distinguishing what is real and what is not, places a growing cognitive burden on human analysts. 

There is also a growing temptation to outsource judgement to automated systems. AI operates like a spotlight – highly effective within a well-defined frame but limited in its ability to see beyond it. Human analysts, in contrast, bring a broader, more contextual awareness – spotting anomalies that sit outside established patterns and therefore escape automated detection.That kind of ‘lantern’ approach to seeing things remains critical, particularly in environments where there is ambiguity, inconsistency and deliberate deception. 

With organisations increasingly using AI to support cybersecurity, investigations, risk management and strategic decision-making, the quality of human oversight has only become more paramount. Trust in AI-assisted intelligence now ultimately depends on the judgement applied to its outputs. 

Adversaries are adapting faster than ever 

Threat actors are also evolving alongside the technology. Increasingly, disinformation campaigns are designed not only to influence audiences but also to manipulate the systems used to analyse information. 

One emerging tactic involves creating the appearance of consensus through large-scale content generation. A single false claim can be reproduced across multiple websites, amplified through automated publishing networks and surfaced by AI tools as corroborated information. What appears to be dozens of independent sources may ultimately originate from a single piece of misinformation. 

Concerningly, in an information environment saturated with synthetic content, volume can easily be mistaken for validation. Fifty sources repeating the same claim may not represent fifty independent confirmations; they may simply be one source echoed fifty times. 

Cognitive security becomes a strategic priority 

As AI-generated content becomes more prevalent, protecting analytical judgement is becoming a discipline in its own right. Operational security used to mean protecting data and operations, but it now means safeguarding the ability to think critically, verify information and resist manipulation. Some experts refer to this as cognitive security. 

The concept is increasingly relevant for organisations adopting AI-powered intelligence capabilities. Technical controls alone cannot protect against poor analytical decisions. Maintainingcognitive resilience is becoming just as important as maintaining cybersecurity resilience. 

Analysts should review original source material wherever possible rather than relying solely on AI-generated summaries. Teams should be encouraged to “you’re your work” and demonstrate how conclusions were reached and challenge findings before accepting them as fact. Equally important is maintaining rigorous source evaluation practices that prioritiseinformation based on where it comes from, not how believable it sounds. 

The future belongs to analysts who can think 

AI will continue to shape the future of OSINT, accelerating how information is collected, monitored and processed. But greater speed and scale do not automatically produce better intelligence – and some cases, they make it harder to achieve. 

The qualities that underpin effective analysis remain distinctly human. Curiosity, scepticism, contextual understanding and sound judgement cannot be automated away. And in fact, may become more important as synthetic content and adversarial tactics make information more difficult to interpret. 

Ultimately, tools scale collection, but discipline scales intelligence. As information environments become increasingly AI-saturated, the organisations that succeed will be those that combine technological capability with strong analytical foundations. In the age of AI, the decisive advantage may be the ability to think clearly about information, question assumptionsand verify what is true before acting on it. 

Author

Related Articles

Back to top button