AI-Powered Cyber Threats

Artificial Intelligence (AI) is reshaping the cybersecurity landscape, and not just for the better. While AI-powered security solutions are proving effective at detecting and preventing cyberattacks and malicious programs, agentic AI is also being embraced by bad actors and hacking groups to make their attacks potentially more effective and dangerous.

Quick Summary

• AI technology is taking an increasingly active role in cyber-attacks today.
• It can identify targets, bypass protections, harvest credentials, and steal data autonomously.
• Attacks are likely to become more sophisticated and complex as AI gets smarter.
• The coming years will see swarm attacks, deepfake-as-a-service technology, and other new threats.
• Those wishing to help entities defend themselves can consider an MSc in Cybersecurity at OPIT.

The Age of Autonomous Cybercrime

Autonomous cybercrime isn’t a theory or a prospective threat on the horizon; it’s an active danger, threatening businesses, governments, and individuals across the globe today. Where cyberattacks may have once involved months of planning and manual work, some attacks can now be planned and executed much faster, with significantly less human involvement.

AI can carry out reconnaissance to identify and map targets autonomously, potentially much faster than human attackers working manually. It can also be used to bypass some defensive systems, steal login details, and automate parts of an attack before conventional defenses can start to respond.

This danger is becoming more widespread, with a Signicat report finding a 2,137% increase in deepfake fraud attempts over the previous three years. The report also found that 42.5% of detected fraud attempts in the financial and payments sector involved AI.

A New Era of Cybersecurity

Before AI emerged, cybercriminals regularly developed new tools and techniques to deceive their victims, steal data, and cause chaos in cyberspace. But almost all of their attacks were manually driven. They had to do most of the hard work and heavy lifting, which effectively limited the speed, efficiency, and overall risk level of their attacks.

Now that AI has entered the equation, experts feel that the “Manual Phase” of cybersecurity is all but over, with two new phases emerging from 2022 onwards:

• The Generative AI Phase: Beginning around 2022, this was when attackers increasingly experimented with generative AI technologies to streamline and enhance their campaigns.
• The Autonomous Phase: From 2025 onwards, the autonomous phase involves AI not merely helping attackers, but effectively replacing them. The latest agentic models can do far more than write scam messages or generate malware; they can orchestrate complex, multi-stage attacks, at scale, while human attackers sit back and wait for the results.

The PRAR Loop

Many analysts fear that this new phase of cybersecurity could quickly spiral out of control because of AI’s propensity to become smarter and more effective at carrying out its duties as time goes by. They cite the “PRAR Loop” as the mechanism that cybersecurity businesses and at-risk entities need to be aware of from this point on:

• Perceive: The AI reads and understands its environment.
• Reason: It relies on its own training and data access to plan its next step.
• Act: It puts its plans into action, rapidly and without need for human oversight or instruction.
• Reflect: It reviews the impact of its actions and uses the results to adjust subsequent actions or plans.

This is what makes AI-powered cyber-attacks so concerning. Unlike traditional malware, which generally requires attackers to modify or redeploy it, AI-powered systems can adapt their behavior and automate iterative tasks without requiring a human to direct every step.

The Five Stages of an AI Attack

While individual attacks can vary widely in their planning and execution, a typical deepfake strike might include the following five stages:

1. Reconnaissance: This is the point at which the AI identifies its target and learns as much about it as possible, often using publicly accessible data, like company websites, social media profiles, and press releases.
2. Construction: Again relying on publicly available data, such as videos and audio files, the AI can construct a realistic likeness of a figure of authority within the business, such as the Chief Financial Officer (CFO).
3. Approach: The deepfake is deployed, either in video or audio form. The attacker uses the AI-generated imitation of a real business figure to demand that a lower-level employee take some sort of action, like transferring money or sharing files.
4. Verification: This is the stage at which attacks may be thwarted, but it depends on whether an employee takes the time to verify the deepfake figure’s identity. If they don’t, the attack will almost invariably succeed. If they do, they may realize what’s happening and take action to stop it.
5. Result: Again, depending on what happened in the previous stage, the attack may either succeed or fail. If it succeeds, data, funds, and credentials may all be lost or stolen.

Looking Ahead

By 2027, some experts and forecasts anticipate that AI-powered cybercrime could evolve significantly, potentially enabling malicious groups to deploy coordinated, multi-agent attacks and assisting attackers in identifying vulnerabilities and developing exploits.

At the same time, there are people on the other side of the equation using AI to build better defenses and guard against these kinds of attacks, and working to level the playing field.

These “guardians of tomorrow” are already learning the tools of their trade today on courses like OPIT’s  Master’s Degree (MSc) in Enterprise Cybersecurity, which provides graduates with the technical and managerial expertise they need to develop new security solutions and lead bold cybersecurity initiatives.

Key Takeaways

• AI-powered cyber-attacks are likely to get more dangerous in the years ahead.
• Current attacks often revolve around deepfakes or AI-generated exploits, but new methods are likely to emerge.
• It will be up to cybersecurity students, graduates, and experts to lead the counter-charge and develop AI-powered defenses to stop these attacks before they do damage.

Learn How to Safeguard the Systems of Tomorrow at OPIT

If you’re concerned about the rapid rise of AI-powered cybercrime and would like to play a part in stopping it, you might like to consider signing up for the MSc in Enterprise Cybersecurity at OPIT. It will give you the tools you need to build the stronger, smarter defenses that businesses are going to need to protect themselves from AI threats for years to come. Visit the OPIT site to learn more or fill out an application.