AI & Technology

The Hard Part of AI Filmmaking Is No Longer Generation. It’s Continuity.

By Sergey Karlov

Generative video has improved so quickly that the conversation around AI filmmaking is already changing. A few years ago, the central question was whether a model could produce a convincing cinematic image at all. Today, the more interesting question is what happens after the first impressive shot.

That shift matters because filmmaking is not a sequence of isolated images. It is a system of decisions that must remain coherent over time: character identity, geography, costume, lighting, performance, sound, pacing, story logic and emotional continuity.

While developing ARK-7, an episodic science-fiction project built through an AI-native workflow, I found that generating a visually strong shot was rarely the hardest part. The difficult part was making the next shot belong to the same world.

The demo problem

Generative AI is exceptionally good at producing demos. A single image or short video can communicate the capability of a model immediately, which is one reason generated media spreads so easily online.

But cinema is not judged one shot at a time. A character who looks convincing for eight seconds still has to look like the same person in the next scene, remember what happened earlier, carry the correct injury, wear the same version of a costume and exist in a location whose geography makes sense.

This is where the gap between generation and production becomes visible. McKinsey’s analysis of AI in film and televisiondescribes AI as moving across development, pre-production, physical production and post-production, rather than remaining confined to a single creative task.

That broader view is important because the value of AI in filmmaking will ultimately depend less on what one model can generate and more on how multiple stages can work together as a reliable production process.

The research community is reaching a similar conclusion. A paper titled “Lights, Camera, Consistency: A Multistage Pipeline for Character-Stable AI Video Stories” found that visual anchoring and multi-stage pipelines dramatically improved character consistency compared with direct generation.

That reinforces something filmmakers discover quickly in practice: continuity needs structure.

AI filmmaking is becoming an asset-management problem

Traditional filmmaking already relies on continuity systems. Departments track costumes, props, makeup, lighting setups, lenses, set dressing and actor positions because memory is not enough.

AI-native production needs an equivalent discipline, even if the assets are digital rather than physical.

A production may need character sheets, approved facial references, wardrobe states, environment masters, prop designs, injury states, lighting references, camera rules and a record of which visual decisions are canonical.

On ARK-7, I gradually stopped thinking of reference images as prompts and started treating them as production assets. That distinction changed the workflow.

Instead of asking a model to reinvent a character for every scene, the goal became to reduce the number of decisions the model was allowed to improvise.

This is one of the less glamorous lessons of generative production. The more freedom a model has, the more continuity work a filmmaker may inherit later.

Directing changes when the material is probabilistic

A traditional director works with uncertainty, but the uncertainty is human and physical. An actor may change a performance, weather may shift, or a camera move may not work as planned.

With generative systems, uncertainty exists inside the production tool itself. The same instruction can produce different staging, identity, movement, composition or physics from one generation to the next.

That changes the director’s job.

Direction becomes partly the design of constraints: deciding what must not change, what can change, what information a model receives, what reference controls a scene and where human judgment has to override a technically impressive result.

The World Economic Forum’s work on generative AI in media and entertainment has highlighted both the technology’s ability to lower barriers to content creation and the need for a human-centred approach to its adoption.

In practical filmmaking terms, that human role is not disappearing. It is moving upstream into system design and downstream into increasingly demanding selection, correction and editorial judgment.

The best generation is not always the best shot.

A beautiful result that breaks geography, character logic or story continuity can be less useful than a visually simpler result that fits the film.

The prompt is not the production system

Prompting is often treated as the defining skill of generative creativity. It matters, but in long-form work it is only one layer.

A production system has to answer questions that a prompt cannot solve by itself.

Which version of a character is canonical? Which reference has priority when two references conflict? What visual information should carry from the final frame of one scene into the next? What happens when a model creates a better-looking shot that contradicts the story?

The solution is not necessarily more detailed prompting. Sometimes it is decomposition: separating concept development, asset creation, keyframes, animation, dialogue, sound and editing into controllable stages.

That is also why the industry conversation should move beyond “text-to-video” as a complete description of AI filmmaking.

A McKinsey overview of AI in film and television points to effects across the whole production pipeline, from script development and pre-production to post-production and distribution.

The emerging workflow is less like asking one machine to make a movie and more like coordinating a new set of creative departments.

Long-form storytelling requires memory

Continuity is visual, but it is also narrative.

A ten-episode season creates a very different problem from a short film because every new idea creates dependencies. A decision in episode two may need to pay off in episode eight. A character relationship may need to change gradually rather than suddenly.

The biology of a fictional planet, the rules of a technology or the history of a location can affect scenes that have not even been written yet.

This is where large-context language models can become useful, not as autonomous writers but as story-development systems.

I use them to stress-test cause and effect, track world rules, compare alternative character arcs and identify contradictions across a large body of material.

The human role remains decisive. Models can propose connections at scale, but taste, authorship and responsibility still sit with the filmmaker.

The useful question is not whether AI “wrote” a scene. It is whether the creative system helped the filmmaker make better decisions across the whole story.

Small teams do not mean simple productions

One of the most important effects of generative AI may be the expansion of what small teams can attempt.

The World Economic Forum has highlighted the technology’s potential to lower creative barriers, while McKinsey has explored scenarios in which new production processes could change both what gets made and who gets to make it.

But lower barriers do not eliminate complexity.

They move it.

A small AI-native team may not need the same physical infrastructure as a traditional production, but it still has to solve writing, art direction, cinematography, continuity, performance, sound, editing, rights and distribution.

In some cases, one person is making decisions that would previously have been distributed across several departments.

That is empowering, but it can also create a false impression that filmmaking has become easy.

Generation has become easier. Production has not.

The next advantage will be systems, not models

AI models will keep changing. A workflow built entirely around the strengths of one model may be obsolete within months.

For filmmakers, the more durable advantage is therefore not loyalty to a particular tool. It is the ability to build a system that can absorb better tools without losing the project’s identity.

That means maintaining clear assets, explicit continuity rules, modular workflows, human review and a strong editorial point of view.

It also means knowing when not to generate again.

The future of AI filmmaking will probably contain far more automation than today, but I do not think its defining skill will be automation itself.

The defining skill will be direction: the ability to hold a coherent world together while the tools underneath it change constantly.

The impressive AI shot is becoming common.

The coherent AI film is still hard.

That is exactly why it is interesting.

Related Articles

Back to top button