How one Ukrainian startup is adapting its app during a time of war

Photo by JOHN MACDOUGALL/AFP via Getty ImagesFrom face swaps to information drops Continue reading…

How one Ukrainian startup is adapting its app during a time of war
GERMANY-RUSSIA-UKRAINE-CONFLICT Photo by JOHN MACDOUGALL/AFP via Getty Images

From face swaps to information drops

Like so many Ukrainians, Dima Shvets was awoken last Thursday by the sound of bombs. At around 5AM local time, Russian troops began shelling key targets in his country, escalating a military assault that had begun eight years ago into a full-fledged invasion. As air raid sirens rang out in cities across Ukraine, Shvets reached out to friends, family, and colleagues to find out what was happening.

“The first two days were super tough,” Shvets tells The Verge, and he and those around him were forced to adapt to this new and terrifying reality. On the one hand, everything they knew had changed forever; on the other, life had to continue — there was no other choice.

For Shvets, continuity meant his company: a startup based in Ukraine called Reface that makes a popular face-swapping app of the same name. As CEO, Shvets watched over Slack and Telegram channels as the firm’s staff, many of whom were already working remotely, headed to bomb shelters and basements for protection against the initial bombardment.

Ksenia Maslova, a member of the company’s comms team, says she found her way to her local subway station in central Kyiv on Friday and was there until Monday with around 50 others. “We had our sleeping bags, warm clothes and other emergency things in — we call them — ‘anxious bags,’” Maslova tells The Verge. “It was crazy because even though we had food with us, we didn’t know if we’d be able to come out again on Monday.”

UKRAINE-RUSSIA-CONFLICT Citizens of the Kyiv have been sheltering in the city’s underground metro stations. Photo by Genya Savilov/AFP via Getty Images

As the days passed and the initial shock of the invasion subsided, staff began to move further afield, keeping an eye on reports of Russian troop movements as they did. Some headed for the border and many to friends and family in the West, where fighting is less intense. “The war forced us to split up,” says Shvets, who is himself now in Western Ukraine.

A few members of Reface’s team members quickly volunteered to join Ukraine’s Territorial Defense Forces, a military branch of civilian reservists that’s been carrying out auxiliary tasks for the army: transporting food and fuel, making Molotov cocktails, and setting up armed roadblocks. And as the Reface team shared news of these departures, Shvets began to think about what his company could do to help the war effort.

“We told our people they shouldn’t work now,” he says. “We should work on the freedom and health of our country instead.”

With a little over 200 employees, Reface is hardly a tech giant, but it’s a well-known startup in Ukraine’s once-booming IT sector. Despite threats of war and the pandemic, Ukraine’s tech exports grew by 20 percent in 2020, and Reface itself (formerly known as Doublicat) has both won awards and topped app download charts around the world since its release.

The app uses machine learning to swap users’ faces into GIFs and videos of movies and memes — essentially producing domesticated deepfakes for entertainment on social media. And while that essential functionality still remains, the Reface team has since conscripted its app into Ukraine’s wider information war.

The first step, explains Shvets, was to leverage the app’s popularity in Russia. Working sometimes from bomb shelters and basements, he and his colleagues compiled a video that showed the invasion as it had happened, using the same clips and images that were circulating on social media. In some ways, it felt like work as normal, says Maslova, but it was a routine conducted under extraordinary conditions. “Sometimes someone took a task and then texted the channel: ‘Oh, sorry, I need to go to my bomb shelter because there are sirens,’” says Maslova. “And we would say, ‘Okay, okay, sure, just tell us whether you’re safe.’”

After the video and accompanying text were prepared, Reface’s team sent out millions of push notifications to the app’s users in Russia and around the world, calling on viewers to join protests and stand with Ukraine.

Screenshots of the push notification Reface sent to users and the embedded video. Image: Reface

Daria Kravets, Reface’s comms manager, says key motivation was to reach Russian viewers by bypassing traditional channels of communication. Twitter and Facebook have been restricted in Russia, and the state has gone to great efforts to limit news of the war from reaching the people. “We understand Russians don’t have access to the real situation here because independent media is blocked,” Kravets tells The Verge. “But we have 5 million users [in Russia], and we sent out 2 million push notifications. We continue to send them. And in that push notification, we added footage of the real situation, and we encouraged people to go protest because that’s the only way to change the situation.”

It’s impossible to know the impact of such work, but rallying resistance is certainly not a trivial matter. Analysts say Russia’s media blackout was a key part of the country’s military strategy: to strike fast and hold territory before domestic politics could disrupt an unpopular invasion or Western powers could stir themselves to help. Ukraine has stymied these efforts on two fronts: first, by offering stiff opposition to Russian troops on the ground and, second, by flooding social media with memes, images, and videos that emphasize the brutality of the invasion and the bravery and humor of ordinary Ukrainians.

The app now lets users swap their face into videos of Ukraine’s President Volodymyr Zelenskyy.Image: The Verge

For Reface, push notifications were just the start, and the company has since given its app a patriotic makeover. The app’s icon now shows the blue and yellow of the Ukrainian flag, while a banner on the welcome screen tells users “Ukraine Needs Your Support,” directing them to donate to the war effort. Most conspicuously, Reface has added a new character to its roster of face-swapping stars: Ukraine’s president Volodymyr Zelenskyy, who has become a key figure in the country’s media war, sharing defiant videos to counter Russian misinformation about his surrender. In Reface’s app, anyone can place their face over Zelenskyy’s as he walks with soldiers and addresses the nation, telling viewers: “Slava Ukraini!”’ — “Glory to Ukraine!”

As Shvets puts it: “Before, the main heroes on the app were Jack Sparrow, Hulk, and Iron Man. But today’s heroes are our people, our military forces, and our president Zelenskyy.”

Shvets says that up until the moment that bombs started falling, he hadn’t ever thought his world would look like this. He says he only wanted to start Reface to make fun tools for creators. “Frankly speaking, I could never have imagined doing this with the app,” he says.

But like so many Ukrainians, Reface and its team have adapted their skills to what they say is an existential threat to their country and freedom. Other members of the tech industry have made similar efforts — volunteering for the so-called “cyber resistance” and agitating on social media. Despite these new concerns, Shvets is adamant that Reface will continue to exist whatever happens next with the invasion. As well as sending push notifications to Russians, he’s been busy securing servers outside of Ukraine to keep the app running whatever happens next. “Our app is not dead; it’s developing, and it’s going to be fine,” he says.

More immediately, though, Reface’s team members say that adapting the app, even in relatively small ways, has given them a sense of purpose. “Fear was replaced by the feeling that I am not alone and surrounded by such [...] focused and brave people,” says Kravets.

As Maslova puts it, during times of war, everyone has to find their niche. “If you have a medical degree, you go and help medical institutions,” she says. “If you have communication skills, you try and prepare these texts.”

When asked how she feels about Reface’s new direction, she pauses for a second and then gives a heartfelt sigh. “United,” she says. “It’s the most important thing. And useful. We have our own piece of the battleground.”