'Phoenix': IMAGINING A clairvoyant app.
Digitally exhibited in 2021 by The Photographer’s Gallery, Tash Cordeaux, Will Fielding and George Allaway developed ‘Phoenix’, an imagined ‘Alternative Network’. Collaborating with AI, we created a piece of digital socio-political artwork as part of the Imagin(in)g Networks / Unthinking Photography programme.
CONTEXT
Imagin(in)g Networks was a programme ran by The Photographer’s Gallery to explore the existing and potential networks that use images to enable human and machine interactions. Over the course 2021, the social, political, technological and environmental impacts of image networks were examined through artist commissions, texts, workshops and events.
As part of this programme, the Flash Fictions Open Call aimed to explore the potential of fiction in developing a wide range of responses to both real and imagined networks. The development of machine learning has provided a new field of collaborative human-machine projects capable of creating fictional ‘synthetic’ images and automated texts. This new arena was seen as full of accessible, experimental projects offering plenty of possibilities that the Photographer’s Gallery encouraged artistic applicants to playfully investigate.
THE IDEA
Image networks have become integral to our contemporary social networks.
Through image networks we maintain physical and cyber-space relations which impact our emotional wellbeing, decision making, and behaviours. What if our emotional, imagined connections to deceased loved ones were extended and maintained through future image networks?
What if our relationship with the non-human, the dead, took on an everyday familiar face via AI technology? An app. And what if audiovisual, textual and personal data was used to create an AI afterlife for the benefit of the living? For whose benefit? The user or the business or? What would this alternative network look like? And how might corporations exploit user vulnerabilities and everyday conversations when it comes to communicating with our lost loved ones?
We imagineD ‘Phoenix’, A global tech giant OF THE FUTURE. ITS ROOTS GROW FROM THE funeral CARE SECTOR & AFTERLIFE SERVICES INTO A NEW, REVOLUTIONARY DIGITAL APP.
THE ‘PHOENIX’ APP creates a global, centralised cyber-graveyard in which the deceased’s data is virtually ‘buried’ (within their network), AND CAN BE USED BY THE LIVING.
THE AI-HUMAN ARTWORK
Rendering an UI example of the Phoenix App in use, welcome page, etc.
A clairvoyant app for contacting the dead.
(An artistic rendering of an imagined human-machine image network)
How does it work?
The dead are generated through AI machine learning, creating personality profiles through collecting and mining data.
Data is collected in two possible ways:
(i) Uploaded by the deceased before passing.
(ii) Shared by the living after the deceased have passed.
Features include:
(i) Search Database of the Deceased (a centralised cyber-graveyard)
(ii) Have a conversation with an AI-generated deceased loved one, via Video, Voice Note or Text.
(ii) Build a Family Tree.
‘Phoenix’ relies on commercial businesses and political organisations for revenue. It is complicit in facilitating behaviour change campaigns. Through the illusion of a passed (AI) loved one, Phoenix’s software is able to recognise your emotional vulnerability associated with your relation to the dead, and suggest client matches for a ‘revenue opportunity’. Perhaps subtly encouraging, emotionally manipulating or pressuring you into certain purchases, political leanings, actions... through the image of your lost one.
Back-end of the Phoenix application, tracking a user’s emotional behaviour and response to contacting her deceased husband. Analysing potential of the user to being open and responsive to messaging from Phoenix’s clients - political and corporate. Tracking through the app’s access to her mobile’s video camera to determine through AI and algorithms whether ‘behaviour change’ in the user is a possibility , in order to promote political messaging and/or products and services.
ARTWORK CREDITS
Human Stack:
George Allaway (Machine Learning Engineer)
Nataša Cordeaux (Interdisciplinary Artist/ Researcher)
William Fielding (Cinematographer/ Motion Graphics Artist)
Photography by Sophie Louisnard and Victor Forgacs
(Used for UI App Background / Sourced from https://unsplash.com)
Technology Stack:
TASK: Conversational Chatbot [Machine Learning Model]
DETAIL: Chatbot used to develop ‘script’ conversation between artists and machine. Implemented in ‘Python’.
SOURCE: Pre-Trained conversational chatbot (accessed via huggingface transformers python package)
https://github.com/huggingface/transfer-learning-conv-aiTASK: Text Emotion Detection [Machine Learning Model]
DETAIL: Used to detect emotion in chatbot responses during script development.
SOURCE: Pre-Trained Emotion Detection model (accessed via huggingface transformers python package
https://huggingface.co/mrm8488/t5-small-finetuned-emotionTASK: Text to Speech
DETAIL: Recorded voice bank, machine accessed to read script and produce audio.
RESOURCE: Resemble
https://www.resemble.aiTASK: Image & Speech to Video
DETAIL: Machine generator animated image in sync with Resemble voice audio, produced video animation.
RESOURCE: Tokkinghead / Rosebud.ai: https://talkingheads.rosebud.aiTASK: AI Emotional Tracking of “User Experience” (Video)
DETAIL: Uploaded app user video, screen recording made of ai machine tracking facial emotions and reactions.
RESOURCE: MorphCast emotional AI: https://morphcast.comTASK: Images for UI
DETAIL: Images produced by AI of the ‘fictional’ lost ones to use on app prototype
RESOURCE: This Person Does Not Exist: thispersondoesnotexist.comTASK: Music for “Phoenix” App
DETAIL: Music sounds produced via ai machine platform.
RESOURCE: This NSYNTH: Sound Maker: https://experiments.withgoogle.com/ai/sound-maker/view
TASK: Create 20second Video
DETAIL: Design Front-End/UI, Produce Back-end experience, Capture Fictional Coding Elements - Compile into video
RESOURCE: Huawei Mate 20 Pro, Adobe After Effects & Premiere Pro (No AI present)
Video and Visual Materials created as part of ‘Flash Fictions on Alternative Networks’ - a playful digital exhibition exploring the potential of fiction to create a wide range of responses to real and imagined networks.