In an effort to eliminate the challenging complexities of performing an opera rehearsal, researchers have developed a virtual digital stage system that is able to model all elements to save time and money.
Announced by the University of South Wales, Australia, the virtual intelligent design is believed to be a world-first to revolutionise how artistic directors are able to work. The three-year project to transform rehearsal design is a collaboration between Professor Del Favero, Chair Professor of Digital Innovation at UNSW Art & Design, a team of UNSW researchers and opera production designer Michael Scott-Mitchell.
“This project demonstrates the advantages of industry collaborating with researchers in the development of the latest software technology to enhance creative decision-making,” Professor Del Favero says.
Opera Australia has the most advanced digital stage system in the world incorporating a wide range of software, robotic and mechanical components which, according to Professor Del Favero, is “why we’re working with them and why they approached us”.
An Opera Australia rehearsal often involves complex software applications for lighting, large-scale rotatable LED robotic screens, props and central revolving stages, along with more than 100 participants – performers and orchestra. Typically, before a rehearsal, each operatic production has a pipeline of different design teams including software and hardware programmers, interaction designers and technicians, set designer, costume designer, graphics designers and video artists.
“Because the design, software and infrastructure elements are developed separately, the individual programming, technical and design teams never see the combined effect until the rehearsal and they are unable to control these as a unified ensemble until that point,” said Professor Del Favero.
“Rehearsals are among the most complex digital and hardware parts of production for Opera Australia. It’s of great value to them to be able to streamline and pre-test that software and hardware rehearsal process – to make the decision-making a lot more effective.”
Artistic director of Opera Australia, Lyndon Terracini AM says what is being proposed has not been achieved by any other opera company in the world and it presents many challenges.
“However, if the research results are what we expect them to be, it will revolutionise how we make theatre and it will be the most significant development in theatre practice for more than half a century. It will mean we can present a number of operas on any given day, and we will be able to reduce our labour costs dramatically.
“In summary, the artistic results will be magnificent, but the savings made in labour and logistics will be just as important,” said Terracini.
To better integrate the operation of the software before the physical rehearsal and to enhance decision-making, Professor Del Favero’s team of researchers will develop an entirely new software application that compiles all the existing software programs of the operatic production such as Premier, Rhinoceros and D3 into a new application. This enables each software and data component to operate independently and then in combination with the others. A machine learning application will analyse and learn the function and interaction between the components and provide real-time corrections to enhance its operation.
“By modelling all of these in an integrated software environment, we’re providing an application where they can test all the rehearsal digital and data components, make and refine decisions, and then undertake and control a full-scale physical rehearsal based on these outcomes,” said Professor Del Favero.
The platform enables designers and programmers to work on their components in pre-existing separate programming applications – say robotic screen movement control software and robotic screen content software – and then import these into the new software application where they can test their combined interaction.
Once they have worked up a draft design in this new software, they can validate this on their laptops or upload it for 1:1 scale rehearsal on cinematic scale immersive screens. They can then remotely access the synchronised software rehearsal to test the design with groups of other programmers and designers.
Inside the unified software program, the designers and programmers have full interactive control. For instance, by synchronising the robotic and mechanical components for a specific scene, the software highlights how the interaction between the screens, revolving stages and props results in numerous collisions. The team can test a range of solutions, such as changing the rotation speed of the screens and stage. After reviewing these, the software application automatically displays a range of more nuanced solutions, including changing the physical position of the screens, stages and props. The programmers and designers review and accept one of these solutions, then integrate it into the final software rehearsal design.
“A virtual rehearsal in a 3D cinema is not only an exciting concept, it also allows the development of artistic collaboration to be fully realised and put into immediate practice. It also saves massive amounts of time in the theatre,” said Terracini.
