12.5 Performance and new technologies

New technologies are revolutionizing performance practices. From motion capture to VR, digital tools are expanding creative possibilities and transforming how artists design, create, and present their work. These innovations are reshaping traditional roles and opening up new avenues for audience engagement.

The integration of technology in performance brings both opportunities and challenges. While it enables remote collaboration, immersive experiences, and global reach, it also raises questions about artistic integrity and accessibility. Balancing innovation with authenticity is key as performers navigate this evolving landscape.

Technologies in Performance Practices

Digital Technologies and Tools

Top images from around the web for Digital Technologies and Tools

• 

  -0010 #effinger View original

  Is this image relevant?

• 

  Frontiers | Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple ... View original

  Is this image relevant?

• 

  3D Content for Virtual Reality | Scholars' Lab View original

  Is this image relevant?

• 

  -0010 #effinger View original

  Is this image relevant?

• 

  Frontiers | Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple ... View original

  Is this image relevant?

1 of 3

Top images from around the web for Digital Technologies and Tools

• 

  -0010 #effinger View original

  Is this image relevant?

• 

  Frontiers | Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple ... View original

  Is this image relevant?

• 

  3D Content for Virtual Reality | Scholars' Lab View original

  Is this image relevant?

• 

  -0010 #effinger View original

  Is this image relevant?

• 

  Frontiers | Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple ... View original

  Is this image relevant?

1 of 3

• Contemporary performance practices utilize a wide range of digital technologies
  • Motion capture enables the recording and digitization of performer movements for animation or projection (virtual dancers, interactive stage elements)
  • Projection mapping allows for the creation of immersive, dynamic visual environments on stage (3D-mapped sets, interactive backdrops)
  • Virtual and augmented reality technologies offer new possibilities for immersive, interactive performance experiences (VR theater, AR-enhanced live performances)
  • Interactive multimedia elements, such as responsive video, generative visuals, and real-time data feeds, can be integrated into performances (data-driven visuals, interactive video installations)
• Digital tools are used extensively in the creation and design of performance elements
  • Computer-aided design (CAD) software facilitates the precise planning and visualization of stage sets, lighting designs, and spatial configurations (AutoCAD, SketchUp)
  • 3D modeling programs enable the creation of detailed, realistic digital assets for projection, animation, or 3D printing (Maya, Blender, ZBrush)
  • Digital audio workstations (DAWs) allow for the composition, recording, and manipulation of sound and music for performances (Ableton Live, Pro Tools, Logic Pro)

Online Platforms and Wearable Technologies

• Live streaming platforms, social media, and online video sharing sites have become integral to the dissemination and promotion of contemporary performance works
  • Performances can be live-streamed to global audiences, expanding reach and accessibility (Twitch, YouTube Live, Facebook Live)
  • Social media platforms enable real-time audience engagement, feedback, and behind-the-scenes content sharing (Instagram, Twitter, TikTok)
  • Online video sharing sites serve as repositories for performance documentation, trailers, and supplementary content (Vimeo, YouTube)
• Wearable technologies are being explored as means of enhancing performer-audience interaction and immersion
  • Biometric sensors can track performers' physiological data, such as heart rate or muscle tension, to generate responsive visuals or sound (Myo armband, Empatica E4 wristband)
  • Haptic devices can provide tactile feedback to performers or audience members, enhancing sensory engagement (vibrating wristbands, haptic suits)
  • Motion-tracking wearables enable the capture and real-time mapping of performer movements for interactive projections or avatars (Perception Neuron, Xsens MVN)
• The integration of artificial intelligence and machine learning algorithms is being investigated for their potential to generate or influence performance content in real-time
  • AI-powered generative systems can create dynamic visuals, music, or text based on live input or predefined parameters (Google Magenta, OpenAI GPT-3)
  • Machine learning algorithms can analyze and respond to performer or audience data, enabling adaptive and personalized experiences (facial recognition, sentiment analysis)

Impact of New Technologies on Performance

Creative Possibilities and Design Processes

• New technologies have expanded the creative possibilities for performance artists
  • Multimedia elements, such as video, animation, and interactive graphics, can be seamlessly integrated into performances (projected backdrops, real-time visuals)
  • Interactive components, such as motion-tracking systems or responsive environments, allow for dynamic performer-technology interactions (Kinect-based interactive sets, sensor-triggered effects)
  • Immersive environments can be created using 360-degree video, spatial audio, or virtual reality, enveloping audiences in the performance space (VR theater experiences, immersive audio installations)
• The use of digital tools has streamlined and accelerated the process of designing and fabricating performance elements
  • CAD software enables precise planning and visualization of stage sets, reducing the need for physical prototypes (virtual set design, 3D renderings)
  • Digital fabrication techniques, such as 3D printing and CNC milling, allow for the rapid production of custom props, costumes, and set pieces (3D-printed masks, CNC-cut stage elements)
  • Digital tools facilitate remote collaboration and real-time updates, enabling designers to work efficiently across distances (cloud-based design platforms, virtual production pipelines)

Transformed Roles and Presentation Formats

• The integration of new technologies has altered the traditional roles and skill sets required of performers
  • Performers must adapt to working with digital interfaces, sensors, and real-time feedback systems (motion capture suits, interactive props)
  • Technical proficiency and understanding of digital tools become essential for performers to effectively integrate with technological elements (programming skills, digital literacy)
  • Collaborative partnerships between performers and technologists emerge, fostering interdisciplinary co-creation and knowledge sharing (performance technologists, creative coders)
• The presentation of performance works has been transformed by the use of advanced audiovisual technologies
  • High-definition video projection systems enable the creation of visually stunning, large-scale stage environments (4K projectors, LED video walls)
  • Surround sound systems and spatial audio technologies immerse audiences in rich, dynamic soundscapes (Dolby Atmos, binaural audio)
  • Intelligent lighting technologies, such as programmable LEDs and moving lights, allow for precise control and real-time responsiveness (DMX-controlled lighting, pixel mapping)
• The reception of performance works has been impacted by the proliferation of digital platforms
  • Digital platforms enable broader access and remote viewership, expanding the potential audience for performances (live streaming, on-demand video)
  • Social media and online forums facilitate viral dissemination and real-time audience engagement, creating new forms of performance promotion and feedback (hashtag campaigns, live commenting)
  • The incorporation of new technologies raises questions about the authenticity and ephemerality of live performance in the digital age (digital documentation, virtual performances)

Potential of New Technologies for Performance

Remote Collaboration and Virtual Performances

• Cloud-based platforms and video conferencing tools have facilitated remote collaboration among performers, directors, and creative teams
  • Collaborative software allows for real-time file sharing, version control, and communication across geographical distances (Google Drive, Dropbox, Slack)
  • Video conferencing enables virtual rehearsals, remote directing, and live-streamed performances, transcending physical limitations (Zoom, Skype, Google Meet)
  • Cloud-based rendering and processing services provide access to high-performance computing resources for complex simulations or real-time effects (AWS, Azure, Google Cloud)
• Virtual performances have emerged as alternatives to traditional in-person events
  • Live-streamed concerts, online theater productions, and digital dance performances can be accessed remotely by global audiences (Fortnite concerts, Zoom plays, YouTube dance premieres)
  • Motion capture technology and virtual reality enable the creation of fully immersive, interactive performance experiences (VR dance performances, motion-captured virtual actors)
  • Game engines and virtual production tools allow for the creation of real-time, interactive virtual environments for performances (Unreal Engine, Unity)

Audience Interaction and Engagement

• Augmented reality has been employed to enhance live performances and enable new forms of audience interaction
  • AR overlays can provide additional layers of content, such as translations, annotations, or visual effects, accessible through mobile devices (AR supertitles, interactive program notes)
  • AR-enhanced sets and props can respond to audience input or trigger interactive experiences, blurring the line between the physical and virtual (AR-enabled stage design, interactive AR costumes)
  • Location-based AR experiences can extend performances beyond the stage, engaging audiences in site-specific or immersive narratives (AR walking tours, geolocated AR performances)
• Social media platforms and online forums have fostered new forms of audience engagement
  • Real-time feedback and interaction through social media channels allow audiences to shape the direction or content of performances (live polls, hashtag prompts)
  • Participatory experiences, such as collaborative writing or crowdsourced choreography, invite audiences to co-create with performers (Twitter plays, online dance challenges)
  • Fan-generated content, such as fan art, remixes, or response videos, extends the life and reach of performances beyond the initial presentation (TikTok duets, YouTube covers)
• The use of new technologies has expanded the reach of performance works and enabled global access
  • Live streaming and online distribution platforms allow for performances to be accessed by audiences worldwide, regardless of physical location (Vimeo OTT, Broadway HD)
  • Virtual and augmented reality experiences can be shared and experienced remotely, enabling access to site-specific or immersive performances (360-degree video, AR portals)
  • Online archives and digital repositories preserve and provide access to performance documentation, extending the lifespan and educational value of works (Hemispheric Institute Digital Video Library, Jacob's Pillow Dance Interactive)

Challenges and Opportunities of New Technologies in Performance

Accessibility and Technical Complexity

• The high cost and rapid obsolescence of technological equipment can present financial barriers for performance creators and venues
  • Acquiring and maintaining cutting-edge technologies, such as high-end projection systems or motion capture suits, requires significant investment (4K projectors, Vicon motion capture systems)
  • The fast pace of technological advancement means that equipment can quickly become outdated, necessitating frequent upgrades or replacements (software updates, hardware compatibility issues)
  • Limited budgets and resources may restrict access to advanced technologies for smaller performance groups or independent artists (cost of VR headsets, specialized software licenses)
• The technical complexity of integrating new technologies requires specialized knowledge and skills
  • Collaborating with tech-savvy personnel, such as programmers, engineers, or digital media specialists, becomes essential for successful technology integration (software developers, projection mapping experts)
  • Performers and creative teams need ongoing training and support to effectively utilize and troubleshoot technological systems (workshops, technical rehearsals)
  • The reliance on complex digital systems raises concerns about technical failures, glitches, or compatibility issues during live performances (software crashes, network outages)

Artistic Integrity and Audience Engagement

• The incorporation of new technologies may challenge traditional notions of artistic integrity and authenticity
  • The use of digital enhancements, pre-recorded elements, or virtual performers can blur the line between live and mediated performance (lip-syncing, holographic projections)
  • Questions arise about the role of technology in creative expression and the extent to which it should shape or dictate artistic choices (generative algorithms, AI-assisted composition)
  • The authenticity and ephemerality of live performance may be compromised by the ability to digitally replicate, manipulate, or distribute works (deepfakes, digital reproductions)
• The use of new technologies can create disparities in access and engagement among audiences
  • Some audiences may lack the necessary devices, internet bandwidth, or digital literacy to fully participate in technologically-mediated performances (smartphone ownership, broadband access)
  • The novelty and spectacle of technological elements may overshadow the artistic content or human dimensions of performances (focus on special effects over storytelling)
  • The integration of interactive or participatory elements may favor certain audience demographics or exclude those uncomfortable with technology (generational divides, digital natives vs. digital immigrants)

Interdisciplinary Collaboration and Innovation

• The integration of new technologies presents opportunities for innovative, immersive, and interactive performance experiences
  • Technology can enable new forms of storytelling, sensory engagement, and emotional impact, pushing the boundaries of traditional performance genres (multisensory experiences, non-linear narratives)
  • Interactive technologies allow for personalized, responsive, and evolving performances that adapt to individual audience members (biometric data-driven experiences, AI-generated content)
  • The use of technology can create shared, collective experiences that foster social connection and empathy among audiences (synchronized AR experiences, networked performances)
• The adoption of new technologies in performance can foster interdisciplinary collaborations and knowledge exchange
  • Artists, technologists, and researchers can come together to explore new creative possibilities and develop innovative performance practices (art-science collaborations, hackathons)
  • Interdisciplinary collaborations can lead to the development of new tools, platforms, and methodologies tailored to the needs of performance creators (open-source software, custom hardware)
  • The intersection of performance and technology can drive advancements in fields such as human-computer interaction, affective computing, and immersive media (gesture recognition, emotion detection, spatial audio)
• The use of new technologies can enable greater accessibility and inclusion in performance
  • Assistive technologies, such as closed captioning, audio description, or sign language interpretation, can make performances more accessible to diverse audiences (real-time translation, visual aids)
  • Virtual and online performances can reach audiences who may face physical, geographic, or socioeconomic barriers to attending live events (remote access, pay-what-you-can ticketing)
  • Technology can facilitate the participation and representation of marginalized voices and communities in performance creation and dissemination (digital storytelling, online platforms for underrepresented artists)