BC Biermann

Creating a voice-activated 3D talking character in TouchDesigner + new ElevenLabs plugin 🎙️Whisper for speech-to-text 🤖ChatGPT for generating dialogue 🔊ElevenLabs for text-to-speech 🕺🏻MediaPipe for motion tracking 
The component and project file are available on my Patreon and the tutorial is available on my YouTube #elevenlabs #touchdesigner #ai #chatGPT #whisper #openai #MediaPipe #tutorial

52

2 Comments

Our series Inside XR Design explores the best of immersive design. Today we’re talking about how to make an incredible VR trailer using just in-game footage. No mixed reality setups, no complicated compositing—just smart planning and a proven playbook. And keep reading, because at the end, I’ll share a checklist of key technical considerations to make your trailer shine, and share a trailer that exemplifies everything we’re about to talk about. https://lnkd.in/ePbpN-jQ

3

🚀 Exciting Developments in XR Technology! 🚀 Not having controllers is an exciting problem to solve for many XR creators. It pushes us to think beyond "which button should I use for X?" and instead, focus on the most natural way for users to interact with their hands, while ensuring the headset can recognize those movements. As XR becomes fully adopted, we won’t want to carry controllers everywhere; we'll want seamless interactions through XR glasses. However, some XR activities, like firefighter training, require controllers for interacting with various tools and providing haptic feedback. It’s thrilling to see companies working on controller solutions for Apple headsets, unlocking a new realm of XR content on the AVP. https://lnkd.in/gMXWcQHU #VRTraining #AppleVisionPro #XRDevelopment

4

5 Comments

Insightful conversations around XR at the Utstein style meeting. We are trying to apply a technology developed in a different field to teaching. So XR doesn't just need to be equivalent to other methods. It needs to solve problems. Let's ask ourselves the question what jobs are not being done, and if XR can help us in those fields.

27

2024 has been a big year for highlighting the use of haptic feedback in #immersivelearning. We've discovered just how much it boosts learning retention, proving it's a must-have for technical and environmentally-focused training. Haptic feedback enhances the realism and effectiveness of VR experiences, making training sessions more impactful and engaging. If you want to enhance your VR projects with this amazing technology, check out the incredible innovations from the team at HaptX Inc. and learn from our very own Scott Stachiw on how to integrate haptic feedback into your VR projects. #VR #HapticFeedback #TechTraining #InnovativeLearning

11

Instead of focusing on just one specific skill, consider learning the entire software creation pipeline, which includes research, design, development, marketing, sales, user testing, and fundraising. In the future, AI is expected to handle much of the labor-intensive work, allowing individuals to assume the roles of art directors or product owners, creating freely without execution constraints. With no-code tools, anyone can bring their ideas to life by creating software. However, those with technical knowledge such as coding can customize these tools to a higher standard, elevating the quality of outputs. As AI raises the baseline for mediocrity, mastering technology becomes crucial for those who wish to innovate and customize effectively. Once you've mastered one skill, expanding your knowledge to other areas can broaden your perspective and enhance your ability to tackle complex problems across various industries, addressing major challenges like climate change, poverty, renewable energy, disease, wars, and overall human well-being. #AI #XR #Development #Artist #Design #UX #XRealityPro

When we talk about ‘human in the loop’, stress the importance of focusing on the aspects of any process that Generative AI is good at then leaving the others to humans, rarely do tools appear to be empathetic to that mantra. Perhaps it’s the ‘great AI-arms race’ to be the best or the blistering speed of development that hampers thoughtful human-computer design in most AI tools we have seen in the last 2 years. Yet, Wonder Dynamics https://lnkd.in/ghxnGBNg should be applauded for flying in the face of the norms in this regard. As well as looking like a super-exciting advancement in a very laborious task - animation, their use of GenAI in the process carefully positions the user and the tech. To me, this shows the way forward for AI tool development. I want to be able to quickly understand where I have control in a creative process and where I don’t. And I want the software developers to have used domain specific expertise to have found that out. Surely, this sort of basic design thinking 101 is the way forward. #ai #generativeai #design #animation Leigh Harder Philip Murdoch 🤙 Dante St James Tom Oliphant Emil Zankov Dr Sophie Fenton Sofia Fenichell Darren Coxon Matthew Esterman 🧔🏻 Ghazali bin Abdul Wahab Ray Parker MBA Dan Bowen 🎸 Michael Sankey Michael Henderson Robert Love Chantelle Love Seshnie Taylor Chris Goodall Joanne Villis Gary Liang Ed Fairfield Gary Henderson Ben Stratton Nick Johns Jacqueline Manison

16

15 Comments

We're witnessing the innovations of XR unfold before our very eyes! It’s thrilling to be part of this ever-evolving landscape and see firsthand how XR is transforming training, healthcare, and climate change initiatives. This technology isn’t just for gaming; it’s revolutionizing how we learn and work. Organizations must embrace these changes responsibly to maximize their positive impact on society and leverage innovations to better ourselves. https://lnkd.in/e46S5hWW

16

Marc Rotenberg, a top AI Expert, said this about our current trajectory of AI use, "That's where we are at this moment—opaque systems that the experts don't understand, increasingly being deployed by organizations that also don't understand these systems and an industry that says, “don't regulate us.” This is not going to end well." Should we care? Maybe we should review the Universal Guidelines for AI. I wrote about this in Substack.

2

4 Comments

A good listen from Sophia Moshasha and Maxwell McGee, M.Ed. Notable to me was at 8mins20sec when they discuss entering the XR industry. Talented people are coming from all vectors and sectors it's no longer just gaming and 360 cardboard giveaway merch for funzies. Maturity is happening now...it's palpable. Medicine, Education, Professional Collab, VR Hosting, Events Mgmt, Engineering, Architecture, Marketing, digital twinning, community building... blah blah ... I actually just get a kick out reeling them all off 🥰😀 There are plenty of inroads into XR no matter what your flavour. Plus! it's a global local kind of thing in its DNA. We regularly do 100-ish individual VR sessions in a busy classroom day. I'm also regularly VR presenting with friends and collaborators across the AsiaPacific UK North America - it has both sides to it: in-person physical and digital. Contrary to a famous Apple-y quote it's a very social enterprise. anyway... I realise I'm totally gushing... but it's invigorating to hear about and be part of our XR industry. 👍🎵✨️😍

4

2 Comments

Reaching out to my network and beyond....Looking to hire an artist/programmer (expert level) plus 1-2 interns to join our team creating generative visualizations. Javascript/React, data visualization, interest in AI development. See projects here: https://lnkd.in/gfAh3QPC. Please message me if interested in learning more. Visit https://lnkd.in/grXtviPi to see an example of one of the projects. #generativeart #javascript #react #openframework #touchdesigner #datavisualization #programmer #creativecoder #freelancers #hiringprogrammer #sciart #particlephysics

23

13 Comments

Microsoft's Research team just introduced the VASA-1 model for Generating Lifelike Talking Faces from a single image (and audio clip!) 🗣️ The model is able to produce lip movements synchronized with the audio as well as realistic facial expressions and head movements. Key features of VASA-1 include: -Ability to generate 512x512 resolution videos at up to 40 FPS ⚡ -Works with just a single input image and audio clip -Captures a wide range of facial nuances and natural head motions The potential applications for virtual characters and avatars using this technology are going to be pretty extensive! However, they note the technology is still in the research stage with no immediate plans for a public release or API. 🚫 Which if I'm being honest, is probably best at the current time. 😜 Still, quite an advancement! More info can be found on their official research page, here: https://lnkd.in/gYYKzYzn #vfx #visualeffects #technology #ai #research

32

8 Comments

Arcade Studio is a dynamic generative AI platform tailored for XR (Extended Reality) experiences. Through tools like Flux Text-to-Image, Image-to-Animation, AI Image Sculptor, and a 3D World Builder, creators can craft immersive visual content from basic prompts, turning them into animated, interactive, and 3D environments suitable for XR applications. The platform's robust generative features position it as an invaluable resource for digital artists and designers venturing into the realm of AI-powered creativity. Despite its strengths, there are needs for further adjustments in the user interface and experience whereas a minimalist approach may not be advantageous for beginners. #generativeai #arcadestıdio #3d #realtime #design #xr #sculpting

41

3 Comments

We had the opportunity to host David Williams from Meta at Utah Valley University and meet with our #XR student cohort. This took place in the secretive XR Skunk Works Lab. We thank David for taking time to review the amazing #VR work being done across four specific projects: Forensics CSI Simulation: A first phase prototype of a one-of-a-kind and highly specialized learning simulation for the #Forensics program. The implementation will engage students in specific evidence gathering procedures and train them for actual field experiences. A focus on industry leading hand-gesture realism is a hallmark of this creative challenge. (META Funded Project) Scott M. Smith Engineering Building VR Tour: A real-time VR experience using Autodesk #REVIT BIM assets integrated into Epic Games #UnrealEngine to demonstrate the cost-saving utility of architectural pre-visualization before build time. We thank VCBO Architecture for their assistance. (Dean Kelly Flanagan - CET Funded project) Beit Lehi Israel–Archaeology VR Experience: A conceptual VR simulation/adventure experience designed to inspire youth to consider a career in the modern archaeology career path...think Indiana Jones using #LiDAR #photogrammetry #drones #AI and other cutting-edge technologies to uncover artifacts of ancient origins across a working archaeology site. A worn fedora-style hat, leather jacket, and a whip is included. (Wheatley Family Foundation Funded Project) Might 5 Utah National Park Adventure: A conceptual project designed around youth, multiplayer experiences, and total immersion in U.S. National Parks–Zion National Park, Capitol Reef, Bryce Canyon, Canyonlands, and Arches come alive in #Quest3 headsets. Students have been working directly with National Park Service rangers the last six months to gather over 60 VR nodes of trails, hundreds of #HDR photos, and even #SpatialAudio, to capture the essence of being on location! (META Funded Project)

46

2 Comments

A counterpoint for artists navigating AI. Thanks again #musictechcinference Miami for having me. #speaking #founder #aimusic #chadgerber #meloscene #AI #vr #spatialcomputing #visionpro #metaquest #shadowgen #speaker #musician #technology #musictechnology #miami #web3 #virtualreality #artificialintelligence

15

Big congratulations goes out to Aurelia O’Neil, M.Ed for successfully completing NMSU Microlearning Designing the Future: Instructional Design in the Metaverse course! Her final portfolio project was nothing short of extraordinary, and I can’t wait to see her share it with the world. If you’re an instructional designer or someone eager to build on your current skills to create immersive learning experiences, let’s connect! Send me a message, and let’s talk about how this course can help you upskill and stay ahead in this exciting field! #instructionaldesign #virtualreality #edtech

8

1 Comment

#GenAI #fashion #3d #tools #creativity great progress in the field : rendering, shapes and the fold, textiles realism, remains a challenge that AI can solve shortly

5

1 Comment

I've worked in several fields and had to adapt multiple times. #AI is causing some of the biggest changes across multiple industries. I've been learning and working on videos that focus on how #Educators could adapt with AI. I recorded a short talk I recently gave at an "AI Symposium at RIT" - I'd be happy to hear your thoughts on this or others of the new series I've been working on! #AIinEducation, #ai, #educationreform , #EdTech, #eLearning

18