Tag: #DI2024oct

Design + Computation + Performance + __________

An innovative software tool enabling users to create dynamic, immersive media environments.

James Grady
Assistant Professor
Boston University

Random Actor is an innovative software tool initiated by James Grady, Assistant Professor of Graphic Design, and Clay Hopper, Senior Lecturer of Directing at Boston University’s College of Fine Arts. This solution connects computation and human performance, enabling users, including theatrical designers, artists, and more, to create dynamic, immersive media environments without extensive coding expertise. By incorporating computational vision, projection mapping, MIDI control, and machine learning into a user-friendly interface, Random Actor democratizes interactive design, making it accessible to a wide range of industries from theater to corporate events and gaming therapy models.

Building on tools like Processing, OpenFrameworks, TouchDesigner, and Unity, which integrate projection mapping, interactive generative graphics, and computational vision, this new tool addresses the challenges of traditional scenic and visual design. These existing tools often require coding knowledge, which can limit accessibility for non-coders. Random Actor bridges this gap by providing an intuitive, user-friendly interface that enables designers and performers to leverage advanced techniques without needing to learn how to code, thus expanding creative expression and adaptability in real-time visual storytelling.

In staging a previous play within an immersive, fully projected-media environment, we found traditional rehearsal methods to be insufficient for achieving the desired aesthetic goals. The excessive time spent adjusting or writing code during rehearsal led to the development of a software application capable of changing the values of any given generative algorithm in real time, without requiring coding knowledge.

We hypothesize that this kind of generative interactive technology could have far-reaching implications for how we construe visual narrative, story structure, and design principles, and how they manifest in physical space as extensions of the human body, speech, sign, and music. Our goal is to develop a new design vocabulary that merges the interior psychology of the performer with the physical environment, expanding the boundaries of Aristotelian narrative structure while affirming their deep relevance to the human experience.

Random Actor aims to bridge the gap between technology, creativity, and research. It expands on a continuum where technology empowers artistic expression. Based on our recent testing during a live play and multiple workshops, our findings suggest a bright future for such tools, indicating they could be further refined and integrated into broader artistic and educational practices, potentially transforming the landscape of design and performance art.

This design research is presented at Design Incubation Colloquium 11.1: Boston University on Friday, October 25, 2024.

Sensory and Ambient Interfaces

Alternative feedback strategies that invert the visual-first priority of digital feedback.

Jonathan Hanahan
Associate Professor
Washington University in St. Louis

For most of its existence, communication design has prioritized visual feedback to users. Even today’s digital interfaces only use other senses, like touch and sound, to alert users to look at a device. As our physical and digital worlds further entwine, a new feedback methodology is required that embraces alternative senses as primary feedback methods, particularly in compromised experiences—where a screen is unavailable, dangerous, or distracting from a primarily complex task. 

My research is interested in evolving a pedagogy that builds on the foundation of craft associated with visual design yet translates it into alternative senses as a catalyst for a world where adding more screens is no longer a valid solution. Through my work in the Sensory and Ambient Interfaces Lab (SAIL) at Wash U, which I founded in 2022, I am building a body of research into alternative feedback strategies that invert the visual-first priority of digital feedback and investigate how information is translated through ambient strategies that “complement a human’s environment, rather than impose themselves on it.”

Through this presentation, I will showcase a range of strategies developed for ubiquitous (apple watch) and novel technologies (custom printable textiles) that output bespoke patterns, intensities, and frequencies at numerous locations on the body to relay complex data non-visually. I will present case studies in development at the Sensory and Ambient Interfaces Lab (SAIL) at Wash U, including current research with WashU athletics, primarily the rowing team, to develop haptic interfaces for performance enhancement. Through this example, I will showcase a design-led research approach to identify user needs and opportunities, design elegant haptic solutions, and test strategies that augment human performance and accelerate the Boyd Observe, Orient, Decide, Act (OODA) loop for situational awareness and decision-making in compromised experiences. These foundational pilot investigations aspire to further collaborative opportunities in other compromised experiences including medicine, military, safety, and more.

This design research is presented at Design Incubation Colloquium 11.1: Boston University on Friday, October 25, 2024.

Designing for Mental Health and Wellbeing: Integrating Mental Health Support into UI/UX Design Course

Collaborative work, peer feedback and positive psychology were integral to the whole process, fostering a supportive learning environment.

Ting Zhou
Assistant Professor
University of Connecticut

The mental health crisis is a significant challenge currently affecting college students. According to data from the Healthy Minds Study, which surveyed 76,406 students across the country, 41% of college students experienced depression, 36% experienced anxiety, 14% experienced eating disorders, 14% had suicidal ideation during the 2022-2023 academic year. The main barriers to help-seeking are “no need for services” (35%) and “not enough time” (24%).  (HMS National 2022-2023 Data Report) Given that 97% of Americans ages 18-29 own a smartphone (Pew Research Center, 2021), the mHealth (mobile Health) application has been one of the primary tools for wellness management, especially during COVID-19. It expands accessibility to support mental health and coping skills, helping students flourish on college campuses. Design thinking (DT) is the fundamental theory in UI/UX design that helps people to become more innovative and creative (Brown T., 2009).

This study aims to explore the integration of mental health support into design education by teaching students to design mHealth applications. The focus is on utilizing human-centered design principles to address mental health challenges among college students. Design students were guided through the design thinking process (empathize, define, ideate, prototype, test) to develop mHealth applications targeting mental health and wellness. Projects were based on students’ personal interests and experiences in mental health, addressing conditions such as ADHD, bipolar disorder, anxiety, sobriety, seasonal affective disorder (SAD), and dissociative identity disorder (DID).  Collaborative work, peer feedback and positive psychology were integral to the whole process, fostering a supportive learning environment.

Through the human-centered design process, students gained profound knowledge of mental health issues on campus and developed innovative solutions tailored to specific user needs. The collaborative approach promoted a culture of empathy and understanding, making students more comfortable discussing mental health and recognizing the importance of self-care. This method normalized help-seeking behavior and integrated positive psychology into their daily lives. It not only prepares future designers to create accessible mental health support tools but also promotes their own mental well-being and professional development.

References

  1. Pew Research Center. (2021). Mobile fact sheet. Retrieved from https://www.pewresearch.org/internet/fact-sheet/mobile/ on 6th of August, 2021.
  2. Brown, T. (2009). Change by design: how design thinking transforms organizations and inspires innovation. [New York], Harper Business.

This design research is presented at Design Incubation Colloquium 11.1: Boston University on Friday, October 25, 2024.

Advancing Design Practices: Assessing the Impact of New Technologies and Sustainable Innovation

The research offers memorable experiences that complement traditional marketing materials.

Caitlin Lu & Maidah Salman
Graduate student
Boston University

Purpose: This study investigates new approaches for displaying designs through digital visualization to enhance engagement and impact while considering the future of design. By integrating methods like projection mapping and digital signage, the research aims to offer memorable experiences that complement rather than replace traditional marketing materials.

The focus is on sustainability, adaptability, interaction, and error correction across various display sizes, including screens and projections. With the global shift toward sustainability, this study offers new strategies for designers to move beyond conventional methods and incorporate more eco-friendly practices.

Process: The research involves a workshop where participants test and compare digital design methods with traditional print media. This includes hands-on experience with projection mapping and a presentation introducing new digital marketing techniques. Following the workshop, participants will complete surveys to measure the effectiveness of different methodology.

Outcomes: Test theory by conducting a workshop where we will check the success rate of digital design as compared to tangible marketing collateral. The findings will highlight how digital visualization can enhance sustainability and audience engagement in design practices.

Significance: The study explores emerging digital techniques that advance conventional design methods, contributing to more sustainable and impactful communication strategies.

This design research is presented at Design Incubation Colloquium 11.1: Boston University on Friday, October 25, 2024.

Drawn Together: Exploring the Intersection of Image-Making and Community-Building

The Center was “founded” in response to a lack of design student cohesion and camaraderie.

Grace Preston
Professor
Texas State University

My paper recounts a collaborative initiative between myself and a cohort of undergraduate design students that we named the Center for Drawn Togetherness. The Center was “founded” in response to a lack of design student cohesion and camaraderie as our institution transitioned back to a fully in-person model post-pandemic. To address these issues, we conceptualized a series of interlocking illustration events that culminated in an exhibition. Each event asked participants to work together, challenging the idea that drawing is a solitary activity and exploring how drawing together could strengthen bonds among participants.

In the first event, a risograph workshop, participants collaboratively designed and printed an official “currency” for the Center. The second event allowed participants to earn “money” by contributing to a collaborative mural, asking them to respond to prompts that could be completed with a partner. The culminating event allowed participants to spend their “money” in a student-run illustration pop-up shop. All happenings were housed in an exhibition that doubled as a gathering space for design students, with student collaborators facilitating the events.

Event planning sessions emphasized Sasha Constanza-Chock’s principles of Design Justice, particularly their assertion that communities should co-lead and control design projects intended to benefit them (2020). Since I was concurrently teaching my student collaborators, planning sessions also challenged the traditional roles of teachers and students, proposing that we can operate as equals.

The workshops received positive feedback from participants, which was gathered through surveys and interviews after the events concluded. The Center plans to use this feedback to develop new initiatives in this upcoming school year. We will continue to investigate how in-person drawing events can potentially promote empathy among students, advocate more collaborative relationships between teachers and students, and encourage young designers to feel ownership over their educational experience.

This design research is presented at Design Incubation Colloquium 11.1: Boston University on Friday, October 25, 2024.

Kaithi Script’s Revival: An Intersection of Design and Cultural Inheritance

Script revival serves as a means of reclaiming and preserving cultural identity.

Anmol Shrivastava
Assistant Professor
Illinois State University

Kaithi (KAE-THEE), also known as Kayathi or Kayasthi, is a script that was once widely used in northern India. Now classified as a “major extinct” script, Kaithi once flourished alongside companion scripts like Devanagari and other major Indian scripts of today. The name Kaithi is derived from ‘Kayastha’, a cultural group known as “scribes”. I am a Kayastha.

Script revival is crucial to colonized cultures, serving as a means of reclaiming and preserving cultural identity. It fosters pride, heritage transmission, and resistance to cultural homogenization, empowering communities to rebuild unique identities and celebrate their heritage.

This presentation explores the intersection of design and ancestry through a personal journey to revive the nearly extinct Kaithi script, historically used by my ancestors, the Kayasthas. It will demonstrate how design can become a powerful tool for historical and cultural revival, offering a unique perspective on the interplay between design, identity, and heritage.

By delving into sparse historical documents of Kaithi and sharing a personal journey of self-learning the script, the presentation will showcase current and upcoming projects that combine typography, type design, lettering, poster design, and embroidery. It will explore projects aimed at broadening the reach of this nearly extinct script by making Kaithi easier to self-teach. This presentation will illustrate how design can play a crucial role in reconnecting with and reviving our ancestral roots, fostering a deeper sense of identity and belonging.

This design research is presented at Design Incubation Colloquium 11.1: Boston University on Friday, October 25, 2024.

A Sequence of Multiplicity

The design outcomes are realized through custom display typefaces, prints, posters, small books, animations, and mixed media. They generate a network of connections between projects.

Moon Jung Jang
Associate Professor
University of Georgia

My creative practice focuses on the simultaneous, multiple existences of mixed feelings or contradictory ideas about unseen things and their information. To understand such a phenomenon, I explore multiplicity as a visual concept and as narrative systems to capture the multiple existences in space-time. My design methodology is as follows: First, I select a group of interrelated unseen things and intangible information, such as temperature, labor, and alignment, that could be meaningful in my daily life. Second, I examine visual qualities that could consist of multiplicity, such as simultaneity, duality, polyhedral-ness, ambivalence, and modularity. Third, I design visual narrative systems to translate or transfer intangible information into metaphoric modules, sequential colors, and their values.

The design outcomes of my work are realized through custom display typefaces, prints, posters, small books, animations, and mixed media, which generate a network of connections between projects. For example, one project, A Sequence of Gray, consists of a book, a series of posters, and an animation that demonstrated the concept of ambivalence and gray gradients as narrative systems to translate the simultaneous existence of black and white. It led to A Sequence of Blue: Labor Day, an installation that translates my unseen laboring time into sequential blue values. In conclusion, this creative practice of multiplicity has allowed me to examine paradoxical, polyphonic, and metaphoric sequences in designing visual narratives and to have active perspectives to understand the unseen.

References

Kenneth Weisbrode, On Ambivalence, Cambridge, MIT Press, 2012

Mari Carmen Ramirez, Hélio Oiticica: The Body of Color, London & Huston, 2007

Italo Calvino, Six Memos for The Next Millennium, Vintage Books, New York, 1988

This design research is presented at Design Incubation Colloquium 11.1: Boston University on Friday, October 25, 2024.

Drawing Water: A Multi-disciplinary Approach to Representing Water Performance

Graphic Design, Landscape Architecture, and Architecture represent an understanding of water systems beyond existing conventions.

Eugene Park
Associate Professor
University of Minnesota, Twin Cities

Jessica Rossi-Mastracci & Matt Tierney
University of Minnesota

Visualizing water systems, across a range of varied spatial and temporal scales, is a complex problem that can be difficult to fully represent on a graphical outcome. Traditionally, these systems have been represented in static, print formats that only convey water’s dynamic flow at a single point in time. This often results in simplistic graphics that show water in a limited perspective, omitting a wide range of scenarios, such as flood and drought that are increasing in frequency and severity due to climate change.

Recognizing the need to innovate in this area, this research aims to develop hybrid representations to convey water and its fluidity across multiple spatial and temporal scales. To achieve this, faculty members in Graphic Design, Landscape Architecture, and Architecture formed a multidisciplinary research team where each discipline offered new insights and methods of representing and understanding water systems beyond existing conventions.

The research team first conducted a broad survey of visualization techniques related to water including heatmaps, chord diagrams, choropleth maps, technical sections, Sankey diagrams, 3-dimensional digital modeling, sequential sections, geospatial data and mappings, decision trees, and system diagrams. Then, these were analyzed to understand types of data that could be displayed, potential spatial scales of use, and relevant time scales, and organized into a graphic matrix that served as a guide to hybridize representation strategies to visualize water as a dynamic and fluid system.

Outcomes from this work resulted in a dashboard prototype that begins to spatially and conceptually represent flows, inputs, uses, and sinks at multiple water scenarios. The intention is to ultimately develop a tool where architects, landscape architects, designers, and engineers can use to plan for future water scenarios at specific locations. Ultimately, this project demonstrates that multiple design disciplines can develop innovative representation and data visualization methodologies through cross disciplinary collaboration.

This design research is presented at Design Incubation Colloquium 11.1: Boston University on Friday, October 25, 2024.

Design + Visual Translation and Cultural Bridging

Recognizing that certain words, phrases, and cultural meanings are untranslatable.

Shuang Wu
Assistant Professor
Virginia Tech

My research explores how graphic design can bridge cultures through translation. Drawing from a multicultural educational background, the study examines the complexities of translation across diverse cultures. Recognizing that certain words, phrases, and cultural meanings are untranslatable, it asks: how can graphic design convey these non-translatable elements through visual expression? The study addresses this question through personal works and pedagogical experiments.

The research begins with A Poetic Space, an immersive project that visualizes ancient Chinese poems using lines, motion, sound, and typography. This approach transcends literal translation, allowing non-Chinese-speaking audiences to appreciate the essence of thousand-year-old Chinese poetry.

Expanding on this, we also explore how visual aids enhance the translation of Chinese culture. A poster series featuring Taoism-inspired phrases reconstructs Chinese characters using an innovative grid, revealing Taoist concepts within the phrases.

In the classroom, I prompt students to investigate how visual elements can translate languages beyond Chinese. Students visually explored non-translatable words from different languages through multimedia. For example, one student created a book based on the Russian word “Toska,” meaning deep sorrow, using a broken typewriter to convey a personal and emotional narrative. This project demonstrates how design can express universal human feelings across languages.

This research shows that graphic design can convey cultural and linguistic nuances that have no direct translation, offering a model for similar projects in various languages and cultures. By using innovative visual methods, it provides ideas for designers and educators to enhance cross-cultural communication and understanding. The practice also aims to shift the focus away from Western design philosophy, encouraging international audiences to appreciate and embrace underrepresented cultures and designers to experiment with their design elements.

This design research is presented at Design Incubation Colloquium 11.1: Boston University on Friday, October 25, 2024.

Visualizing Faculty Salary Inequity: A Study of Salary Compression and Inversion and Its Impact in Higher Education

Empowering faculty with data-driven information to establish a transparent salary structure.

MiHyun Kim
Associate Professor
Texas State University

Have you ever wondered whether you’re being fairly compensated for your work? Have you experienced frustration due to an unfair salary structure? Do you question if factors like your gender, race, or connections to higher-level administrators play a role in this inequitable environment?

This study explores the persistent challenges of salary compression and inversion across various fields in higher education, with a specific focus on the discipline of art and design. Institutions often face the need to attract new talent with specialized skills, resulting in higher starting salaries for new hires and creating disparities among existing faculty members.

As a Faculty Senate Fellow at Texas State University during the 2022-2023 academic year, I developed a series of compelling data visualizations based on regional and national salary compression data sourced from institutional data and the College and University Professional Association for Human Resources (CUPA). The study found that as of the 2022—2023 academic year, 51.8% of the faculty at Texas State University earned below the national median salary and 46.8% of the faculty at the School of Art and Design earned below the national median salary.

By examining salaries across different colleges, departments, and ranks, I aimed to identify trends and patterns in compensation, comparing state universities in Texas and peer institutions across the nation. Also, I pinpointed faculty members earning below the national median salaries, highlighting disparities, especially among senior lecturers, minorities, and full professors. As a result of the study, the university increased the salaries of faculty members whose incomes were below 90% of the national median salary.

To investigate the topic deeper from various perspectives, a salary sub-committee among the faculty senates was formed, and a survey was conducted to gather information and insights from faculty members regarding salary compression issues at the university. The responses were categorized into five groups, and these categories were visualized to encourage empathy and understanding among faculty members and upper-level administrators.

The ultimate goal of this project is to advocate for fair and equitable compensation practices, empowering faculty with data-driven information to establish a transparent salary structure. This presentation explores the visualized data, gains a deeper understanding of salary equity challenges, and contributes to the conversation on reshaping compensation practices within higher education.

This design research is presented at Design Incubation Colloquium 11.1: Boston University on Friday, October 25, 2024.