H.Wanhong

Author Note: This post is a personal speculative reflection prompted by reading the work of Alfredo, Mejia-Domenzain, Echeverria, Rahayu, Zhao, Alajlan, Swiecki, Käser, Gašević, and Martinez-Maldonado (2025). The authors of TeamTeachingViz have produced a careful, empirically grounded, and genuinely valuable contribution to the learning analytics community. Their paper is substantive and thoughtfully designed that it invites the kind of deeper structural questioning attempted below. The mathematical frameworks introduced in this note, category theory, sheaf theory, information geometry, and dynamical systems theory, are exploratory lenses offered in a spirit of intellectual curiosity and humble conjecture. The authors of TeamTeachingViz are not responsible for any of the speculative claims made here, and any errors or overreaches in the mathematical reasoning that follows are entirely my own.

Reference Paper: Alfredo, R., Mejia-Domenzain, P., Echeverria, V., Rahayu, D., Zhao, L., Alajlan, H., Swiecki, Z., Käser, T., Gašević, D., & Martinez-Maldonado, R. (2025). TeamTeachingViz: Benefits, Challenges, and Ethical Considerations of Using a Multimodal Analytics Dashboard to Support Team Teaching Reflection. In Proceedings of the 15th International Learning Analytics and Knowledge Conference (LAK 2025). ACM. https://doi.org/10.1145/3706468.3706475 | Monash University Repository

1. Starting Point: What “Multimodal Matters” Actually Claims

The paper TeamTeachingViz presents a dashboard integrating three data streams to support team teaching reflection in higher education classrooms: indoor positioning data (x-y coordinates of each educator at ~1 Hz via UWB sensors), voice activity detection (timestamped speaking/silent segments from individual microphones), and spatial pedagogy observation codes (human-coded behavioural categories such as Lecturing, One-to-one consultation, or Monitoring). The implicit design argument is clear and defensible: position alone is ambiguous, audio alone is ambiguous, but their combination together with theoretically grounded observation codes gives educators enough interpretive purchase to reflect meaningfully on what happened in a session.

Empirical feedback from educators partially confirms this. The dashboard did provoke genuine reflective dissonance, with one educator surprised to find their educator-to-educator interaction time nearly equalling their educator-to-student time, prompting a concrete reconsideration of classroom priorities. Yet educators consistently requested richer context, especially student-side data and speech content, suggesting that multimodality, as currently implemented, is necessary but not sufficient. The obvious interpretation is that more modalities would help. But there is a more interesting and structurally deeper interpretation: the limitation may lie less in the number of modalities present and more in how their coupling is handled.

The current dashboard treats integration as juxtaposition: a hexagonal heatmap (position + voice), a bar chart (observation codes), and a text panel (co-teaching strategy summaries) are displayed side by side. What this presents is essentially three marginal distributions made visually readable simultaneously. The information that lives between modalities, the joint structure, the dependencies, the cross-modal transitions, the contradictions between channels, is almost entirely invisible. This essay argues that this missing coupling structure is where the genuinely interesting pedagogical information resides, and that systems theory, category theory, algebraic topology, and information geometry together offer a rigorous and productive language for describing it.

Author Note: This is a preliminary investigation of using spinfoam as an intermediate representation to bridge a quantum field theoretical model with music structure. The consideration and design is preliminary, it recommends critical reading it. The materials contains AI assist creation.

Citation: HUANG, W. (2026, February 24). Spin Foam Representation of Music: Theory and Compilation. https://doi.org/10.17605/OSF.IO/7GPZ2

The source code can be accessed from Github: https://github.com/wwwwanhonghuang/Spin-Foam-Representations-of-Music

PDF Source (PDF File Link)

GFT addresses ontological questions and those related to generativity: specifically, what are the primitive units for generating complex structures, and how are complex structures generated?

To answer these two questions, GFT does not assume a specific structure or particle as a primitive, bt rather takes an abstract algebraic group structure as the fundamental entity. Constraints are then defined on this structure to generate a field, with these constraints based on symmetries.

Through the cumulative effects of the field and the perturbative expansion (which allows us to introduce symmetry breaking), we witness the existence of a complex quantized discrete structure. This structure is then interpreted to yield our continuous spacetime. The complex structures involved are often described by spin foams, which involve triangular evolution dynamics.

It is important to note that the geometry derived from the expansion is complex and discrete. Only through the interpretive process do we arrive at the continuous, real spacetime.

Interestingly, symmetry breaking is one of the causes of generativity and creativity. In GFT, the generativity arising from symmetry breaking is realized through the perturbative expansion.

This type of generativity resulting from symmetry breaking is not only found in GFT but also has related manifestations in computational neuroscience. In some studies, the behavior flow is considered a result of symmetry breaking in brain networks. My intuition tells me that there is a certain connection between symmetry breaking and generativity, as well as creativity.

Author Note: The ideas presented here are preliminary and non-rigorous. The goal is to propose a direction of inquiry, not to establish formal results. We invite critique from both legal scholars and mathematicians. AI tools were adopted in the creation of this article.

1. The Starting Observation

Civil law is, at its core, a science of relations. Not things, not acts, but the structured connections between legal subjects — the debt that runs from debtor to creditor, the ownership that connects a person to a piece of land, the guardianship that links an adult to a child. This is not a novel observation. But it raises a question that has not, to our knowledge, been seriously pursued: if civil law is fundamentally about relations and their transformations, and if category theory is the mathematical language of pure relational structure, might category theory offer a natural foundation for civil law analysis?

Citation: HUANG, W. (2026, January 9). [Book] Foundations of Quantitative Social Science Research. https://doi.org/10.17605/OSF.IO/EVR46

PDF Source (PDF File Link)

Productive Failure (Kapur, 2012) is an instructional strategy where learners engage in problem solving before receiving formal instruction. The failure refers to the likely unsuccessful outcomes of these initial attempts. The productive quality arises because this phase of struggle has been empirically shown to improve later learning and the ability to transfer knowledge to new problems (Güreş et al., 2025; Sinha & Kapur, 2021). Beyond better recall, evidence suggests this approach may specifically enhance creativity and novel problem solving (Schwartz & Martin, 2004; Loibl et al., 2017). This raises a central question: why would a period of difficulty and error cultivate novel thinking?

We offer a speculative interpretation using concepts from dynamical systems theory. A dynamical system model describes how a state changes over time according to some rules. We can model a learner’s understanding as a state vector $ x(t) $ within a high-dimensional cognitive space. The evolution of this state is governed by a differential equation: $ \dot{x} = f(x, t, u, P) $. Here, the function $ f $ defines the dynamics. The parameters $ P $ represent the system parameters, here can be the learner’s cognitive architecture, physical features, among others. The parameters shape the system’s inherent dynamics repertoire. The stimulus/inputs $ u(t) $ represents external influences, such as instructional guidance or feedback.

Citation: HUANG, W. (2026, February 5). Spatiotemporal Structures to Music from a Quantum Field-Theoretic Framework. https://doi.org/10.17605/OSF.IO/B62GP

Citation: HUANG, W. (2026, February 5). Spatiotemporal Structures to Music from a Quantum Field-Theoretic Framework. https://doi.org/10.17605/OSF.IO/B62GP

The nature of music and how it emerges has long been a topic of philosophical and scientific inquiry (Scruton, 1997; Levinson, 1990). One influential interpretation, the structural-generative account, posits that music is constituted by regularized structures and the generative processes through which these structures unfold (Lerdahl & Jackendoff, 1983).

In recent years, the transformation of diverse spatiotemporal structures into music has emerged as a significant research topic (Hermann et al., 2011; Dubus & Bresin, 2013). This endeavor holds both theoretical and practical importance. Theoretically, it offers scientific and philosophical insights into understanding what constitutes music (Davies, 2003). Practically, it advances inclusion by enabling individuals with disabilities to create music through alternative spatiotemporal modalities, such as movement patterns or electroencephalographic (EEG) signals (Miranda & Brouse, 2005; Rosenboom, 1990). From existentialist and eudaimonic perspectives, this facilitates the freedom and well-being of people with disabilities (Ryan & Deci, 2001).

However, a unified language and framework for interpreting and implementing mappings from diverse spatiotemporal structures to music remains absent. In physics, quantum field theory (QFT) serves as a universal language for describing how spatiotemporal structures emerge and evolve (Peskin & Schroeder, 1995; Weinberg, 1995). Inspired by this, the present work aims to employ QFT to model different spatiotemporal structures, their generative rules, and processes, and to establish mappings from these structures to musical spatiotemporal structures. Furthermore, we examine the philosophical implications and potential debates surrounding this approach.

Specifically, our research questions are: (1) How can structures and their generative processes be modeled using QFT? (2) How can QFT-based generative models, including generative rules and parameters, be learned from data? (3) How can such models be evaluated? (4) As a preliminary case study, how can EEG signals be modeled via QFT and mapped to music? (5) What are the philosophical dimensions and potential controversies of this method?

In brief, our methodological approach proceeds as follows. For a given spatiotemporal structure, we employ triangulation methods from quantum field theory to decompose it into simplices (Regge, 1961; Ambjørn et al., 2012). We then use QFT formalism to describe how these simplices combine to form complex spatiotemporal structures and evolve over time. For the mapping to music, we model both musical and non-musical structures using QFT-based spatiotemporal frameworks. We then seek an optimal mapping between the two models. This mapping is formulated as an optimization problem and explored through optimization algorithms.

As an initial evaluation of this approach, we conduct case studies on EEG data, mapping these signals to music using the proposed framework. We expect this work to systematically provide a general framework for describing diverse spatiotemporal structures, their generative rules and processes, and for establishing structure-to-music mappings, alongside philosophical discussion and perspectives on the method.

References

Ambjørn, J., Görlich, A., Jurkiewicz, J., & Loll, R. (2012). Nonperturbative quantum gravity. Physics Reports, 519(4-5), 127-210. https://doi.org/10.1016/j.physrep.2012.03.007

Davies, S. (2003). Themes in the philosophy of music. Oxford University Press.

Dubus, G., & Bresin, R. (2013). A systematic review of mapping strategies for the sonification of physical quantities. PLoS ONE, 8(12), e82491. https://doi.org/10.1371/journal.pone.0082491

Hermann, T., Hunt, A., & Neuhoff, J. G. (Eds.). (2011). The sonification handbook. Logos Verlag.

Lerdahl, F., & Jackendoff, R. (1983). A generative theory of tonal music. MIT Press.

Levinson, J. (1990). Music, art, and metaphysics: Essays in philosophical aesthetics. Cornell University Press.

Miranda, E. R., & Brouse, A. (2005). Interfacing the brain directly with musical systems: On developing systems for making music with brain signals. Leonardo, 38(4), 331-336. https://doi.org/10.1162/0024094054762133

Peskin, M. E., & Schroeder, D. V. (1995). An introduction to quantum field theory. Westview Press.

Regge, T. (1961). General relativity without coordinates. Nuovo Cimento, 19(3), 558-571. https://doi.org/10.1007/BF02733251

Rosenboom, D. (1990). The performing brain. Computer Music Journal, 14(1), 48-66. https://doi.org/10.2307/3680116

Ryan, R. M., & Deci, E. L. (2001). On happiness and human potentials: A review of research on hedonic and eudaimonic well-being. Annual Review of Psychology, 52, 141-166. https://doi.org/10.1146/annurev.psych.52.1.141

Scruton, R. (1997). The aesthetics of music. Oxford University Press.

Weinberg, S. (1995). The quantum theory of fields (Vol. 1). Cambridge University Press.

Citation: HUANG, W. (2026, February 5). Spatiotemporal Structures to Music from a Quantum Field-Theoretic Framework. https://doi.org/10.17605/OSF.IO/B62GP

In exploring the essence of music, at the ontological level, there exists the generative-structural account.
The generative process and generative structure together constitute music.

Today, people are exploring the possibility of mapping different structures to music, which has both practical and theoretical significance. Theoretically, it allows us to understand the nature of music and spatiotemporal structures.
Practically, it establishes possibilities for multimodal music creation, which is particularly beneficial for the freedom of artistic creation by people with disabilities.

While existing approaches to mapping structures to music often treat spectral and generative aspects separately, a unified theoretical and practical framework remains lacking.

QFT, as a universal language for describing spatiotemporal structures and their generative processes, this work will first explore using it as a general framework to model spatiotemporal structures and generativity, and map them to musical structures. As a preliminary case study, it will be conducted on the spatiotemporal structures of EEG, considering its important significance for well-being.

Secondly, from the perspectives of philosophy of art and philosophy of science, we will discuss structure and art, as well as possible debates about this method in philosophy, science, and engineering.

As a proposal, this work expects to provide the first systematic quantum field-theoretic framework for structure-to-music mapping.

Citation: HUANG, W. (2026, January 9). [Book] Foundations of Quantitative Social Science Research. https://doi.org/10.17605/OSF.IO/EVR46

PDF Source (PDF File Link)