Modeling Art History


For my modeling & simulation class this Fall, I am exploring a new collaboration with colleagues from the Dallas Museum of Art (DMA).  The exploration consists of a mix of digital humanities, art history, computer science, and modeling & simulation. The above image is of a tunic that is part of the DMA collection and currently on display in the exhibition entitled Inca: Conquests of the Andes/Los Incas y las conquistas de los Andes. It is a beautiful piece with rich history from the Peruvian culture. What does this have to do with process modeling that we do in simulation? The tunic, like all works of art, can be interpreted and presented in numerous ways. I think this diversity of interpretation is central to both modeling and to the humanities. Bruno Latour, in How to Be Iconophilic in Art, Science, and Religion [1], concludes his essay with "The difficulty is to learn how to be iconophilic for one form of visual culture without being iconoclastic for the others." We need diversity in interpretation, and modeling helps achieve this diversity with multiple, mediated objects each providing an understanding of a phenomenon, like the checkered Andean Tunic. How might we model a process that partially re-creates this pattern? This can be done with text-based scripts or with a visual program. How did the Peruvians weave this particular tunic (ref. Lesli Robertson's gallery talk)? One classic technology employed is the back-strap loom. How might we use modern weaving methods and weaving draft notations to model something similar? How were the red and black dyes made for the pattern? What transportation processes (people and things moving around) were in place to get materials to and from their locations? All of these are questions of process [2], and models of process are therefore creative interpretations of the tunic. Process models can be an integral part of the history and interpretation of art. In last year's class, we used Max/Msp (a visual programing data flow program used by artists) and the target scenarios to be modeled came from everywhere. This year our targets are all inside the DMA. We are therefore continuing to use Max, but diving further into the art world for our cultural context. Can we learn to see these models in the art? Can diagrammatic models provide additional interpretation and knowledge about art and culture? This approach is a departure from "Big X" (e.g. Big Data).  We may find some interesting workflow models that yield new information on art by amassing and sifting through huge online collections. This should be part of our process. But, to quote Feynman in the spirit of "close reading" within the traditional humanities, there is plenty of room at the bottom if we only diversify our interpretations of a single work.

[1] In Latour, B. 1998. How to Be Iconophilic in Art, Science, and Religion? in Jones, C. A. & Galison, P., Eds, Picturing Science Producing Art, Routledge.

[2] Questions of process are not only central to modeling and simulation but also to computer science. The term "code" means to model a process, usually with typographic symbols in the form of a program or script.

Modeling in Common Core


We know that reading, writing, and arithmetic represent the basics in the education of our youth.  But what of modeling? According to an article from last year's US News and World Report, "The Common Core Math Standards: Content and Controversy," there is to be more of an emphasis on modeling concepts. The report "Progressions for the Common Core State Standards in Mathematics (draft), 4 July 2013" provides additional detail on the role of modeling at the high school level. This may be the age old set of issues centered on whether we teach math as a subject without real-world relevance, or whether connecting math to the world creates a deeper understanding. I would guess that most modeling and simulation (M&S) practitioners would favor introducing modeling in K-12, or at least at the high school level. But is this so? Is modeling more complicated than memorizing and practicing dry, abstract methods? Can real-world relevance help learner attention and motivation? If it can, then enter modeling--center stage. [More information on Modeling in CC].

Formalized Synesthesia


I recently engaged in a three-way podcast conversation covering research that we do in the CA lab, as well as activities in the Creative Automata class that I teach--if that is even the right word. Guide? The title of this post is gleaned from Christopher White who works with Elecia White. I engaged in dialogue with both of them, and thoroughly enjoyed our discussion. Elecia and Chris produce a podcast called Embedded where the main theme is embedded systems and electronics. But they tackle a wide variety of interesting topics around this central theme. This audio podcast name Bubblesort Yourself was invented by Elecia, and the hour long podcast can be found here. Their Embedded podcast can also be accessed using the Apple podcast app or the equivalent app on Android phones and tablets. I listen to their podcasts regularly, and also to other podcasts while I take long walks. For some of you, driving the car or working out in the gym may be good times for podcast listening. Chris White also posted an accompanying blog entry where he expands upon formalized synesthesia. Is that what we do when we model in simulation? It seems to be on the basis that we employ many models, each of which contains a hidden set of analogies. The models are encoded with respect to our senses [credit: artwork Synesthesia above is from Nuno de Matox].

Modeling the New You


If you go to Google Images, and you type in the word "modeling," if you are like me, you might expect to see all sorts of equations, diagrams, and software interfaces allowing scientists and engineers to model complicated things. Instead, from the public's perspective, or perhaps from the perspective of the advertising industry, modeling means to model clothing. Fashion. Runways. The above image is from Top Ten Modeling Agencies. At first glance, this type of modeling is something we might be tempted to dismiss as irrelevant to our supposedly higher ambitions within mathematics, science, and engineering. But, this type of modeling is ubiquitous and serves as a good way to talk about modeling to others. Why not talk about models by covering fashion? You probably have heard of a "model house" or a "model kitchen." This type of model refers to model as prototype. Rather than modeling a pre-existing phenomenon like automobile traffic or heat exchange, model as prototype brings in design as a type of modeling. The model house may be one you'd like to live in. The model kitchen gives you ideas of how you'd like your kitchen to look and function. So, if you want to explain what you do as a modeler to others, begin with common terms and experiences. Meet people on their ground, with their understanding of model. And wear something suitable like a well-designed pair of jeans. You might be surprised when the next day, your friend shows up wearing the same clothing. You have become a model. [Source concept: from a column that I did long ago for the Society for Modeling & Simulation International].

Creative Disturbance


In a recent audio podcast, three of us were discussing personalized modeling from different angles--including using art and craft-inspiration, and engineering culture. Karen Doore, Sharon Hewitt, and I engaged in a short conversation that is part of a series of podcasts called Creative Disturbance. Anyone who has been to a modeling and simulation conference notices that...the people attending are all quite different. Often having different degrees and from different departments and schools. There is good reason for this: modeling is inherently an area that connects different people and things together. This diversity plays out, also, in our modeling choices. What is your favorite modeling system or language? What underlying analogies are used?

Modeling is the New Coding


Coding. Modeling. Which came first? And what should we be teaching our students? There has been some recent discussion on this from two blogs: Chris Granger who suggests that modeling is the new literacy, and Mark Guzdial who observes that modeling requires coding. Let me begin from the beginning--as an after-school programmer in 10th grade with punched cards and FORTRAN 66. We were introduced to a green plastic IBM template which captured the modeling task known as flowcharting. Flowchart templates promote control flow thinking--these control flow diagrams are models of code. One made a flow diagram first, then wrote code. I don't know whether this is still common practice--to model control flow in pictures, and then proceed to write down code as text. Has this modeling effort been relegated only to the advanced reaches of software engineering courses taken only by CS majors?

Chris and Mark both have valid points. Code is at the bottom layer of modeling. Think of code as modeling with the technology of type. All models are tied to explicitly to types of technology, and so types of media. Consider James Clerk Maxwell's plaster model of Gibb's thermodynamics surface. A new way of understanding thermodynamics--using the technology of plaster of Paris. Typeset equations are another way. If your technology is a typewriter or a keyboard, then your computing model is going to look like code. If you use different technology, your "code" will look radically different -- it may be physical or in diagrammatic form. Most dynamic models we create in the CA Lab are either physical or diagrammatic, but code is indeed at the bottom layer. When I teach process, I cover a combination of control and data flow methods. Data flow thinking is where the process is based on a description of how data are manipulated over time--data flow is a natural way of thinking about computing, and it has the added benefit of weaving in thousands of years of analog computing practice. Another benefit of data flow thinking and modeling is that one comes to understand computer science, and information science, as real sciences--seeing information everywhere rather than remaining glued to a keyboard and the accompanying video. We need modeling and we need coding. But, more than this, we need the respective communities around modeling (e.g., SCS, ACM SIGSIM, IEEE Systems Science, Engineering & Cybernetics) to better connect with organizations devoted to teaching computer science (e.g., ACM SIGCSE). Because these two communities seem lightyears away from each other when they shouldn't be.

Meeting on the Knowledge Bridge



Most of our research in the Creative Automata Lab is devoted to better understanding mathematics and dynamic system modeling through multiple modalities and representations. This strategy is partially art-based, and stresses an individual orientation toward education rather than one based on standard notations pushed to the masses. The lab stresses having more people understand modeling. Last month, I was intrigued by news of someone in the UK holding a professorship entitled the Public Understanding of Philosophy. And I found information on two faculty (Richard Dawkins and Marcus du Sautoy) who hold the title of Simonyi Professor for the Public Understanding of Science at Oxford. The emphasis on public understanding of an academic area has a strong fit with our lab goals. But, there is something deeper happening: Ideally, all university faculty should strive toward a public understanding of their disciplinary topics. Engaging the public directly, and speaking more broadly about an area, should be explicitly encouraged and rewarded by university administration at all levels. As faculty, we need to maintain deep disciplinary depth, but we must also strive to gently establish tendrils throughout the university knowledge infrastructure. A justification for this need can be seen in the latest version of National Geographic entitled "Why do Many Reasonable People Doubt Science?" Perhaps fewer people would doubt science if universities made a stronger effort at public outreach and communication. Public outreach is not a speciality; it should be a job requirement within the academy. Publishing in a society transactions moves a field forward, expanding our essential knowledge base. Talking and publishing to a wider audience brings more people into our fields. More people on the planet become better educated. If we try, we can achieve both breadth and depth of knowledge. If you are a faculty member at a college or university, you find yourself in a park on one side of a bridge. The public is waiting for you on the other side. Meet in the middle?

Design It For Yourself


Design is a big word, and something we all feel passionate  about. We know from Jonathan Ive of Apple that well-designed things can enrich our lives and, indeed, do quite well in the marketplace. Think of products such as the iPhone, iPad, and the upcoming iWatch. These products are well designed by Apple, and meant for you, the consumer. There are ways to customize the look and feel of the human interface in these devices. But, is it possible for people to design things for themselves? Yes, but for a different type of market: self-education. Imagine that you are in a class, trying to learn something hard like computer science or calculus. Further imagine that the teacher, rather than dishing out pre-designed computing and mathematical structures plays the role of facilitator, allowing you to design your own objects. Design your own code. What would it look and sound like? Design your own integrator. Make your own personal language. Design your own representation for equations. This isn't about markets and sales. It is about allowing you to craft your own self-inspired representations--as a way to promote self-interest and creativity--you may come to learn better because you have been given an opportunity to create rather than to interpret the symbols of others. This approach of designing something yourself to learn something goes by another name: art. Let's promote learning by creative representation and creative design. Design, in this particular instance, not of creating something for other people, but creating something because it moves you.

Personalized Model Learning

Property release:3 Model release:Q,E,J


Much of what we do in the Creative Automata (CA) Lab is oriented around multiple representations of a single abstract mathematical concept--such as integration in calculus or sorting in computer science. How can we personalize approaches for learning something like integration? Is it possible to leverage our multiple cultures to engage and motivate the learner? The lab just submitted our video entry to the National Academy of Engineering (NAE) Grand Challenges for Engineering Video Contest called E4U2. Sharon Hewitt from the CA Lab designed and produced this video. The video segments include representations of a virtual analog computer based on the sand-like flow in PowderToy, as well as several personalized models of the Lotka Volterra model. Instead of  making models for other people, consider that you can learn about modeling by making these wonders for yourself. In this arts-based approach, you will also interest other people in modeling.


Naked Rabbits


This is a circuit created by a Creative Automata Lab research assistant David Vega. The circuit is a physical incarnation of the Fibonacci difference equation f(m) = f(m-1) + f(m-2), where "m" equals the current month in decimal. We begin the Fibonacci sequence by iteratively solving, beginning with f(0)=f(1)=1. These values jump start the difference equation: f(2) = f(1) + f(0), f(3) = f(2) + f(1), and so forth. The sequence ends up as 1,1,2,3,5,8,13,21,34 until we decide to stop. These numbers are termed Fibonacci numbers. There are all kinds of interesting real-world patterns related to these numbers, including the spiral pattern found within a nautilus shell. This equation represents an idealized model of rabbit population growth. The equation was re-represented as a visual Max/MSP patch, and then translated into an equivalent electronic circuit using Teensy 3.1 microcontroller boards. The boards, populating the breadboard above, are connected using serial communications, and there is "software clock" that regulates the data flow. In Max/MSP this clock is programmed as a [metro] (short for metronome) object. This circuit will be transformed yet again into a tangible artwork where the Teensy boards are housed in 3d printed rabbit objects. I'll post another entry when we get to that stage. You've probably heard of "embedded systems," so this is a case where the embedding is meant to draw in the participant in a way not really possible with the textual difference equation.

The Illusion of Usability


Usability is a key topic and frequently thought of from the perspective of the human-technology interface. How easy is your oven to use? Is your exercise bracelet elegant, but hard to put on your arm? The illusion of usability is related to my previous post, since usability depends on the person using it. There is no such thing as generalized usability. Let's take a famous graphic--shown above--created by Charles Minard. This graphic is a map of Napoleon's disastrous Russian campaign of 1812. This is a visually striking map and elegantly shows a number of variables (6 types). The diagram is probably adorning walls and in coffee table books everywhere. According to a Wikipedia article, "modern information scientists say the illustration may be the best statistical graphic ever drawn." If your expertise is statistical graphics, knowledge of such a map is undoubtedly of significant academic use. What if you just wanted to know how many soldiers died during the walk to Moscow and back? What if you were not interested in knowing the temperature, or the lat/lon geographic coordinates? Perhaps you'd rather experience what it was like in 1812 during the slow frozen march? Representations are only as good as the explicit, and unique, purpose required by a viewer. An eight year old might do better with a verbal description, or a reproduction of a painting that is not too graphic. I attended a talk recently, where the speaker spent some time crafting a story using a slide containing Minard's graphic--the illusion was that the image was telling the story, when in fact, one had to consider the medium being used, the speaker's voice, the elements left in, and left out of the story. The image itself has no story to tell; one requires human interaction to achieve that effect--it was his theatrical performance that brought Minard's graphic to life. Models are just like Minard's masterpiece--you have to design them very carefully for one specific type of user.  Ideally for a single person. Is there a simulation model equivalent to Minard's graphic? The notion that one size fits all is false at best, and dangerous at worst.

Personalized Simulation Modeling


Artists created the first virtual realities -- sometimes in the forms of cave drawings, paintings, and friezes.  The above photograph is a woman who is experiencing the virtual experience of stereo viewing of a remote object or scene with a stereoscope. As modeling and simulation researchers, we should think of new ways to represent models of observed phenomena. Do you use equations, statistical plots, or diagrams with pointy arrows and boxes? With the rapid expansion of the web, we are reaching a state where multiple representations for any abstract concept are at our fingertips. Seeing one abstract concept 300 different ways. This is especially important for those outside of engineering. Modeling and simulation, as a discipline, is becoming so widespread that we need to bring the academic knowledge of our area into the hands of everyone. We are not going to reach the masses with limited human experiences for modeling. That means diversity in model representation. Want to model something but not in Simul8 or Arena, but instead in Minecraft? Go for it. For the professional engineer, Minecraft is the wrong choice. But for teaching the student who grows up in these new powerful multi-player virtual worlds, why not use environments that attract them rather than conforming to a perceived set of standards employed mainly by a limited set of professionals. Strap on your Victorian-era stereoscope and come with me on a different sort of simulation modeling adventure.


Exploring Computing Representation

%d bloggers like this: