Results (
Thai) 1:
[Copy]Copied!
lies in the interplay between the rhythms in the twodomains. The key to establishing this interplay is theability to synchronize musical and visual rhythms.Sonnet furnishes an ideal platform upon which to buildand combine the necessary components. In particular,interface components can be constructed (e.g. for MIDI,data glove, dance suits) to allow data flows from externalsources to modulate visual parameters. Likewise, becausedata packets can trigger component execution, these sameinterface components act to trigger Imager visuals or tosynchronize activity between Imager and external sources(e.g. of MIDI music content).4.4. OrchestrationThe orchestration of visual (and musical) segments andmodalities is central to organizing a coherent, structuredperformance from basic visual forms and rhythms .Satisfying these needs generally requires real-timefacilities. In particular, where visual rhythms are triggeredsympathetically by musical events, real-time support isnecessary for timely response. Orchestrating segments ofthe visual performance, on the other hand, requires bothhigh-level and fine-grained sequencing support (e.g.,“show this visual five seconds into the second section ofthe piece”). Sequencing at both of these levels isaccomplished using Sonnet’s event flow and real-timesupport to create and propagate events that trigger activityat the appropriate times.5. Tools for Complex CompositionsSonnet+Imager offers three additional tools for dealingwith complex compositions. The first two of these aid thenavigation of long compositions; the last allows artists toconstruct performances containing arbitrarily complexvisuals, regardless of their computational complexity.5.1. Navigating long compositionsSonnet+Imager offers two techniques for navigatinglonger compositions: variable-speed fast-forward, andrandom access (seek). This is accomplished by triggeringImager’s display refresh from a virtual clock, whose ratecan be controlled using a Sonnet+Imager component.Under ordinary circumstances (e.g. during performances),the virtual clock runs in real-time. During editing, theclock can be sped up (and the normal retrace interlockingbypassed) to effect fast-forward. If the rendering isalready running at full speed, then the clock can be madeto advance virtual time in larger increments.The second feature, seek, is trivially implemented bysetting the Imager virtual clock to the desired time(relative to the beginning of the performance).Our current design for the seek feature poses a minorproblem, however. Specifically, we have found that asignificant class of visuals derives value from “artifacts”that are produced as moving visual objects interact invarious ways, as shown in Figure 8. These artifacts arecritically dependent on the history of pixel-level drawingoperations used to render the visual objects. Thus, movingdirectly to a different temporal location elides theintermediate drawing operations, thus losing the artifacts.As a result, continuing the performance from that pointwill produce somewhat (or perhaps radically) differentresults from those achieved when starting from thebeginning of the composition. As of this time, we have nosolution to this problem.
Being translated, please wait..
