林欣怡 // SENSORY LAB 清大感官實驗室

2022-2023 數據聲化計畫

鯓語:數據織碼
[sin-gí]:Data Weaving

© 圖片:林欣怡,〈鯓語:數據織碼〉,2022

訊息可以用作紡織品的編碼內容,織品亦可作為訊息輸出的介面。〈鯓語:數據織碼〉將台灣大傑顛社馬卡道族(Makatao)大武壠族(Tevorangh)西拉雅族(Siraya)三族語言與台灣河洛音的拼音方式,轉譯為二進制語碼,再以古老的「Macramé」編織技術進行語碼編織,成為多語言、多模態族群的交互共存的跨族群共織創作。刺繡、織物不僅作為一種世界性的文化物質性表徵,「縫補」的身體動作亦是一種多主體的交互理解與身體共感的過程。織品的生產是一種編織可見和物質數據的物理行為,而參與織作物件的動作不僅是主體面對材料物質的感知行動,同時也構建了文化技術的意義構建,一種包含身體與時間、物料和文化環境的痕跡,以物質和視覺的方式嵌入織品中。織品向我們展示了一種透過織品圖樣、身體動作和循環行為的數據語言集合,隨著技術訊息以及圖樣視覺的更新聚合,一件織品傳輸的不僅是織面上的視覺數據,也積累了人、文化物質與生活環境之間「文化縫補」關係的物質意義,形成一種循環文化(circular culture)。

The message can be used as coding contents of textiles, and the textiles can also be used as the interface of the message output. ” [sin-gí]: Data Weaving” translates three ethnic groups’ language from Makatao, Tevorangh, and Siraya and the phonetic system of Taiwan Heluo accent into binary codes and uses the ancient “Macramé” weaving technique to create a weaving with cross-ethnic coexistence of multilingual and multimodal groups. Embroidery and textiles not only serve as a worldwide cultural-materialized symbol, but the physical act of “sewing” is also a process of mutual understanding and body empathy of multiple subjects. The production of textiles is a physical behavior of weaving visible and material data, and the action of participating in the weaving of objects is not only the perceptual action of the subject facing the material but also constructs the meaning of cultural technology: a trace of body, time, material and cultural environment that is embedded in textiles in a material and visual way. Textiles show us a collection of data language through patterns, body movements, and circular behavior. With the updated aggregation of technical information and pattern visualization, a textile transmits not only the visual data on the surface of the textile, but also accumulates the material meaning of the “cultural mending” relationship between people, cultural materials, and living environment, forming a circular culture.

[sin-gí]:Data Weaving Technical Presentation © Lin, Hsin-I
Kang-Xi Taiwan Map 康熙臺灣輿圖 © National Taiwan Museum

以清巡臺御史黃叔璥所著《臺海使槎錄》中的〈番俗六考〉作為織碼文本,啟動歷史/當代共構的河洛音原語數據。〈番俗六考〉中關於原民歌曲的紀錄,一方面呈現了某種外來者的紀實註記;一方面也層疊了語言文化「重新描述」的語感詮釋,是一種跨文化並置的書寫模態。在這樣的理解上,藝術家進行當代河洛音原語歌調的再尋訪,尋黃叔璥的路線,追索現世的台灣原民語調的日常聲景。初步將以國內研究學者洪國勝翻譯〈番俗六考〉三首馬卡道族(Makatao)、大武壠族(Tevorangh)與西拉雅族(Siraya)歌曲,三族語言與河洛音的拼音方式,轉譯為二進制語碼。

接續考掘三族的傳統織品刺繡、織法與圖樣進行數據物質化。除了將文化數據轉碼編譯之外,作品也結合特雷門琴數位版的聲響發音裝置,成為可即時互動、感應磁波的聲語織物。

Using the “Fan Su Liu Kao ( Six Investigation of Pingpu customs, ‘番俗六考’) ” in the “Tai Hai Su Tsa Liok ( Investigation Record of Taiwan Sea, ‘臺海使槎錄’)” by Huang Shu-qiu, a Qing imperial officer, as a coded context, it start-ups the historical/contemporary co-construction of the indigenous language data of Heluo accent. The records of the indigenous songs in the “Fan Su Liu Kao ” present documentary notes from some kinds of foreigners on the one hand, and a linguistic interpretation of “re-description” in language culture on the other, which is a cross-cultural juxtaposition of writing modes. Based on this understanding, the artist conducts re-search on the contemporary Heluo accent in indigenous language songs, tracing the route of Huang Shu-qiu to explore the daily soundscape of the present-day Taiwanese indigenous language.

Initially, translating the three Makatao(馬卡道), Tevorangh(大武壠), and Siraya(西拉雅) songs from the ” Fan Su Liu Kao ” by domestic researcher Hong Guo-sheng(洪國勝), three indigenous songs and the phonetic system of Heluo accent(河洛音) will be transcoded into binary codes. Next, traditional embroidery, weaving methods, and patterns of the three ethnic groups were then explored for data materialization. In addition to transcoding the cultural data, the work is also combined with the acoustic pronunciation device of a digital version of Theremin to become an instantly interactive and magnetic wave-sensitive acoustic textile.

// Artist : LIN, Hsin-I  // 2022, textiles, interactive sound installation
// Arduino light theremin programmer:LAI, Wei-Han
// Sound Installation Song : 加蚋埔馬卡道族 Garanpu Makato.踏荷好 [tahoho] by WIND MUSIC International Corporation
// Thanks:HUNG, Go-Zen.KE,Tsu-Hao.sensorium/Mozzi

// From Phonetic system to Binary Data: Cultural Translation of Different Languages

拼音到二進制數據:不同語言的文化轉譯

Transcoding of Taiwan’s Heluo accent and indigenous languages into binary
languages.

Textile production is for making the visible body movements as material data. When
participating in data weaving textiles, the artist collects various kinds of recycled
clothing and emotional data at the same time, and transfers both from words and
images to the material interface through body manipulation, which becomes a kind of
non-digital storage interface. These data textiles are cultural technologies that encode
cultural meanings, material substances, and bodily experiences. 

[sin-gí] Textiles:
coded textiles in two languages of 3 ethnic groups

© Lin, Hsin-I

Laser engraving the translated text
on a transparent acrylic loom with circuit board and pins

© Lin, Hsin-I

// Language data to textile data: the translation of different material media

語言數據到織品數據:不同物質的媒介轉譯

Weaving binary languages with traditional artistry to store material interfaces.

They are composed of human-material interactions, while forming cultural networks that index the meaning of messages. When narratives are translated into message codes, we also translate them into a stable but complex cultural meaning, a cultural update that
encompasses collective memory, multilingualism, and heterogeneous images. Each message storage becomes a shared parameter for the next data collection, which in turn resonates with the output of an open data interface in a multilingual mode.

// From Sound Data to Body Sensing:
Language Decoding of Subject Movement

聲音數據到身體感測:主體動作的語言破譯

By digitizing the principle of the Theremin and detecting body movements through the arduino light sensor, it searches for the semantic meaning of ancient local songs at different distances. The viewer can only hear the “correct” song chanting in a certain position, and only the pitch-tonal modulation can be heard in different positions.

Arduino light sensor Theremin

© Lin, Hsin-I