国立研究開発法人 産業技術総合研究所 人間情報インタラクション研究部門 メディアインタラクション研究グループ Media Interaction Group, Human Informatics and Interaction Research Institute (HIIRI), National Institute of Advanced Industrial Science and Technology (AIST)
The Media Interaction Group targets a variety of media content (music, video, text, user activities, physical devices, etc.) and conducts research on media interaction technologies that can enrich people's life. In particular, our group aims to promote content creation and utilization and enhance the creativity of the society by bridging the gap between creators and consumers. Toward this goal, we develop value-creation support technologies that facilitate content creation by complementing knowledge, experience, and technique of creators. We also develop value-enhancement support technologies that provide consumers with various means of appreciation, retrieval, recommendation, and browsing. These media technologies and interaction technologies demand a broad range of basic and applied research. We conduct research on music information processing, singing information processing, natural language processing, image and video processing, human-computer interaction, web services, signal processing, machine learning, retrieval and recommendation, data mining, visualization, computer graphics, community analysis and support, etc.
お知らせ News
record_voice_over 国際会議ISMIR2024 (San Francisco, CA, USA)のTutorialsに採択されました。[2024/6/17 掲載] [渡邉、後藤]
Masataka Goto, Jin Ha Lee, and Meinard Muller: T2: Exploring 25 Years of Music Information Retrieval: Perspectives and Insights
Daniel Stoller, Emir Demirel, Kento Watanabe, and Brendan O'Connor: T6: Lyrics alignment and transcription: Methods and applications
Yuki Tatsukawa, I-Chao Shen, Anran Qi, Yuki Koyama, Takeo Igarashi, and Ariel Shamir: FontCLIP: A Semantic Typography Visual-Language Model for Multilingual Font Applicationsopen_in_new
Shuhei Tsuchida, Satoru Fukayama, Jun Kato, Hiromu Yakura, Masataka Goto: DanceUnisoner: A Parametric, Visual, and Interactive Simulation Interface for Choreographic Composition of Group Danceopen_in_new
Daichi Horita, Jiaolong Yang, Dong Chen, Yuki Koyama, Kiyoharu Aizawa, Nicu Sebe: A Structure-Guided Diffusion Model for Large-Hole Image Completionopen_in_new
- Ryota Mibayashi, Takehiro Yamamoto, Kosetsu Tsukuda, Kento Watanabe, Tomoyasu Nakano, Masataka Goto, Hiroaki Ohshima: Verse Generation by Reverse Generation Considering Rhyme and Answer in Japanese Rap Battlesopen_in_new
- Tomoyasu Nakano, Momoka Sasaki, Mayuko Kishi, Masahiro Hamasaki, Masataka Goto, Yoshinori Hijikata: A Music Exploration Interface Based on Vocal Timbre and Pitch in Popular Musicopen_in_new
- Kento Watanabe, Masataka Goto: Text-to-lyrics generation with image-based semantics and reduced risk of plagiarismopen_in_new
- Kosetsu Tsukuda, Tomoyasu Nakano, Masahiro Hamasaki, Masataka Goto: Unveiling the Impact of Musical Factors in Judging a Song on First Listen: Insights from a User Surveyopen_in_new
- Kosetsu Tsukuda, Masahiro Hamasaki, Masataka Goto: Chorus-Playlist: Exploring the Impact of Listening to Only Choruses in a Playlistopen_in_new
- Haven Kim, Kento Watanabe, Masataka Goto, Juhan Nam: A Computational Evaluation Framework for Singable Lyric Translationopen_in_new
- Hiromu Yakura, Masataka Goto: IteraTTA: An interface for exploring both text prompts and audio priors in generating music with text-to-audio modelsopen_in_new
- Tian Cheng, Masataka Goto: Transformer-based beat tracking with low-resolution encoder and high-resolution decoderopen_in_new
- Tomoyasu Nakano, Masataka Goto: Music source separation with MLP mixing of time, frequency, and channelopen_in_new
- Vincent K.M. Cheung, Lana Okuma, Kazuhisa Shibata, Kosetsu Tsukuda, Masataka Goto, Shinichi Furuya: Decoding drums, instrumentals, vocals, and mixed sources in music using human brain activityopen_in_new
Kosetsu Tsukuda, Keisuke Ishida, Masahiro Hamasaki, Masataka Goto: Kiite Cafe: A Web Service Enabling Users to Listen to the Same Song at the Same Moment While Reacting to the Songopen_in_new
Daichi Horita, Jiaolong Yang, Dong Chen, Yuki Koyama, and Kiyoharu Aizawa: A Structure-Guided Diffusion Model for Large-Hole Diverse Image Completionopen_in_new
Jun Kato, Jonas Frich, Zhicong Lu, Jennifer Jacobs, Kumiyo Nakakoji, and Celine Latulipe: Special Interest Group on Creativity and Cultures in Computingopen_in_new
Jun Kato and Masataka Goto: Lyric App Framework: A Web-based Framework for Developing Interactive Lyric-driven Musical Applicationsopen_in_new
Riku Arakawa, Hiromu Yakura, and Masataka Goto: CatAlyst: Domain-Extensible Intervention for Preventing Task Procrastination Using Large Generative Modelsopen_in_new
Yuki Koyama, Masataka Goto: BO as Assistant: Using Bayesian Optimization for Asynchronously Generating Design Suggestions (UIST2022)open_in_new
Hiromu Yakura, Yuki Koyama, and Masataka Goto: Tool- and Domain-Agnostic Parameterization of Style Transfer Effects Leveraging Pretrained Perceptual Metrics (IJCAI2021)open_in_new
Daichi Haraguchi, Shota Sakaguchi, Jun Kato, Masataka Goto, Seiichi Uchida: Fonts That Fit the Music: A Multimodal Design Trend Analysis of Lyric Videosopen_in_new
Media Interaction Group
Human Informatics and Interaction Research Institute (HIIRI),
National Institute of Advanced Industrial Science and Technology (AIST)
AIST Tsukuba Central 2, 1-1-1 Umezono, Tsukuba, Ibaraki 305-8568, Japan