Publication Type

Conference Proceeding Article

Version

publishedVersion

Publication Date

11-2023

Abstract

The rise of social media platforms has brought about a new digital culture called memes. Memes, which combine visuals and text, can strongly influence public opinions on social and cultural issues. As a result, people have become interested in categorizing memes, leading to the development of various datasets and multimodal models that show promising results in this field. However, there is currently a lack of a single library that allows for the reproduction, evaluation, and comparison of these models using fair benchmarks and settings. To fill this gap, we introduce the Meme Analytical Tool Kit (MATK), an open-source toolkit specifically designed to support existing memes datasets and cutting-edge multimodal models. MATK aims to assist researchers and engineers in training and reproducing these multimodal models for meme classification tasks, while also providing analysis techniques to gain insights into their strengths and weaknesses. To access MATK, please visit https://github.com/Social-AI-Studio/MATK.

Keywords

meme, multimodal analysis, visual-language models

Discipline

Graphic Communications | Graphics and Human Computer Interfaces | Numerical Analysis and Scientific Computing

Publication

MM '23: Proceedings of the 31st ACM International Conference on Multimedia: Ottawa, October 29 - November 3

First Page

9689

Last Page

9692

ISBN

9798400701085

Identifier

10.1145/3581783.3613463

Publisher

ACM

City or Country

New York

Copyright Owner and License

Authors

Additional URL

https://doi.org/10.1145/3581783.3613463

Download

Share

COinS