About Me

Womin djeka! This is my personal – not an official RMIT – website. I’m a Senior Lecturer at RMIT University (School of Computing Technologies), an Associate Investigator at the ARC Centre of Excellence for Automated Decision-Making and Society, RMIT Research Leader at the Australian Internet Observatory, and a member of the International Panel on the Information Environment. I was the recipient of an ARC Discovering Early-Career Research Award (DECRA).

My main research interests are Information Retrieval (IR), Text Analytics, and Data Science. I currently work on evaluation of information access systems and interactive information retrieval.

In my free time, I teach Capoeira at the Associação de Capoeira Descendente do Pantera (ACDP) – where I am also known as Contramestre Camaleão – and play samba with Wombatuque.

I acknowledge the people of the Woi wurrung and Boon wurrung language groups of the eastern Kulin Nation on whose unceded lands I live, work, learn, and teach. I respectfully acknowledge their Ancestors and Elders, past and present. I also acknowledge the Traditional Custodians and their Ancestors of the lands, waters, and skies across Australia, and their connection to Country.
Interests
  • Information Retrieval
  • Human-AI Cooperation
  • Evaluation Methodologies
Education

  • PhD in Computer Science, 2014

    UNED (Madrid, Spain)

Affiliations

rmit
RMIT University

Senior Lecturer, School of Computing Technologies

adms-fill
ADM+S

Associate Investigator, ARC Centre of Excellence for Automated Decision-Making and Society

adms
AIO

RMIT Research Lead, Australian Internet Observatory

Publications

Johanne R. Trippas, Damiano Spina, Falk Scholer (2025). Adapting Generative Information Retrieval Systems to Users, Tasks, and Scenarios. Information Access in the Era of Generative AI.

PDF Cite DOI Chapter Book

Simon Coghlan, Hui Xian Chia, Falk Scholer, Damiano Spina (2025). Control Search Rankings, Control the World: What is a Good Search Engine?. AI and Ethics.

PDF Cite DOI

Rahmad Mahendra, Damiano Spina, Lawrence Cavedon, Karin Verspoor (2025). Evaluating Numeracy of Language Models as a Natural Language Inference Task. Findings of the Association for Computational Linguistics: NAACL 2025.

PDF Cite Dataset

Laura Plaza, Jorge Carrillo de Albornoz, Iván Arcos, Paolo Rosso, Damiano Spina, Enrique Amigó, Julio Gonzalo, Roser Morante (2025). EXIST 2025: Learning with Disagreement for Sexism Identification and Characterization in Tweets, Memes, and TikTok Videos. Advances in Information Retrieval.

PDF Cite Project

See all publications

Projects

Half-Day Tutorial at ACM SIGIR CHIIR 2025
While the concept of responsible AI is becoming more and more popular, practitioners and researchers may often struggle to characterize responsible practices in their own work. Using a hands-on approach – where participants are invited to discuss terminology from their own perspectives – this tutorial aims to illustrate the application of responsible practices in Information Retrieval (IR), including fairness-aware information access, diversity, and misinformation management. Using case studies based on existing IR research, the tutorial will explore responsible AI concepts such as positionality, participatory research, fairness, diversity, and ethics.
CHIIR'25 Abstract
Half-Day Tutorial at ACM SIGIR CHIIR 2025
NeuroPhysIIR Workshop at CHIIR 2025
The International Workshop on NeuroPhysiological Approaches for Interactive Information Retrieval (NeuroPhysIIR'25) at ACM SIGIR CHIIR 2025 aims to bring together experts and non-experts interested in advancing knowledge on how to effectively use neurophysiological signals captured with multiple wearable devices to characterize cognitive and affective processes that occur when we interact with information access systems, including search engines, recommender systems, and conversational assistants. The workshop aims to lower the entry barrier to this research area, and researchers and practitioners without experience in any of the disciplines involved (cognitive science, information science, wearable computing, etc.) are particularly welcomed.
CHIIR'25 Abstract
NeuroPhysIIR Workshop at CHIIR 2025
Australian Internet Observatory (AIO)
The Australian Internet Observatory (AIO) is a new, four-year national research infrastructure initiative that will create an interconnected ecosystem of people, data and tools to support innovative approaches to the collection and analysis of digital social data across a range of disciplines and sectors. It will enable researchers to explore topics such as the distribution of misinformation, the patterns of everyday engagement with business, culture and science, flows of communication in emergencies and humanitarian crises, and the dynamics of political conflict and consensus. AIO will develop the tools and capabilities required to gather and analyse online user experience data, algorithms, and interactions. It will support innovative approaches to the collection and analysis of digital social data and internet platforms and the analytical tools and governance required to support cutting-edge research on social, economic, health, and environmental issues.
Australian Internet Observatory (AIO)
Walert - Your Open Day FAQ Buddy
Woi wurrung / Boon wurrung word for ‘possum’, Walert is a conversational agent that answers questions about prgrams at the RMIT School of Computing Technologies (SCT). We used an in-house deployed large language model to rephrase questions and answers in an existing Frequently Asked Questions document for SCT programs to train the conversation model of Walert. We built an evaluation framework to compare the effectiveness of intent-based and Retrieval-Augmented Generation (RAG) architectures for customized chatbots.
PDF Code Video CHIIR'24 Award
Walert - Your Open Day FAQ Buddy
EXIST: sEXism Identification in Social neTworks
EXIST is a series of scientific events and shared tasks on sexism identification in social networks. EXIST aims to capture sexism in a broad sense, from explicit misogyny to other subtle expressions that involve implicit sexist behaviours (EXIST 2021, EXIST 2022). The third and fourth editions of the EXIST shared task was held as a Lab in CLEF 2023. [NEW] Next CLEF 2025 in Madrid, Spain will host the fifth edition of EXIST, including tasks to study sexism characterization in text (microblog posts/tweets), images (memes) and video (TikTok)!
EXIST 2022 EXIST 2023 EXIST 2024 EXIST 2025
EXIST: sEXism Identification in Social neTworks
ADM+S Project: Quantifying and Measuring Bias and Engagement
Recent developments in machine learning, information access, and AI communities attempt to define mechanisms to minimise the creation and reinforcement of unintended cognitive biases. This research aims to address research questions related to quantifying and measuring bias and engagement by focusing on information access systems that involve automated decision-making components. By partnering with experts in fact-checking, we use misinformation management as the main scenario of study, given that bias and engagement play an important role in three main elements of the automated decision-making processes: the user, the system, and the information that is presented and consumed.
CACM SIGIR'23 CIKM'23 UbiComp/ISWC'23 SIGIR'24 SIGIR'24 SIGIR-AP'24 ICMI'24 ICMI'24 SIGIR Forum CHIIR'25 MobileHCI'24 ADM+S News and Media Report Technical Report
ADM+S Project: Quantifying and Measuring Bias and Engagement
Cortana Intelligence Institute
Cortana Intelligence Institute was a co-funded initiative between Microsoft Research, Cortana Research and RMIT University (2018-2020), which advanced knowledge on new capabilities of digital assistants. The Institute focused on researching work-related tasks, an area that helped to develop more proactive and context-aware digital assistants. Microsoft’s researchers collaborated with RMIT team members on the development of algorithms that used a novel dataset to improve Cortana.
CHIIR'19 TI@WSDM'19 ICMR'20 IJHCS
Cortana Intelligence Institute
RepLab: Online Reputation Monitoring
RepLab is a competitive evaluation exercise for Online Reputation Management systems organized as an activity of CLEF for the 2012, 2013, and 2014 editions. RepLab focused on the task of monitoring the reputation of entities (companies, organizations, celebrities, etc.) on Twitter. The monitoring task for analysts consists of searching the stream of tweets for potential mentions to the entity, filtering those that do refer to the entity, detecting topics (i.e., clustering tweets by subject) and ranking them based on the degree to which they signal reputation alerts (i.e., issues that may have a substantial impact on the reputation of the entity).
RepLab 2013 RepLab 2014
RepLab: Online Reputation Monitoring

Supervision

Current PhD Students

Current Master and Hounours Students

Former PhD Students

Former Master and Honours Students

  • Tony Smith, How Well Can A Pre-Trained Large Language Model Detect Sexism in Tweets?, RMIT University, 2024. [Paper]
  • Reham Abdullah Altalhi, Search Results Fairness based on Analytical Hierarchy Process, RMIT University, 2022. [Paper]
  • Binh Chon Nut Le, Investigating Algorithmic Bias via Crowdsourcing, RMIT University, 2020. [Paper]
  • Xinhuan Duan, Two-Step Classification for Profiling Fake News Spreaders on Twitter, RMIT University, 2020. [Paper]
  • Shubhdeep Singh, Spoken DialogWOZ : A Tool to PerformWizard of Oz Experiments in Speech-Only Question Answering Scenarios, RMIT University, 2020.
  • Assunta Cerone, Watch ’n’ Check: Towards a Social Media Monitoring Tool to Assist Fact-Checking Experts, Politecnico di Torino, 2020. [Paper]
  • Mazhar Morshed, Missing Attribute Imputation through Clustering in New Item Cold Start Job Recommendation, RMIT University, 2017.
  • Phanomsinh Homsombath, Applying Phonetic Matching to Spoken Document Retrieval, RMIT University, 2015.

Visitors

Awards

RMIT RACE Hub
Woi wurrung / Boon wurrung word for ‘possum’, Walert is a conversational agent that answers questions about prgrams at the RMIT School of Computing Technologies (SCT). We used an in-house deployed large language model to rephrase questions and answers in an existing Frequently Asked Questions document for SCT programs to train the conversation model of Walert. We built an evaluation framework to compare the effectiveness of intent-based and Retrieval-Augmented Generation (RAG) architectures for customized chatbots.
See certificate
ACM SIGIR 2024
Award for Excellence in Reviewing
ACM SIGIR 2024 Jul 2024
See certificate
NTCIR-17
Best Presentation Award
NTCIR-17 Dec 2023
Sachin Pathiyan Cherumanal, Kaixin Ji, Danula Hettiachchi, Johanne R. Trippas, Falk Scholer, and Damiano Spina. 2023. RMIT_IR at the NTCIR-17 FairWeb-1 Task. In: Proceedings of 17th Conference on Evaluation of Information Access Technologies (NTCIR-17). https://doi.org/10.20736/0002001315
See certificate
Ubicomp-ISWC 2023
Kaixin Ji, Damiano Spina, Danula Hettiachchi, Falk Scholer, and Flora D. Salim. 2023. Towards Detecting Tonic Information Processing Activities with Physiological Data. In: Adjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing & the 2023 ACM International Symposium on Wearable Computing (UbiComp/ISWC ‘23 Adjunct). Association for Computing Machinery, New York, NY, USA, 1–5. https://doi.org/10.1145/3594739.3610679
See certificate
RMIT University
The RMIT Research Awards and Prizes focus on research excellence and research impact. It is through these research contributions that RMIT continues to bridge the gap between research and impact, benefitting those beyond the academic community. The research awards and prizes acknowledge the accomplishments of individual researchers, research teams, research leaders, supervisors, and HDR candidates.
See certificate
Australian Research Council
Fair and Transparent Information Access in Spoken Conversational Assistants. This project aims to investigate how rich information needed to answer complex questions can be delivered via a speech-only communication channel. Using laboratory user studies, where users can interact with a smart speaker to ask for information about controversial or multi-perspective topics, the project expects to advance knowledge on how to expose pertinent information without creating or reinforcing biases. Expected outcomes include novel presentation strategies to access rich information via audio in a fair manner. This should significantly benefit the visually impaired and low-literacy communities by enhancing their access to topics with multiple point of views, which would impact decision making such as who to vote for in elections.
See certificate
ECIR 2020
La Barbera D., Roitero K., Demartini G., Mizzaro S., Spina D. (2020) Crowdsourcing Truthfulness: The Impact of Judgment Scale and Assessor Bias. In: Jose J. et al. (eds) Advances in Information Retrieval. ECIR 2020. Lecture Notes in Computer Science, vol 12036. Springer, Cham. https://doi.org/10.1007/978-3-030-45442-5_26
See certificate
ECIR 2019
Albahem A., Spina D., Scholer F., Cavedon L. (2019) Meta-evaluation of Dynamic Search: How Do Metrics Capture Topical Relevance, Diversity and User Effort?. In: Azzopardi L., Stein B., Fuhr N., Mayr P., Hauff C., Hiemstra D. (eds) Advances in Information Retrieval. ECIR 2019. Lecture Notes in Computer Science, vol 11437. Springer, Cham. https://doi.org/10.1007/978-3-030-15712-8_39
See certificate
Information Processing & Management
Top Reviewer Award
Information Processing & Management Dec 2018
In recognition of the review made for the Elsevier’s international journal Information Processing & Management (IP&M), based on number of reviews, quality of reviews, and timeliness of responses.
See certificate

Art



Capoeira ACDP Australia

Capoeira ACDP Australia aims to teach and promote Capoeira. Capoeira is an Afro-Brazilian cultural practice, an art form that involves sport, body expression, music and tradition.

Wombatuque

Wombatuque (pronounced /ˈwɒmbatuːki/), plays Samba de Raiz and traditional Samba from the Recôncavo Baiano, among other folklore influenced by Capoeira. The repertoire includes original tunes, as well as songs by the renowned Fundo de Quintal, Zeca Pagodinho, Dorival Caymmi, Dona Ivone Lara, Clara Nunes, and Paulinho da Viola, among others.

Recordings