Call for Resource Papers

The Conference on Information and Knowledge Management (CIKM) is a premier forum for researchers and practitioners from academia, industry, and government bodies to share technologies and state-of-the-art research on the emerging aspects of artificial intelligence, data mining, data management, and information retrieval. The resource track at CIKM 2024 provides a unique opportunity to researchers to share and highlight their latest technologies that enable intelligent decision-making, predictive analytics, and machine learning.

Key dates 

All deadlines are 11:59pm in the Anywhere on Earth timezone.

• Abstract submission: May 27
• Paper submission: June 3
• Paper Notification: July 16
• Camera-ready: August 8

Topics of Interest

We welcome submissions on all topics in the general areas of artificial intelligence, machine learning, data science, databases, information retrieval, and knowledge management.

An ideal resource paper’s topics of interest include, but are not limited to, the following areas:

• Data resources comprising a new and innovative dataset or protocol, or one created using novel methods and/or algorithms
• Data resources labelled using novel and well-described annotation and/or crowdsourcing approaches;
• Software resources to support research on novel application domains or support novel evaluation or benchmark tasks;
• Software resources such as prototypes and services, open source frameworks, or tools and libraries which support computing, visualization, evaluation and other exploration tasks in data science, data engineering, or information & knowledge management.

Submission Guidelines

Recourse papers must be no more than 4 pages long including appendices, plus unlimited pages for references. 

Supplementary material: It is allowed to cite supplementary materials including source code, videos, datasets, and demonstration prototypes that are accessible via online platforms like GitHub. Reviewers have the discretion to decide whether or not they will review such materials.

The review of the resource papers will be single-blind, which means that the authors should include their names and affiliations in the paper. All submissions will be reviewed by the Program Committee of the Resource track, who will evaluate the novelty of the technical features and/or research being presented, the research and/or development challenges, its expected impact, and its timeliness and relevance for the CIKM audience of practitioners and researchers. 

Manuscripts should be submitted to CIKM 2024’s Easychair page in PDF format using the ACM’s two-column template “sigconf”, see https://www.acm.org/publications/proceedings-template. 

At least one author of each accepted paper must register to present the work at the conference. 

All papers should be submitted via Easychair: https://easychair.org/conferences/?conf=cikm24

Papers that include text generated from a large-scale language model (LLM), such as ChatGPT, are prohibited unless this produced text is presented as a part of the paper’s experimental analysis. AI tools may be used to edit and polish authors’ work, such as using LLMs for light editing of their text (e.g., automate grammar checks, word autocorrect, and other editing of author-written text), but text “produced entirely” by generative/AI models is not allowed.

Guidelines and review rubric for Resource papers

Papers presenting a dataset or a benchmark must publish the datasets and metadata using a dataset-sharing service (e.g., Zenodo, Datorium, Dataverse, or any other dataset-sharing service that indexes your dataset and metadata and increase the re-findability of the data) that provides a DOI for the dataset, which should be included in the dataset paper submission. Ethical considerations must be discussed. Authors are encouraged to include a description of how they intend to make their datasets FAIR [1]. We would also encourage authors to consider addressing the questions covered in the Datasheets for Datasets recommendations [2].

For papers detailing code resources, such as libraries, external tools, frameworks, etc., it is imperative that authors adhere to rigorous standards in code sharing and ethical considerations. Specifically, authors should ensure that their code resources are made publicly available through reputable, code-sharing platforms such as GitHub, GitLab, Bitbucket, or similar services that facilitate code access and enhance code reusability, thereby ensuring transparency and reproducibility. We advocate for the incorporation of best practices in code documentation and versioning, urging authors to provide comprehensive documentation covering code functionalities, dependencies, and potential limitations, fostering transparency and usability in research practices.

The reviewing guidelines for the resource paper track will focus on the following criteria:

Novelty:

• What is new about this resource?
• Does the resource represent an incremental advance or something more dramatic?

Availability:

• Is the resource available to the reviewer at the time of review?
• Are there discrepancies between what is described and what is available?
• Are the licensing/terms of use sufficiently open to allow most academic and industry researchers access to the resource?
• If the resource is data collected from people, do appropriate human subjects control board (IRB) procedures appear to have been followed and included in the repo?

Utility:

• Is the resource well documented? What level of expertise do you expect is required to make use of the resource?
• Are there tutorials or examples? Do they resemble actual uses, or are they toy examples?
• If the resource is data, are appropriate tools provided for loading that data?
• If the resource is data, are the provenance (source, pre-processing, cleaning, aggregation) stages clearly documented?

Predicted Impact:

• What CIKM research activity is enabled by the availability of this resource?
• Does the resource advance a well-established research area or a brand new one?
• Do you expect that this resource will be useful for a long time, or will it need to be curated or updated? If the latter, is that planned?
• How large is the (anticipated) research user community? Will that grow or shrink in the next few years?

Ethics of Resource Type Papers

Resources are expected to be available as described, where “available” means that most researchers in our community could obtain and make use of the resource without strongly limiting the research they can perform with it. Datasets are expected to be collected in accordance with institutional review board standards and ACM standards of ethics. Reviewers are instructed not to use their reviews as an advocacy platform for these issues but to do what they can to help authors bring their resources to fruition.

Disclosure of Competing Interests

Disclosure of funding and competing interests: Authors are required to provide an explicit disclosure of funding (financial activities supporting the submitted work) and competing interests (related financial activities outside the submitted work) that could result in conflicts of interest in a section (e.g., “Acknowledgments”) that should be added in the submitted version for review.