Call for Data Challenge Sessions

[vc_btn title=”Download PDF” color=”primary” size=”sm” i_icon_fontawesome=”fas fa-file-alt” add_icon=”true” link=”url:https%3A%2F%2F2022.ieeemlsp.org%2Fwp-content%2Fuploads%2Fsites%2F417%2FMLSP2022_CFDC.pdf|title:Call%20for%20Papers|target:_blank”]

The 32nd MLSP is organizing the Data Challenge (DC) Sessions with new and exciting problems that aim at engaging signal processing and machine learning research community, industry, and practitioners. If you are planning to submit a Data Challenge proposal, please include:

  • One-page call for participation
  • Data Challenge Description
  • Description of the dataset provided for training and evaluation criteria and methodology, guidelines for proponents, and submission deadline;
  • List of potential participants.

Participation: Data Challenge organizers should facilitate participation, communication, and impact. Data Challenge organizers are not allowed to participate in the competition they are organizing.

Dataset: If applicable to the challenge, organizers are encouraged to provide at least one training dataset with both input and ground truth and one test dataset without the ground truth-the latter to be used for final assessment. A secondary test set for evaluation, which is not available to participants, is also encouraged to highlight the generalizability of their approach.

Evaluation: How the results are evaluated and ranked should be announced along with the challenge description. The evaluation methods should be unbiased and transparent to all participants. Provision of baseline approaches and evaluation metrics is encouraged.

DC Papers: Each challenge would have around 2-3 months to run the competition and rank/select winning teams. Each challenge can have up to 3 papers from the top ranked teams. The format should be consistent with MLSP regular paper.

  • Organizers are responsible for coordinating the review of the challenge papers.
  • The DC paper submission deadline should coincide with the model submission deadline for DCs.
  • The DC paper acceptance announcement should coincide with the model evaluation results announcement.

DC Sessions: DC sessions will be organized in the MLSP 2022 program. This session will include DC paper presentations (oral or poster), followed by a panel or open discussion.

Proposals should be sent to the MLSP Data Competition Subcommittee via Ercan Kuruoglu (kuruoglu@sz.tsinghua.edu.cn) and Danilo Comminiello (danilo.comminiello@uniroma1.it)

  • DC Proposal Submission: March 10, 2022.  March 17, 2022
  • DC Proposal Acceptance Notification: March 20, 2022
  • DC Paper Acceptance: July 25, 2022
  • Camera-ready DC Papers: July 31, 2022