FAQ

The reviewing process consists of two phases. In Phase 1, every paper will be reviewed by two reviewers and if a paper receives two reviews that are not sufficiently positive, it will be rejected without any opportunity to submit an author response.  By submitting a paper, authors acknowledge that they are aware of the possibility of receiving a summary rejection notification.

Authors of summary rejected papers will receive two reviews.

The IJCAI series of conferences started in 1969, and since then IJCAI has remained the premier conference bringing together the international AI community. In classic AI areas, with a long tradition at IJCAI, people submit their best papers to IJCAI.  For areas that have grown a lot in the last few years (NLP, vision, machine learning), a rule of thumb to decide whether a paper is good enough for IJCAI, is to ask whether it is good enough for conferences such as ACL / ICCV / ICML.

The purpose of the rebuttal is to ask questions about specific issues that 1) could directly influence your evaluation of the paper, and 2) do not require providing new results. Typical questions include requests to clarify or justify particular issues, or about important relationships to other works.

The purpose of the rebuttal phase is not to enter a discussion about the ways the authors could extend or revise their paper by, for instance, asking for extra experiments or theoretical results. You must judge the current and not the possible future versions of the paper. 

The rebuttal will be visible to all members of the program committee involved in the paper (reviewers, meta-reviewers, senior meta reviewers, (associate) pc chairs).

There is also the option to enter confidential comments that will not be visible to the reviewers, but will be accessible to the meta-reviewers, senior meta reviewers, and (associate) pc chairs.

All papers violating the rules specified in the CFP must be rejected. Most papers that obviously violated these requirements have been desk rejected before the reviewing phases. However, in case you find an obvious violation, please inform the workflow chairs (at workflow@ijcai-22.org) immediately. You can also mention it in your review, though you must not take it into account in your judgement as decisions about violations are made by the PC-chair directly in order to ensure consistency and fairness.

Please refrain from using search engines such as Google to try to identify the authors.  This is not good practice.

Please start by watching our video  “Reviewing” and looking into our review form.

The program chair highly recommends reading Mistakes reviewers make (by professor Niklas Elmqvist), see https://sites.umiacs.umd.edu/elm/2016/02/01/mistakes-reviewers-make/

It provides a very balanced view on reviewing that applies to AI and its subfields. (One little detail: when Elmqvist writes about user study (coming from an HCI perspective), you might want to think of experiment (in AI or ML).)

The program chair also highly recommends going through the slides that Hendrik Blockeel and Jesse Davis used for a tutorial on reviewing, and that they have kindly adapted   for IJCAI-ECAI 2022.

https://dtai.cs.kuleuven.be/introduction-to-reviewing-for-ijcai.pdf

The assignment algorithm considers your bids, the subject areas, TPMS, as well as the reviewer workload, etc. It aims at optimizing the global assignment. If you did not bid, or entered positive bids for too few papers, or mainly on very popular papers, the algorithm may not have found the best papers for you. Still there are many other papers that need to be reviewed, and we rely on your expertise to provide an opinion.

Warning: If you see that a paper does not at all match the subject areas entered for that paper, please inform  workflow@ijcai-22.org and put it in your review, as this is considered bad practice. 

If a paper is somewhat outside your core area of expertise, your evaluation of the work as an informed outsider can still be useful. Nevertheless, in exceptional cases where you believe you are unable to provide any well-informed review, please inform workflow@ijcai-22.org as soon as possible. We will then try to assign it to someone else. Obviously, the longer you wait, the more difficult it is to reassign. (The same holds if you discover a conflict of interest, or if you cannot review a paper for any other reason.)

In principle, the answer is NO, unless there is really no other option because of unforeseen circumstances (like illness). The reason is that for large conferences like IJCAI, it is extremely hard to control the conflicts of interest if subreviewers are allowed. In any case it is always the PC member / reviewer  that remains responsible for the review.

Please continue to review it. We don’t regard this situation as a COI. Reviewers for previous versions of the submission are in an ideal position to judge whether the current submission has been really improved. Note that submissions that have been rejected at any peer-reviewed conference within the past 6 months must declare the resubmission and attach the previous review as well as an explanation about how authors have improved the work. The resubmission file will be visible only after the rebuttal during the discussion period.

As mentioned in the call for papers, IJCAI-ECAI 2022 welcomes papers on AI techniques for novel application domains. Keep in mind though that IJCAI is the place to publish research papers.  Therefore, if the use of AI, or the AI technique used, is novel for this kind of application, it can be considered, provided that the application is formalized in such a manner that the formalization can be applied to solve other applications in an innovative manner as well.”  If the paper doesn’t completely satisfy the previous criterion but it clearly explains why the used technique works well, again it can be considered. In those cases, acceptance depends on how important the application is, how significant the improvement is, and to which extent it can be generalized to other problems. If the paper doesn’t satisfy the previous criteria but the AI technique used has a major impact in the application domain and in industry or society, it may be considered for publication at IJCAI-ECAI 2022.

On the other hand, simply applying a standard AI or ML technique (like neural nets or decision trees) on standard datasets from an application domain clearly does not constitute a valid contribution for IJCAI-ECAI 2022.

That is not a problem as long as the papers  are presented in non-archival venues (that is, as long as there are not formally published proceedings with a publisher, in general with a DOI, ISBN, or ISSN ).  ArXiv submissions are also ok. 

No, if the short paper is not longer than a two-column two-page paper. If the ‘short’ paper is longer than that, but no longer than half of the IJCAI paper, then the extension must be significant enough.

The call for papers mentions: 

“For anonymity of the IJCAI-ECAI 22 submission, in the citation please hide the authors’ names, and hide the place where the abstract got published. However, you need to mention that this is an extension of a published abstract, and submit the published abstract as supplementary materials (with authors’ names/affiliations and publication venue removed). For example, you should mention:

This submission is an extension of a published extended 2-page abstract [AAA].

Ref-AAA: XXX. Short paper title. YYY, 2020. [see: supplementary file]”