Guide to Successful Paper Submissions
by John Tang and Ellen Isaacs
Last Revised: February 1998 by Saul Greenberg
Due date: (for submissions) Friday, April 3, 1998
Note: This document is meant to complement the CSCW'98 Call for Participation and Papers Submission Requirements.
Please send comments to Saul Greenberg
(saul@cpsc.ucalgary.ca)
or Christine Neuwirth
(cmn+@andrew.cmu.edu),
Program Co-Chairs for CSCW'98.
Introduction
The CSCW conference is interdisciplinary in nature, typically drawing
submissions from diverse fields (e.g., computer science, psychology,
anthropology, business, education) and sectors (e.g., industry, academia,
government). Given this diversity of perspectives, it might be unclear how to
write a successful paper that reaches out to the CSCW audience. Toward that
end, we want to communicate to prospective authors (and to reviewers of CSCW
papers) what makes a successful paper submission to CSCW. By
"successful", we mean a submission that presents the work with all
the information needed to get a fair review. If the work is innovative and
interesting to the CSCW community, then successful submissions should be
accepted. But, if the review process finds that the work does not meet the
quality threshold for accepted papers, then a successful submission will still
generate constructive feedback to the authors. We don't want these guidelines
to constrain the creativity and freedom of authors. However, we thought these
guidelines would help make the review process a constructive experience where
authors and reviewers work together to create the best quality conference
possible.
A useful place to start discussing successful CSCW submissions is the review
process. It's important to note that CSCW reviews papers on an
"as-is" basis. The review process does not include enough time for a
second review after the author has made requested changes, so reviewers must
make a decision whether the submission in its current form is an acceptable
CSCW publication. (However, reviewers often do make suggestions, and authors of
accepted papers are encouraged to revise their work before a final draft is
required.) Describing future work (or work expected to be completed before the
conference) is often interesting, but you should not rely on any unfinished
work to gain acceptance to the conference. A common reviewer comment is that a
submission was premature and should be resubmitted when more of the work is
completed.
Paper submissions will be reviewed by at least three people from a panel of
international reviewers. Although the wording of the review form changes from
year, the review form essentially asks:
- Is the work new, significant, and important to the CSCW community?
- Is the thesis sufficiently supported with data or analyses?
- Is the work clearly and concisely described?
Let's look at each of these in turn.
Is the work new significant and important to the CSCW community?
Simply put, CSCW is looking for innovative and significant work in the
research and practice of applying technology to support collaborative work. As
noted in the Call for Participation, topics
include:
- Technology use in specific work domains
- Innovations and experiences with Intranets, the Internet, WWW
- Theoretical aspects of coordination and communication
- New technologies and architectures to support group activity
- Social and organizational effects of introducing technology
- Methodologies and tools for design and analysis
- Ethnographic and case studies of work practice
The emphasis on new means that the work should be interestingly
different from previous work in the area. A good sense of what has been done in
the field can be gained by browsing the proceedings of previous CSCW
conferences (CSCW '86, '88, '90, '92, '94 and '96) and the related European
CSCW conferences (ECSCW '89, '91, '93, '95 and '97). Because of the emergent
and interdisciplinary nature of CSCW, papers can sometimes introduce ideas and
theories from other fields by demonstrating their relevance to CSCW.
The emphasis on significant and important means that the work should
have the potential for changing the way our community: applies principles,
theory, or methodologies; studies collaborative activity; or characterizes the
CSCW perspecitve.
Authors should clearly address: What is new and significant about the work?
How is it different from existing work? How is the problem useful and relevant
to the CSCW community? What can the CSCW community learn from this work?
Because CSCW is a multi-disciplinary and international conference, it is
important to take a global perspective on "what's new and
significant". It's easy to get caught up in your particular specialty in
your corner of the world, but successful submissions help people in other
disciplines and locales appreciate what is new and significant about your work.
It also helps to put your work in the context of related previous work. Citing
related work and describing how your work differs is a good start towards
demonstrating what's new about your work.
Sometimes authors bury the new and significant parts of the work among the
many other issues crammed into the paper. With the limit of ten pages (and
about 20 minutes of presentation) to describe your work, it's important to
choose an appropriate focus for the paper. In general, it is difficult to make
more than three major points in a paper of that length, so think carefully
about the issues you want to highlight. Keep in mind that you want the reader
to be able to easily identify your contribution and why it is important.
Is the thesis sufficiently supported?
The validity of the ideas or claims in the paper need to be supported by
appropriate data, analyses, or arguments. In the case of data analyses, an
appropriate methodology should be selected and correctly applied to support the
work. Authors should: provide sufficient data and/or well-supported arguments,
explain what analyses were made and why, cite relevant work, and cover the
important issues at the appropriate level of detail.
A common reviewer comment is that an obvious or important issue with the
work was not addressed by the authors. Papers have also been criticized for not
providing enough evidence or sound reasoning for their claims. A similar
concern is not justifying the design choices and not explaining why certain
design features were included. In summary, you should not only explain
what you did, but why you did it so that readers (including
reviewers) can be convinced that you made appropriate choices. Explaining your
choices can also stimulate more research by helping others see alternative
approaches.
One way to support your ideas, one that CSCW strongly prefers, is to include
some evaluation or application of the ideas. CSCW is not especially interested
in descriptions of new technology without any evaluation of its usefulness to
people. If it is not possible to conduct an evaluation with real users, then
find some other way to indicate how your work benefits people. For example, you
might spend more time explaining how the system was motivated by user needs and
how it addresses those needs. CSCW is a conference about people using
technology, and reviewers are looking for serious consideration of this central
issue.
It's important to pick an appropriate evaluation methodology for the task
and to conduct it appropriately. Reviewers often cited inappropriate
methodology choices (e.g., using a quantitative method for something that has
qualitative effects) and improper uses of the method (e.g., not enough
subjects, inappropriate statistical analyses).
Finally, referees sometime complain that authors have failed to cite clearly
relevant work previously published in CSCW-related proceedings and
journals. This problem is often found with authors from areas outside CSCW who
may not know the CSCW literature. Look through previous proceedings to see how
the ideas in your thesis relate to previous papers.
Is the work clearly and concisely described?
You would be surprised at the number of reviewer comments that indicate that
the work was not adequately described. Usually the authors simply did not
carefully describe what they did or how they studied what they did. Describing
the work involves not only good writing, but also a solid structure that helps
the reader follow the explanation. It also helps to support the text with
figures, tables, and photos that are clear and easy to understand. Authors
should: clearly describe what was done and/or how it was studied, write clearly
and concisely (avoiding jargon), organize their paper to flow logically and
smoothly, provide the right level of detail, and make good use of figures to
support the text.
Although all presentations at CSCW are made using English, CSCW is a
conference with an international audience (and an international panel of
reviewers). Keeping a global perspective also means using the English language
in a way that effectively communicates across cultural boundaries. For authors
who are not native speakers of English, reviewers try to assess the quality of
the work independent of language issues. However, it is in your best interest
to communicate as clearly and effectively as you can in English. If a native
English speaker is available, it is a good idea to ask them to proofread your
paper before you submit it. For those whose first language is English, it helps
to keep in mind that non-native English speakers will be reading and reviewing
the paper. It is best to avoid long, complex sentences as well as regional
colloquialisms, jokes, or puns that are difficult for someone outside your
culture to understand.
Summary
With the large number of submissions that are typically received, CSCW's
review process is competitive. The intent of the review process is to bring the
highest quality, most interesting, most provocative papers to the conference.
Doing a good job writing (and reviewing) CSCW papers is a lot of work, but we
hope that work is rewarded with a high quality conference that benefits us all.
We hope this document has helped give you some concrete guidelines on how to
write a successful CSCW submission. If you'd like more information, contact
Saul Greenberg (saul@cpsc.ucalgary.ca) or Christine M Neuwirth
(cmn+@andrew.cmu.edu), who are Co-Chairs for the Papers Program. Best
wishes, and we look forward to seeing a good collection of paper submissions
this year.
SDM
/ cscw98-info@acm.org
/ March 4, 1998
|