How to write research papers

How to Write CHI Papers with Jim Wallace - Episode ShownotesEpisode OverviewGetting a paper into CHI (the top Human-Computer Interaction conference) is harder than ever. In this episode, Professor Jim Wallace from the University of Waterloo reveals the exact writing process, template, and mindset that gets papers accepted. We discuss the abstract-first method, the three-paragraph expansion technique, and why hard and fast iteration is the only way papers actually get written.GuestProfessor Jim WallaceAssociate Professor, School of Public Health Sciences, University of WaterlooFormer CHI Associate Chair (Games and Play subcommittee)CHI Science Jam organizerCreator of the CHIzen LaTeX templateKey Topics CoveredWhat Types of Papers Does CHI Want?Harder to publish: Systems papers, bibliographical work, meta-reviewsGrowing trend: Reflective and meta papers about HCI research methodsExciting developments: Papers examining research practices, statistical methods, and theoretical foundationsThe balance between artifact-driven research and methodological reflectionThe Abstract-First Writing MethodJim's recommended approach for writing CHI papers:Start with the abstractAddress these key questions:What problem are you solving?What's your solution?Who should care?What are your contributions?Expand to introductionTurn each abstract sentence into a paragraphDevelop related workExpand each paragraph into three paragraphsIterate hard and fastWrite, realize it needs work, revise, repeatThe CHIzen TemplateJim created a LaTeX/Overleaf template called CHIzen (meaning "continuous improvement") that includes:Visualization wrappers and graphics toolsTransparency and best practices for sharing materialsEthics materials templatesA comprehensive checklist for paper submissionTips and tricks collected from working with many researchersFind it on GitHub: https://github.com/JimWallace/CHI-ZenCHI Paper Structure & NarrativeCHI balances being both a scientific and design communityUnlike health sciences with rigid structure, CHI emphasizes storytelling and narrativeKey framework: Problem → Solution → Who Cares?Persuasion is essentialYou must convince reviewers the problem is valuableQuality Criteria & Review ProcessWhat reviewers look for:Context: Is the problem valuable and well-positioned?Methods: Are methods appropriate and rigorously applied?Clarity: Is the writing clear and well-presented?The evolution of expectations:20 years ago: "The Wild West" - almost anything could be publishedToday: Power analyses, rigorous methods, careful justification requiredRisk: Expectation inflation may crush good ideas that aren't perfectly executedBeing a Champion ReviewerEssential reading: Ken Hinckley's paper on being a championReviewers should champion good papers, not destroy themBe constructive and focus on positivesYour job is to help papers succeed, not sink themStudents often think reviewers are out to destroy their work - this shouldn't be the mindsetAdvice for Junior ResearchersOn writing your first paper:Pick a niche contribution - you can't please everyoneSmall steps and iteration are essentialLearn from feedback from advisors and co-authorsDon't expect perfection on the first draftOn reviewing papers:Get involved early to see behind the scenesBe honest about what you don't knowIt's okay to decline reviews for methods you haven't usedFocus on what you CAN comment on constructivelyOn learning new methods:This is a career-long process, not something finished in a PhDBe honest about expertise gapsReviewing helps calibrate your understandingFairness in the Review ProcessEveryone in the process has the best intentionsAuthors don't see all the work happening behind the scenesConsistency is a major challengeWhen is a power analysis required? For which methods?Revise and resubmit processes (like CHI Play, ISS, CSCW) are moving in the right directionSecond chances mean papers are only rejected for big, important reasonsCurrent Trends & Future DirectionsCHI Play's new rubric system: Separating methods expertise from domain expertiseRevise and resubmit models: Gaining traction across HCI conferencesTransparency and reproducibility: Growing emphasis on sharing materialsQualitative methods: Increased popularity, especially during COVID-19Key Papers & Resources MentionedInter-rater reliability paper by Norm McDonald et al. (CSCW)Statistical methods and null hypothesis testing (CHI Play)"HARKing No More" (CHI)Ken Hinckley's "Being a Champion" paperEssential reading for reviewers and ACsGreenberg and Buxton's "Usability Studies Considered Harmful" (2008/2009) - Including Dan Olson's panel comments on value networksWorkshop on challenges for qualitative research/transparency (CHI)CHIzen LaTeX TemplateAvailable on GitHubMemorable Quotes"You could get almost anything published 20 years ago... you look at the types of rigor and the things that reviewers ask for today, and it's not even close.""The abstract, the intro, the related work - they're all basically the same thing. It's just longer versions of the same piece of writing.""You can't just write the whole paper and revise it. You've gotta focus on small pieces or small chunks that you can revise easily and then expand out as you go.""Students going in today just think that reviewers are complete... they're just gonna tear papers apart... I actually think we need to ease up a little bit.""Every single person in the process has the best of intentions... everyone really wants to have very constructive feedback and do the author's justice."Episode NotesThis episode was originally recorded approximately 5 years ago and is being re-released as part of the relaunch of the podcast, now titled "How to Write Research Papers." The podcast is expanding its scope while maintaining its focus on helping researchers improve their academic writing.Host: Professor Lennart NackeProduction: How to Write Research Papers PodcastEpisode Length: ~29 minutesFor more episodes and resources, visit https://lennartnacke.substack.comOr join me on YouTube: https://www.youtube.com/@lennartnacke This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe

In our tenth episode, I finally get to meet up with Jacob Wobbrock, a Professor of human-computer interaction (HCI) in The Information School and, by courtesy, in the Paul G. Allen School of Computer Science & Engineering at the University of Washington. He was one of the people that inspired me to teach the first version of this course. The interview is full of fantastic tips for writing CHI papers, Jake's personal writing process, what it takes to get cited, lots of great anecdotes, mentoring advice for junior students and faculty, and thoughts on why reviewers should be chasing value in every CHI paper. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe

In this episode, my guest is Munmun De Choudhury, an Associate Professor in the School of Interactive Computing at Georgia Tech. Munmun has a fantastic track record and high impact in citations, worked countless service hours for the CHI community, and because of her work in the health field, she has many good tips that put the human first in any CHI paper project right from the first brainstorm. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe

Elisa Mekler, Assistant Professor at Aalto University shares some profound paper writing strategies and tips about reviewing CHI papers. She dips into her wealth of experience of writing award-winning papers and chairing papers tracks. In addition, she talks about her mentoring approach to her own students for writing CHI papers. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe

Kathrin Gerling, Assistant Professor at KU Leuven, talks about her experiences as papers and subcommittee chair in the SIGCHI world. In our interview, we explore strategies for publishing papers at CHI and she gives some excellent tips for junior Ph.D. students looking to get published. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe

In this interview from 2017 with Kasper Hornbæk, who has won on IJHCS’s most cited paper award 2006-2008, talks about his writing process in good detail. He answers the important questions about finding a good research direction and taking it from idea to manuscript. I hope you enjoy this interview. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe

In this interview with Vero Vanden Abeele, papers chair of CHI PLAY 2017 and 2018, we discuss the writing practices that have contributed to her success in writing research papers for CHI and other conferences. I hope you enjoy this interview. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe

In this interview with Regan Mandryk, chair of CHI 2018, we dive deep into the writing practices that have made her a successful author for the conference. Take away some tips and tricks from her prolific writing structure and learn how to bring the 'boom'. I hope you enjoy this interview. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe

In this interview with Jofish Kaye, former co-chair of CHI 2016, he provides some hands-on tips about cutting through to the essence of paper writing and finding good research questions. I hope you enjoy this interview. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe

This is an older interview when I had the pleasure of interviewing Professor Carl Gutwin from the University of Saskatchewan in 2016 for the How to write CHI papers course (Carl has been papers chair of CHI in the past and has an incredible amount of experience in writing for SIGCHI conferences). Having worked with Carl at the University of Saskatchewan before, I knew that he was going to have some excellent advice for new CHI writers. In fact, it was Carl who taught me the first CHI writing course when I was a postdoc. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe

In this episode, Dr. Lennart Nacke introduces the podcast to listeners and conducts interviews with several people at CHI 2019 about what it takes to write CHI papers. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe