Within & Between

Related to this podcast's interests in data sharing, this week Jess and Sara talk about common data elements initiatives. These are movements that are hoping to get all of the researchers in the same field or subfield to agree to a given set of assessments, measures, procedures, and/or reporting metrics (Think: Everyone who measures mother’s education would ask the same stem question with the same eight category responses, which would be coded and reported in the same way).  We’ll talk about different types of initiatives, the reasons why proponents think it’s a great idea, and what major concerns might come up. Sara also gives us a mini lecture introducing genome-wide association studies. Trust us, it’s related!  In this episode, we talk about:  The NIH Common Data Elements Program: https://heal.nih.gov/data/common-data-elements  NIH Common Measures website: https://www.phenxtoolkit.org/  A paper about the NIMH common data elements: Barch, D. M., Gotlib, I. H., Bilder, R. M., Pine, D. S., Smoller, J. W., Brown, C. H., ... & Farber, G. K. (2016). Common measures for National Institute of Mental Health funded research. Biological Psychiatry, 79(12), e91-e96. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4968690/ What’s the difference between common measures and common metrics:  de Beurs, E., Boehnke, J. R., & Fried, E. I. (2022). Common measures or common metrics? A plea to harmonize measurement results. Clinical Psychology & Psychotherapy, 29(5), 1755-1767. Paper describing the openly available Project KIDS data: Van Dijk, W., Norris, C. U., Al Otaiba, S., Schatschneider, C., & Hart, S. A. (2022). Exploring individual differences in response to reading intervention: Data from Project KIDS (Kids and Individual Differences in Schools). Journal of Open Psychology Data, 10(1). Educational attainment GWAS paper data harmonization appendix: https://static-content.springer.com/esm/art%3A10.1038%2Fs41588-022-01016-z/MediaObjects/41588_2022_1016_MOESM1_ESM.pdf   Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. Recorded July 9, 2023.

One of the ways the research machine operates is through research conferences. Scientists present new work, hear about others’ work, and (maybe most importantly) network with one another. In the first of a two-part episode about conferencing, Jess and Sara talk about what research conferences are and why you might want to go. We talk through how we choose which conferences to attend, how to plan your travel, and the importance of a comfortable pair of shoes. Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer.

Since we last talked, Jess has moved institutions! In this episode, Jess and Sara discuss the ins and outs of her recent move and why she made the decision to go. We describe how a mid-career academic move is different from an early career one, the timeline of the hiring process when you do (and don’t) have a promotion as part of the offer, and some of the difficult nuts and bolts of moving. Learning a new culture, new systems, and getting new logins. And did you know they delete your email when you move? Some resources: What makes academics move? https://www.science.org/content/article/what-makes-elite-academics-move Do you have a colleague moving into your department? https://miryaholman.substack.com/p/welcoming-new-colleagues Other resources: https://theprofessorisin.com/2017/07/03/howtoapplyforyoursecondjob/ Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer.

Preregistration is writing down your idea for how you plan to collect and analyze your data _before_ you actually start collecting or analyzing it. In this episode, Jess and Sara talk about the many benefits of preregistration, the differences between preregistration and registered reports, describe their experiences with it, discuss some resources, and (hopefully) put to rest some fears about the practice that you might have. Some resources we mention in this episode: Sara’s blog post on preregistration: https://www.womeninedresearch.com/news/preregistrations Paper Sara was thinking of when she talked about the distribution of p-values between preregistered and not preregistered work (it’s really the distribution of effect sizes): https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6470248/ Garden of forking paths: http://www.stat.columbia.edu/~gelman/research/unpublished/p_hacking.pdf Preregistration templates at OSF: https://osf.io/zab38/wiki/home/ Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. Recorded September 12, 2021.

In most faculty jobs, the department or college asks you to stop and document what you’ve been up to for the past year. In this episode, Jess and Sara talk about the institution’s goals for this annual review. We compare notes on what the evaluation packet looks like for our two programs, and we find that they are… quite different. Finally, Sara has the inside scoop on what happens after you turn in the annual review packet at her institution, and folks it is fascinating. Have a listen as you’re prepping to do your year-in-review! Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. Recorded January 9, 2022.

In this episode, Jess and Sara talk about managing all the manuscripts that they are working on. We talk about whether and how we keep track of those papers that are nearly done, partly done, or just an idea, and how that changes when you are a first author vs. a coauthor. We also talk about how we mentor students through the writing process, from idea through to finished draft. We’ll cover broad concepts and specific tools of the trade. Mentioned in this article: National Center for Faculty Development and Diversity The Twitter thread about writing Trello  Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. Recorded January 2, 2022.

In this episode, Jess and Sara finally (Finally!) tackle the basic premise of behavior genetics. We talk about what kinds of research questions you can ask with genetically sensitive designs, describe what heritability is and what it’s not, and discuss just how it’s possible that scientists can use data from twin pairs to understand how much of the variance in some skill or behavior is due to genes and how much is attributable to the environment. A lot of that estimate depends on just how much genes and environments vary within a twin pair and between twin pairs (see what we did there?). In this episode we talked about: Sara’s paper with the figures that Jess describes: https://www.nature.com/articles/s41539-020-00079-z/figures/3 Here’s a cool introductory paper written for Frontiers for young minds that covers much of this introductory content: https://kids.frontiersin.org/articles/10.3389/frym.2019.00059 Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. Recorded November 28, 2021.

If you’ve ever had to deal with missing data, you’ve probably wished you could avoid it completely in the future. So why on earth would anyone design a study where data are missing on purpose? When you set up a project, there are actually several advantages to selecting a subset of people to skip assessments, items, or waves on purpose. Jess and Sara describe those designs here, and just what the advantages are, as well as fun future directions for one specific subtype of these designs: The two-method measurement planned missingness design. Even though we start with a basic missing data overview, and you might think that missing data is scary or boring, we SWEAR this one is interesting. Links mentioned in this episode: The preprint on how to handle missing data decision tree: https://psyarxiv.com/mdw5r/ The paper that introduces the longitudinal version of the two method measurement design: https://doi.org/10.1177/0165025414542711 Menglin Xu and Jess’s paper in JREE: https://www.tandfonline.com/doi/pdf/10.1080/19345747.2021.1875528 Overview of different types of planning missing data designs in education research:  https://doi.org/10.1080/00461520.2016.1208094 Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. Recorded November 16, 2021.

Why do you write a grant? To get money to do some sort of project of course! But how do you figure out how much money you need? Through a grant budget! But what goes into a grant budget? All kinds of things that you might expect (e.g., cost of the materials you need) and some things that you maybe don’t (e.g., Indirect costs). How can I find out what those budget-y things are and what they mean? You’re in luck, friend. That’s what Jess and Sara talk about for this whole episode! But Jess, why did you structure this whole show note blurb as questions and answers? Playing around with different narrative structures is both fun AND informative. Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. Recorded November 13, 2021.

Trajectory of heritability to the heritability of trajectories? Measuring growth in skills and abilities over time is practically (maybe literally!) synonymous with developmental science. In this episode, Jess and Sara talk about how static measurements of a skill can have different variance, and different predictors, from growth in that skill. After a general discussion, we dive into how that plays into estimates of heritability, and the difference between the trajectory of heritability and the heritability of trajectories. Our Response paper: https://psyarxiv.com/qtwhg/ Uchiyama and colleagues “Cultural Evolution of Genetic Heritability” from 2021.  Behavioral and Brain Sciences Paper mentioned that examined the heritability of general cognitive ability across ages. Sara’s lab meta-analysis summarizing heritability of reading. Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. This episode was recorded 9/26/2021.

In this episode, Jess and Sara talk about what it’s like to serve on an academic search committee. To those of you who are about to serve on a committee (maybe for the first time), we will take you through the whole process from writing the call to making the offer. Or those of you on the market this year, peek behind the curtain. Every search is different! Things happen very differently from university to university, and even from search to search. We want this overview to give you, the search committee member, the permission to speak up and suggest changes from the way it may have been done before. Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. This episode was recorded September 18, 2021.

In this episode, Jess asks Sara to talk about LDBase, the data repository she has been building designed specifically to hold developmental science data. We discuss what LDbase is, what motivated her and her colleagues to start building it, what makes it unique, and how it works. Sara even describes several excellent resources you can find on the website that make data sharing easier. Go see it for yourself at www.LDBase.org All about integrative data analysis: Curran, P. J., & Hussong, A. M. (2009). Integrative data analysis: the simultaneous analysis of multiple data sets. Psychological methods, 14(2), 81. https://pubmed.ncbi.nlm.nih.gov/19485623/ Check out a paper by Sara’s team on a cool use of integrative data analysis https://psyarxiv.com/xqbc5/ Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. This episode was recorded July 8, 2021.

You may have noticed that the cycle of academic publishing is pretty broken. Scientists give their research papers to academic journals for free, then the journal puts that work behind a paywall. Sometimes institutions will pay for a package of subscriptions to these journals, often costing millions of dollars. Jess and Sara talk about this cycle, and how institutions, journals, and individuals have started to push back against it. On ArXiv: https://xkcd.com/2085/ About UC’s exit from that Elsevier contract: https://www.vox.com/the-highlight/2019/6/3/18271538/open-access-elsevier-california-sci-hub-academic-paywalls More on FSU’s exit from the Big Deal: https://sparcopen.org/news/2020/elsevier-exit-qa-with-florida-state-university-about-their-big-deal-cancellations/ On the cycle of academic publishing: https://www.theguardian.com/science/2017/jun/27/profitable-business-scientific-publishing-bad-for-science https://www.theguardian.com/commentisfree/2019/mar/04/the-guardian-view-on-academic-publishing-disastrous-capitalism EndNote Click Extension: https://chrome.google.com/webstore/detail/endnote-click-formerly-ko/fjgncogppolhfdpijihbpfmeohpaadpc?hl=en Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. This episode was recorded July 3, 2021.

In this episode Jess and Sara talk about the role of methodologist in developmental science, and how it’s different from a statistician. A methodologist is a content expert and a collaborator like any other, and we do our best work when we’re involved right from the initial planning stages of a project. Why? Because nearly every decision made in a research project can have implications for statistical conclusions, and methodologists are the collaborators who keep this in mind. Think you might be interested in being a methodologist? Jess and Sara give some suggestions on how to prepare and frame your materials. Resources: Jess blog post on how methodology is a content area: https://www.jarlogan.com/blog/methodology_content_area Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. This episode was recorded June 26, 2021.

Well the spring 2021 semester is over, and - what is this feeling? We’re a little (a lot) overwhelmed. Jess and Sara describe their experiences, and theorize a bit about why it might be particularly bad right now. Is the pandemic over here in the US? What does that mean for our jobs? That feeling of one day more can sometimes be too much. We end by suggesting, maybe, we all need a break, and to give ourselves, and our colleagues, some grace. Ed Yong’s article about the “end” of the pandemic in the US: https://www.theatlantic.com/health/archive/2021/05/pandemic-trauma-summer/618934/ The Seven Year Postdoc: https://blogs.scientificamerican.com/guest-blog/the-awesomest-7-year-postdoc-or-how-i-learned-to-stop-worrying-and-love-the-tenure-track-faculty-life/ A few articles about burnout: https://www.insidehighered.com/advice/2020/04/28/advice-faculty-help-them-avoid-burnout-during-pandemic-opinion https://www.chronicle.com/newsletter/teaching/2020-05-21?cid2=gen_login_refresh&cid=gen_sign_in https://www.psychologytoday.com/us/blog/high-octane-women/201311/the-tell-tale-signs-burnout-do-you-have-them Does anybody have a map - does anybody maybe happen to know how the hell to do this? I don’t know if you can tell but this is me just pretending to know. Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. This episode was recorded May 23, 2021.

The saga continues. In this episode we talk about the data management steps you’ll need to consider after you’ve collected your data. We talk a lot about data entry, including the science of how to do it well. We also discuss data merging, data cleaning, and the concept of “release” datasets. Finally, because it seems no episode is complete without Sara discovering something to be shocked about regarding Jess’s approach to science, we talk about the importance of backing up your data. Resources: Recent working group on data management led by Tara Reynolds and Chris: Paper about data entry methods is new in 2020, and cites a whole (fascinating!) history of similar work: Barchard, K. A., Freeman, A. J., Ochoa, E., & Stephens, A. K. (2020). Comparing the accuracy and speed of four data-checking methods. Behavior research methods, 52(1), 97-115. A “merging error that went wrong” was actually an ID mixup, read about it here Sanjay Srivastava’s blog post: “Science is more interesting when it’s true” Data sharing paper by Jess and Sara and Chris Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. This is Season 2, Episode 14, It was recorded March 21st 2021

You might think “data management” is just getting data ready to share, but it’s so much more. In this episode, Jess and Sara talk about the expanded universe of data management. This is the first of a two part series, and focuses on some of the things you can do to help ensure you have good quality data before you even talk to a single participant. We talk about lots of fun data management tips and tricks, from creating research protocols, assigning IDs, creating variable names, variable codes, and coding missing data. Make a rule. Write it down. Don’t change it. Mentioned in this episode: Sara’s data management plan example. The Logan, Hart & Schatschneider paper on Data Sharing: https://edarxiv.org/2x3cu/ Jess’s data management slides. CONSORT diagram: consort-statement.org A great data management guide by Reynolds & Schatschneider. Crystal Lewis’s training website Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. This is Season 2, Episode 11, It was recorded February 27, 2021

Turnabout is fair play in this episode as now Sara describes her new paper! Some developmental science research is focused on how the home environment is correlated (or co-occurs with) children’s skills, behaviors, or abilities. Sara explains that these correlations are also influenced by the shared genes between parents and their children, and that the genetic correlation may be inflating the true environmental correlation that scientists are seeking to measure. In this episode, she describes a few different ways that researchers can account for shared genetic influences in their work. The solutions range from very simple to very complex, but all are very exciting. Sara’s paper: https://www.nature.com/articles/s41539-020-00079-z and https://psyarxiv.com/j5x7g/ The developmental theory of gene-environment correlations: https://pubmed.ncbi.nlm.nih.gov/6683622/ Interested in All of Us? https://allofus.nih.gov/ (you can become a participant!!) Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. This was recorded on February 7th 2021.

To celebrate hitting our 10,000 listens benchmark, Jess and Sara spend episode 10 discussing two listener questions. First, we talk about the decision to change or not to change your last name when you get married. It’s something many developmental scientists struggle with, and we talk about how (even though it feels unique) it’s not terribly different from other professions. Second, we discuss that overwhelming feeling you sometimes get when you’re trying to manage your research pipeline, and how we (try) to (mostly) keep it at bay. Ps, how do you say ORCID? Do you want a Within & Between sticker? https://forms.gle/bDbAuauTxwDDUQMi9 Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. This was recorded on January 27th 2021.

Are you open-science curious? Ready to turn and face the strange ch-ch-changes happening in our field? Preprints are one of the most accessible steps in learning about, and might we even suggest embracing open science. To post a preprint, you put a digital copy of a completed paper online, somewhere others can read it.  In this episode, we discuss the advantages of preprints, different ways to post them, and address some of the potential barriers and common fears we hear from other scholars  when we talk about preprints. Sara Mentioned: Gold, Bronze, Green open access  Jess Mentioned: Overlay Journals  Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. This is Season 2, Episode 9. It was recorded on Sunday, January 17th 2021.