Everything Hertz

We're back! After a long break, we catch up on why it's been so long: Dan's promotion and James's new venture capital gig at Helena where he can argue about science for a living. Then it's on to how much meta-science has changed in the past six months. Dan talks about using MetaCheck and local LLMs to find out whether shared materials on OSF actually get downloaded (mostly yes) and James argues that reanalysing public data is now so cheap it barely counts as a paper. We also get into why real human data is gaining value, how to disclose AI use (Disclosure: AI was used to help create these notes, based on the recording), and why open-weight models at "temperature zero" make reproducibility of LMM output easier. We also cover the worry about outsourcing thinking, what LLMs mean for grants, and why data provenance is going to matter. Other links Helena The metacheck R package Dan's OSF downloads preprint Ollama for local LLM use The OpenAlex scholarly database

We discuss how living meta‑analyses—meta‑analyses that are continuously updated as new studies appear—can cut research waste and keep evidence current. We also chat about how using synthetic research participants is a terrible idea. Links The BMJ Christmas special paper on how recent is "recent" The synthetic panel service The paper describing a living meta-analysis platform for oxytocin research A preprint commentary on living meta-analysis Social media links Dan on Bluesky James on Bluesky Everything Hertz on Bluesky

We discuss whether preprint servers and journals should require author identity verification for submitting manuscripts. This would probably speed up the submission process, but is this worth the potential downsides? We also discuss the similarities and differences between academia and professional sports and a weird case of author identity theft. Other links The BJKS podcast https://bjks.buzzsprout.com Social media links Dan on Bluesky James on Bluesky Everything Hertz on Bluesky

Dan and James chat about a a new 'pop-up journal' concept for addressing specific research questions. They also answer a listener question from a journal grammar editor and discuss a new PNAS article on paper mills Links The pop-up journal The episode where Dan's wife went into labor The PNAS paper mill paper A blog post from the PNAS paper lead author, Reese Richardson. The Nature piece on the paper Social media links Dan on Bluesky James on Bluesky Everything Hertz on Bluesky Citation Quintana, D. S., & Heathers, J. (2025, August 7). 193: The pop-up journal, Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/2ZMQ7

Dan and James answer listener questions on outsourcing in academia and differences in research culture between academic institutions and commercial institutions. Social media links Dan on Bluesky James on Bluesky Everything Hertz on Bluesky Citation Quintana, D. S., & Heathers, J. (2025, July 1). 192: Outsourcing in academia, Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/3MC2R