Archive for April, 2011

An RCT to determine the value of blogging

Blog World Expo 2008

When Science of Blogging first went live one of the first comments we received was from the well-known pseudonymous science blogger Drug Monkey, who said that:

One of the mission critical assignments is to figure out how to show real-world impact of blogging. Traffic numbers are insufficient to convince a traditional audience. How to make the determination of impact easier, consistent and valid?

One of the main reasons that Peter and I started Science of Blogging was because we’ve seen that it has a lot of value for us personally. It’s been a useful way to promote our research and network with others, but DM has a point - simply telling someone that your post got X number of hits doesn’t really convey the benefits of blogging. But I’m not sure that we will ever have an Impact Factor-like metric that will allow people to easily quantify just how effective an individual blog is. We could certainly create one based on some combination of comments, incoming links, and viewers per post (or google rankings, etc), but I’m skeptical that it would ever be used in performance reviews or the like. It would be terrific if it did, but I just don’t see it happening. If people don’t see value in blog traffic stats, I don’t think they’re going to value any other blog-related metric either.

Instead, since we are all researchers anyway, I think it makes sense to do the studies to see whether blogging about a topic can help achieve hard outcomes that are already valued. For example, does blogging about a journal article increase the number of downloads or citations that it receives? Does it increase the likelihood that health-care professionals will perform an evidence-based treatment, or avoid a non-evidence-based treatment? Does it help individuals to adopt healthier behaviours?

These are the things that will convince people that blogging is worth the effort. And since we’re all researchers, it really wouldn’t be that hard to actually start to measure these things.

Here’s an example of an RCT that would be tremendously useful in determining the value of blogging in terms of increasing paper downloads and citations, and would cost absolutely no money to perform. Select 30 papers from a wide range of academic disciplines, all of which are at least 5 years old and have less than 3 citations (e.g. if they aren’t cited much now, it’s unlikely that they ever will be). Randomly select 15 of these articles, and ask for volunteers from among the 1000+ active bloggers on Researchblogging.org who are willing to blog about the papers relevant to their discipline. Then, track the number of downloads and citations for the blogged and non-blogged papers over a period of several years, to see if there is a difference between the two groups.

We could even do something similar using papers in the PLoS journals as a convenience sample - are the PLoS papers that have been discussed in blogs downloaded and cited more often? This could be potentially biased (I’m assuming that the papers that get blogged about are probably more interesting or novel, which would make them more likely to get cited as well), but the data is freely available for anyone with a summer student with time to kill.

I know there are a million and one qualitative studies that could also be done in this area, and I’ve participated in a few myself. But lots of people (myself included) like to see hard numbers, and it really wouldn’t be very hard to get them. Seriously, why isn’t the science blogging community doing this? If I’m just ignorant of the research, please tell me. And if it really doesn’t exist, then why don’t we get it going?

Travis

Get to Know a Scienceblogger: Patrice Brassard

Dr Patrice Brassard of Le Physiologiste

Do you ever wonder how people get into online science communication? I certainly hope so, because over the coming weeks Peter and I will be introducing a new series interviewing science communicators about their experiences promoting science using social media. These individuals cover a broad range of academic disciplines, and we hope that they will be a useful source of info and motivation for others who are considering moving into social media, or for those who are already online but simply looking for some new ideas. If you would like to share your own experiences communicating science through social media feel free to do so in the comments, or to introduce yourself to us via Twitter or email (saunders [dot] travis [at] gmail [dot] com).

Our first interview comes from Dr Patrice Brassard, an assistant professor of Kinesiology at Université Laval in Quebec city, Canada. His main research interests are the integration of cardiopulmonary and cerebrovascular physiology in patients with diabetes at rest and during exercise, and the impact of mental work on the cardiovascular system in healthy subjects. His blog is titled Le Physiologiste and for the past two weeks he has also been guest-posting at the blog network Scientopia.

 

1. What is the general subject of your blog?

Initially, the general subject of Le Physiologiste was supposed to be…physiology :-). However, I started by sharing my experiences as a junior faculty member. It is important to mention that when I began to read science blogs, I was very interested in these kinds of posts from bloggers sharing similar research and teaching issues than mine. The other collaborators at Le Physiologiste are graduate students and are sharing their experiences as well (in English and French). A couple of weeks ago, we finally decided to include posts where we are actually discussing physiology, mostly in French.

I would like this blog to become a place for graduate students, researchers and professors in physiology to debate about hot physiology topics.

 

2. What was your primary reason for starting a blog?

The primary reason for starting my blog was that, to my knowledge, there are no valuable French blogs/websites discussing published literature in integrative/exercise physiology…however, I soon noticed that it would be easier to start blogging in English, because I was already exchanging with bloggers in that language.

I still have that goal of discussing and debating physiology research in French…Our blog remains a work in progress for the moment!


3. How often do you post, and roughly how much time goes into each post?

More >

Knowledge Dissemination: blogging vs peer review

Travis’ Note: Today’s post is from Dr David J Phipps of ResearchImpact, a Canadian knowledge-exchange network. The original post can be found on Mobilize This!, the ResearchImpact blog. Thanks to David for allowing us to cross-post his article here.

In an age of self publishing – including blogs, videos, and other Web-based media – why do we still seek to publish in traditional academic peer-reviewed journals? Vanity.

ResearchImpact-York published two academic papers in 2009. In 2010 we had one in press, two submitted, and one just rejected for a second time, from the same journal. Since our first post on May 30, 2008, ResearchImpact has published 206 blogs on Mobilize This!, an average of 6 or 7 each month.

Here’s a comparison of blogging and peer-reviewed publishing: More >

Scienceblogging Roundup: March 27-April 2

While we post lengthy discussions here on Science of Blogging, there are many research updates, news stories, videos, etc. related to science communication that we come across on a daily basis that never grace the pages of the blog. Most of these mini-stories we share with our followers on Twitter, and we encourage those of you with active Twitter accounts to communicate with us there to get real-time updates of all the stuff we are discussing (Follow Peter and/or Follow Travis). For those of you who shy away from Twitter, enjoy below the best mini-stories that we came across during the prior week along with links to the original source so that you can follow the full story.

  • Personal tweets make profs seem more credible (Ars Technica)
  • Terrific advice for grad students and PhDs considering alternative careers (LabSpaces)
  • Cut the crap and write better now (CopyBlogger)
  • The popular blog Neuroskeptic has been featured in an editorial in Annals of Neurology - check out what they had to say! (Neuroskeptic)
  • A possible upside to cyberbullying - at least in comparison to regular bullying (The Atlantic)
  • Uber-blogger PZ Myers announces he is leaving ScienceBlogs… April Fools.

Have a great weekend!
Travis