Creating an evidencebased framework to support biodiversity management

1

Gavin Stewart Centre for Evidence-Based
ConservationBangor University, UK

• Software for Meta-analysis
• With thanks to Will Shadish Julio Sanchez-Meca

2
Outline

• Commercial stand-alone programs
• Freeware
• Meta-analysis macros in general packages
• Reviews of meta-analytic software
• Personal view
• Note this data has not been systematically
  collated and critically appraised in a uniform
  manner!

3
Stand alone-1(3)

• Johnson, B.T. (1993). D-Stat Software for the
  meta-analytic review of research literatures
  (version 1.1). Hillsdale, New Jersey Erlbaum.
  (Lawrence Erlbaum, www site www/erlbaum.com
  email orders_at_erlbaum.com). Does various
  meta-analytic statistics including some effect
  size calculation.
• Mullen, B. (1989). Advanced BASIC Meta-Analysis.
  Hillsdale, New Jersey Erlbaum. (Lawrence
  Erlbaum, email orders_at_erlbaum.com). Like
  Johnson.
• CMA-Michael Bornstein has just finished a
  reputedly excellent program. Order information at
  http//www.meta-analysis.com Does effect size
  calculation and meta-analysis, good graphics.

4
Stand alone-2

• Shadish, W.R., Robinson, L., Lu, C. (1999). ES
  A Computer Program and Manual for Effect Size
  Calculation. St. Paul, Minnesota Assessment
  Systems Corporation. A program for computing
  standardized mean difference statistics with over
  40 different methods. See http//141.225.14.75/wsh
  adish/es.htm or http//www.assess.com/ES.html.
• Lipsey, M.W., Wilson, D.B. (1996). Practical
  Meta-Analysis. Newbury Park CA Sage
  Publications. This book also makes reference to
  SPSS, SAS, and STATA macros that implement many
  analyses, and that can be downloaded for free at
  http//mason.gmu.edu/dwilsonb/ma.html. Also
  available is the authors' EXCEL macros for doing
  effect size calcuation.

5
Stand alone-3

• M. Rosenberg, D.C. Adams, J. Gurevitch. (1999).
  MetaWin Statistical Software for Meta-Analysis
  with Resampling Tests (Version 2.0). MetaWin can
  be ordered from Sinauer Associates, Inc., P.O.
  Box 407, Sunderland, Massachusetts 01375-0407
  fax [phone] e-mail orders_at_sinauer.com
  internet http//www.metawinsoft.com/. Costs
  about 70. Does fixed and random effects models
  including categorical tests and it does mixed
  model regression. Can handle up to 500 studies
  belonging to 25 classes in each of 10 grouping
  categories. Unique feature is that it
  incorporates resampling statistics (percentile
  bootstrap confidence limits and bias-corrected
  bootstrap confidence limits), and you can test
  for differences among classes of studies using a
  randomization test to evaluate between-group
  homogeneity.
• Eddy, D.M. Hasselblad, V. (1992). FASTPRO
  Software for Meta-analysis by the Confidence
  Profile Method. Boston, MA Academic Press. Note
  Book no longer in print, and software may not
  otherwise be available today.

6
Freeware-1(5)

• Meta Meta-analysis Programs (Vers. 5.3) (1989)
  R. Schwarzer. Raleigh, NC National Collegiate
  Software Clearinghouse (http//www.RalfSchwarzer.d
  e)
• MA.EXE, by Joseph Cappelleri, Pfizer Central
  Research, Biometrics Department, Eastern Point
  Road, Groton, CT 06340 (joseph_c_cappelleri_at_groton
  .phiser.com)
• MACALC.EXE, by Larry Lyons, Multimedia and CBT
  Development, Information and Aviation Engineer
  Group, Advanced Engineering and Research
  Associates, 1919 South Eads Street, Suite 400,
  Arlington, Virginia 22203, (solomon_at_mnsinc.com).
  Downloadable from http//www.lyonsmorris.com/MetaA
  /index.htm .

7
Freeware-2

• Carlette, W.L. (1987). The meta-analysis effect
  size calculator A BASIC program for
  reconstructing unbiased effect sizes. Educational
  and Psychological Measurement, 47, 373-384.
• EasyMA by M. Cucherat, J.P. Boissel, A.
  Leizorovicz, M.C. Haugh, P. Nony, F. Gueyffier.
  Can be downloaded from http//www.spc.univ-lyon1.f
  r/mcu/easyma/. Developed in France for use by
  clinical pharmacologists to perform meta-analyses
  of clinical trial data with binary outcomes using
  fixed or random effects methods.
• Meta-Analysis Easy To Answer (META), by David
  Kenny at the University of Connecticut
  (http//davidakenny.net/meta.htm). A few fairly
  simple effect size computations can be done, and
  weighted or unweighted averages can be computed
  using any of several systems.

8
Freeware-3

• EPIMETA (http//ftp.cdc.gov/pub/Software/epimeta/)
  was written for the Centers for Disease Control
  and is a DOS program. It has no effect size
  computation capacity, but does fixed and random
  effects modeling on epidemiological data (e.g.,
  risk ratios).
• Meta-Analyst (1995) J. Lau. Boston, MA New
  England Medical Center. E-mail
  joseph.lau_at_es.nemc.org
• Meta-Test (1997) J. Lau. Boston, MA New
  England Medical Center. E-mail
  joseph.lau_at_es.nemc.org http//hiru.mcmaster.ca/co
  chrane/cochrane/sadt.htm/ http//som.flinders.edu
  .au/FUSA/Cochrane/COCHRANE/sadt.htm/

9
Freeware-4

• RevMan The Cochrane Collaborations Review
  Manager (Vers. 5.0) (2001). The Cochrane
  Collaboration. http//www.cochrane.org/cochrane/re
  vman.htm/.
• MetaStat This software is written by Lawrence M.
  Rudner, Gene V Glass, David L. Evartt, and
  Patrick J. Emery, and it does a variety of
  meta-analytic statistics. It can be downloaded at
  http//ericae.net/meta/metastat.htm.
• http//web.uccs.edu/lbecker/Psy590/escalc3.htm.
  This www page is devoted to effect size
  calculation, computing d or r from means and
  standard deviations, or from t and df.

10
Freeware-5

• www.work-learning.com/effect_sizes.htm. This web
  site allows you to download an excel effect size
  calculator with basic effect size computation
  capacity, along with a manual showing the
  formulas and how to use the program.
•  MIX (http//www.mix-for-meta-analysis.info) MIX
  stands for Meta-analysis with Interactive
  eXplanations. It is analytical software with
  extensive educational interactive tutoring. It is
  especially meant for students and teachers,
  although it provides professional numerical and
  graphical output and, besides analyzing the
  built-in data sets, one can also enter one's own
  data.
• Metadisc Zamora, Khan et al. BMC Med Res
  Methodol. 2006 6 31. observational
  studies/diagnostic data

11
Macros in general packages-1(2)

• BUGS y WinBUGS.  http//www.mrc-bsu.cam.ac.uk//bug
  s/.
• R. http//cran.r-project.org/.
• SAS . Wang, M.C. Bushman, B.J. (1999).
  Integrating Results through Meta-analytic Review
  Using SAS(R) Software. Cary, NC SAS Institute,
  Inc. Kus, O. Koch, A. (1996). Meta-analysis
  macros for SAS. Computational Statistics Data
  Analysis, 22, 325-333. http//www.prw.le.ac.uk/epi
  demio/personal/ajs22/meta/macros.sas/.
  http//www.sas.com/.
• SPSS. The Lipsey and Wilson macros. See
  http//www.wam.umd.edu/wilsondb/ma.html.
• S-Plus. http//www.mathsoft.com/splus/.
  http//www.prw.le.ac.uk/epidemio/personal/ajs22/me
  ta/routine.html/. http//www.research.att.com/dum
  ouchel/bsoft.html/.

12
Macros-2

• StataTM. Sterne, J.A.C., Bradburn, M.J. Egger,
  M. (2001). Meta-analysis in StataTM. In M. Egger,
  G. Davey Smith D.G. Altmann (Eds.), Systematic
  Reviews in Health Care Meta-analysis in Context
  (pp. 347-369). London, UK BMJ Pub. Group.
  http//www.stata.com/.
• StatsDirect. http//www.camcode.com/.
• StatXact. http//www.cytel.com/statxact
• True Epistat. Epistat Services, 2011 Cap Rock
  Circle, Richardson TX 75080-3417, phone (214)
  680-1376 (Note, this address is old, and True
  Epistat may not be available today).

13
Reviews of meta-analytic software

• Arthur, W., Bennett, W. Huffcutt, A. (1994).
  Choice of software and programs in meta-analysis
  research Does it make a difference? Educational
  Psychological Measurement, 54, 776-787.
•  Egger, M., Sterne, J.A.C. Davey Smith, G.
  (2000). Meta-analysis software. British Medical
  Journal, 316.
• http//www.bmj.com/archive/7126/7126ed9.htm/
  (accesed 21.11.2000).
•  Normand, S.L. (1995). Meta-analysis software A
  comparative review. American Statistician, 49,
  298-309.
•  Sterne, J.A.C., Egger, M. Sutton, A.J. (2001).
  Meta-analysis software. In M. Egger, G. Davey
  Smith D.G. Altmann (Eds.), Systematic Reviews
  in Health Care Meta-analysis in Context (pp.
  336-346). London BMJ Pub. Group.
•  Sutton, A.J., Lambert, P.C., Hellmich, M., et
  al. (2000). Meta-analysis in practice A critical
  review of available software. In D.A. Berry
  D.K. Stangl (Eds.), Meta-analysis in Medicine and
  Health Policy. New York Marcel Dekker.

14
Personal view

• Different Paradigms
• Different Data
• Different Skills
• Freeware, Metawin,
• Stata, winbugs
• Check out CMA
• collaboration