Thursday, January 29, 2009

Week 4: Research Methods

There is a great deal of difference between qualitative and quantitative design, although there are some research methods that take a little bit from each category. Qualitative studies include ethnographies, case studies, and descriptive studies. This type of research aims to investigate and describe the process of the situation, be it an participant ethnography, or a world-wide internet survey. Qualitative researchers collect 6 sources of data: documentation, archival records, interviews/surveys, direct observation, participant observation, and physical artifacts. Quantitative research includes correlational research and experimental research, of which there are several types: true experiments, quasi-experiments, and many, many others. Quantitative research frequently uses randomly-selected sample groups and seeks to control as many variables as possible, especially in true experiments. It also poses a questions and a hypothesis as the basis of the research. Statistics come into play much more in quantitative research, including descriptive stats (mean, median, mode) and inferential stats (chi squared, t test, f test.) An important point from Morgan is that it is not useful to argue over the merits of one or the other, but that researchers should instead choose the method that best answers their particular question. Qualitative research designs are most useful in describing in-depth situations as they occur in “natural” settings -as things occur in “real-life.” Quantitative research designs are most useful in describing correlational and causal relationships between different phenomena or variables.

There is a clear difference between Validity and Reliability, although the two terms are often used incorrectly when talking about research. They are both forms of accuracy, but measure different things. Validity is the degree to which the researcher measures what (s)he claims to measure. Reliability is the external and internal consistency of the measurements. Both are needed for the research to have credibility (of the research methods), transferability (of the results to a new researcher), dependability (explaining results), and confirmability (repeatable results from a similar test). These four aspects can be analyzed to gauge the effectiveness of the research.

Statistical probability is a way of looking at research results. Total probabilities should always equal 1.0 and the results often form a bell-shaped distribution. Probability is a useful method to infer population distributions from the actual sample results. Significance is the degree of probability of the result occurring strictly from chance. In a well-controlled test, if a certain result is more than this- that is if it is statistically significant- then it can be inferred that the result is caused by the independent variable and not from random chance. Statistical significance is the difference between correlation and causation.

1 comment:

  1. Hey. If this is the second time this comment comes up. I am sorry. I posted it one time and it did not show up after it was accepted. So. I did it again.

    Bryan,

    One of the problems I run into when reading about the same subject from several writers is the fact that they all express themselves differently. I sometimes get confused in defining the essence of ideas in the midst of all the competing words. Because of this, I was glad to read your posting. It was clearly written and covered the major topics systematically. The synopsis of the research designs was excellent. I noted that you specifically listed the six data sources for qualitative research. (As this was a point that I had glossed over in my reading, you deserve my thanks).

    I liked how you joined validity and reliability into two forms of accuracy before you described them individually and then joined them back together as sources of the four aspects of effective research. This was an effective method of describing the differences and relationships between validity and reliability. I believe it can also serve as a memory aid.

    Your descriptions of probability and significance were easily understood. The “difference in correlation and causation” made me stop and think. After I pondered a moment, I found the concept was well stated.

    Good job.
    Greg

    ReplyDelete